-- Logs begin at Mon 2022-09-12 22:49:09 UTC, end at Mon 2022-09-12 23:45:40 UTC. -- Sep 12 23:13:36.171000 dv-cinder-852009-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 12 23:13:36.178344 dv-cinder-852009-7-smb devstack@keystone.service[81372]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 12 23:13:36.180378 dv-cinder-852009-7-smb devstack@keystone.service[81372]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 12 23:13:36 2022] *** Sep 12 23:13:36.180378 dv-cinder-852009-7-smb devstack@keystone.service[81372]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 12 23:13:36.180378 dv-cinder-852009-7-smb devstack@keystone.service[81372]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 12 23:13:36.180378 dv-cinder-852009-7-smb devstack@keystone.service[81372]: nodename: dv-cinder-852009-7-smb Sep 12 23:13:36.180378 dv-cinder-852009-7-smb devstack@keystone.service[81372]: machine: x86_64 Sep 12 23:13:36.180378 dv-cinder-852009-7-smb devstack@keystone.service[81372]: clock source: unix Sep 12 23:13:36.180378 dv-cinder-852009-7-smb devstack@keystone.service[81372]: pcre jit disabled Sep 12 23:13:36.180378 dv-cinder-852009-7-smb devstack@keystone.service[81372]: detected number of CPU cores: 4 Sep 12 23:13:36.180856 dv-cinder-852009-7-smb devstack@keystone.service[81372]: current working directory: / Sep 12 23:13:36.180856 dv-cinder-852009-7-smb devstack@keystone.service[81372]: detected binary path: /usr/bin/uwsgi-core Sep 12 23:13:36.180856 dv-cinder-852009-7-smb devstack@keystone.service[81372]: your processes number limit is 47680 Sep 12 23:13:36.180856 dv-cinder-852009-7-smb devstack@keystone.service[81372]: your memory page size is 4096 bytes Sep 12 23:13:36.180856 dv-cinder-852009-7-smb devstack@keystone.service[81372]: detected max file descriptor number: 2048 Sep 12 23:13:36.180856 dv-cinder-852009-7-smb devstack@keystone.service[81372]: lock engine: pthread robust mutexes Sep 12 23:13:36.180856 dv-cinder-852009-7-smb devstack@keystone.service[81372]: thunder lock: enabled Sep 12 23:13:36.180856 dv-cinder-852009-7-smb devstack@keystone.service[81372]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 12 23:13:36.180856 dv-cinder-852009-7-smb devstack@keystone.service[81372]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 12 23:13:36.221832 dv-cinder-852009-7-smb devstack@keystone.service[81372]: Python main interpreter initialized at 0x5650e82679c0 Sep 12 23:13:36.221832 dv-cinder-852009-7-smb devstack@keystone.service[81372]: python threads support enabled Sep 12 23:13:36.221832 dv-cinder-852009-7-smb devstack@keystone.service[81372]: your server socket listen backlog is limited to 100 connections Sep 12 23:13:36.221832 dv-cinder-852009-7-smb devstack@keystone.service[81372]: your mercy for graceful operations on workers is 90 seconds Sep 12 23:13:36.222481 dv-cinder-852009-7-smb devstack@keystone.service[81372]: mapped 403077 bytes (393 KB) for 2 cores Sep 12 23:13:36.222481 dv-cinder-852009-7-smb devstack@keystone.service[81372]: *** Operational MODE: preforking *** Sep 12 23:13:36.222640 dv-cinder-852009-7-smb devstack@keystone.service[81372]: *** uWSGI is running in multiple interpreter mode *** Sep 12 23:13:36.222640 dv-cinder-852009-7-smb devstack@keystone.service[81372]: spawned uWSGI master process (pid: 81372) Sep 12 23:13:36.222770 dv-cinder-852009-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 12 23:13:36.223858 dv-cinder-852009-7-smb devstack@keystone.service[81372]: spawned uWSGI worker 1 (pid: 81386, cores: 1) Sep 12 23:13:36.223858 dv-cinder-852009-7-smb devstack@keystone.service[81372]: spawned uWSGI worker 2 (pid: 81387, cores: 1) Sep 12 23:13:36.223858 dv-cinder-852009-7-smb devstack@keystone.service[81372]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 12 23:13:40.557773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:13:40.557773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: from cryptography.utils import int_from_bytes Sep 12 23:13:40.558594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:13:40.558594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: from cryptography.utils import int_from_bytes Sep 12 23:13:40.560094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:13:40.560094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: from cryptography.utils import int_from_bytes Sep 12 23:13:40.560547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:13:40.560547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: from cryptography.utils import int_from_bytes Sep 12 23:13:40.608654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 23:13:40.608831 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 23:13:40.609025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] command line args: [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 23:13:40.609298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 23:13:40.609478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ================================================================================ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 23:13:40.609733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] admin_token = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.609981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config_dir = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.610171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.610354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config_source = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.610559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] debug = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.610758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.611013 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 23:13:40.611013 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 23:13:40.611127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.611266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] command line args: [] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 23:13:40.611342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.611480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 23:13:40.611564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.611670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ================================================================================ {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 23:13:40.611769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.611905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] admin_token = **** {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.611987 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.612148 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] config_dir = [] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.612231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_config_append = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.612337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.612431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.612528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_dir = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.612671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] config_source = [] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.612785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.612880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] debug = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.612978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.613078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.613177 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.613361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.613519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.613697 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.613774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.613898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.613979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.614058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.614181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.614260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.614405 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] list_limit = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.614495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.614575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] log_config_append = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.614651 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.614720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.614885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] log_dir = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.614966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.615058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] log_file = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.615142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.615290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.615434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.615539 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.615614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.615787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.615872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.616032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.616158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.616239 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.616373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.616541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.616629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.616717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] publish_errors = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.616846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.616952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.617069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.617185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.617294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.617368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.617522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.617604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.617753 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.617835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.617998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.618073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] standard_threads = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.618241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.618320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.618517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.618605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.618677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.618858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_journal = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.619011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.619094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_json = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.619189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] publish_errors = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.619270 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_stderr = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.619350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_syslog = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.619424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.619581 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.619662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.619792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.619867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.620036 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.620114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.620267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.620349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.620496 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] standard_threads = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.620571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.620724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.620801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.620964 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.621045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.621120 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.621235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.621317 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] use_journal = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.621457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] use_json = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.621530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.621628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] use_stderr = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.621702 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.621801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] use_syslog = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.621940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.622022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:13:40.622188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.622268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.622445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.622525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.622694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.622778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.622929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.623004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.623187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.623303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.623435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.623515 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.623676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.623762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.623905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.623992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.624151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.624228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.624395 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.624471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.624628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.624710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.624856 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.624935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.625098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.625180 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.625329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.625404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.625573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.625656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.625814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.625891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.626042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.626127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.626273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.626348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.626542 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.626618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.626780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.626867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.627014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.627090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.627246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.627322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.627478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.627561 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.627725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.627802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.627974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.628049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.628200 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.628342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.628637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.628750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.628990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.629072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.629230 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.629316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.629466 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.629549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.629698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.629799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.629929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.630036 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.630162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.630269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.630411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.630542 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.630654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.630793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.630905 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.631031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.631136 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.631280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.631412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.631567 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.631640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.631735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.631830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.631967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.632065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.632197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.632315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.632426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.632548 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.632657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.632785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.632876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.633022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.633104 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.633259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.633335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.633501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.633587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.633740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.633815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.633971 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.634045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.634215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.634297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.634472 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.634551 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.634698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.634804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.634935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.635040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.635169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.635277 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.635406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.635509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.635641 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.635729 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.635877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.635994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.636110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.636184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.636339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.636419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.636586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.636666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.636822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.636946 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.637056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.637133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.637287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.637367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.637522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.637640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.637756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.637833 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.637987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.638068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.638222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.638301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.638486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.638564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.638716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.638833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.638955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.639031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.639200 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.639275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.639435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.639515 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.639667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.639782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.639901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.639977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.640132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.640212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.640366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.640442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.640600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.640682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.640836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.640917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.641075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.641151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.641308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.641385 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.641550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.641626 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.641780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.641855 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.642012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.642094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.642245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.642322 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.642499 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.642577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.642731 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.642809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.642953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.643026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.643184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.643260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.643424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.643513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.643656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.643741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.644405 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.644494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.644649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.644871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.644949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.645152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.645322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.645565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.645641 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.645806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.645882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.646040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.646117 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.646273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.646348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.external = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.646529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.646609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.646766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.646843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.646997 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.647081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.647235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.647358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.password = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.647468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.647547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.token = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.647701 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.647779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.647935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.648010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.648183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.648260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.648415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.648493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.648662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.648745 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.648888 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] auth.external = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.648964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.649116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.649194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.649349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.649424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.649599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.649684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.649841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] auth.password = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.649918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.650070 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] auth.token = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.650147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.650306 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.650434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.650563 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.650642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.650804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.650878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.651031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.651107 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.651276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.651360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.651520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.651596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.651748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.651824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.651982 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] credential.caching = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.652059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.652640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.652722 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.652793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.652863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.652945 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.653017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.653087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.653156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.653232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.653303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.653380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.653451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.653598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.653675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.653847 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.653923 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.654081 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.654159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.654331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.654426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.654618 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.654708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.654862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.654939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.655098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.655174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.655342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.655428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.655577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.655652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.655813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] federation.caching = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.655889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.656047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.656130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.656287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.656363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.656530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.656607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.656758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.656842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.656990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.657072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.657222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.657298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.657458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.657612 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.657695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.657771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.657929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.658007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.658162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.658247 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.658412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.658492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.658664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.658790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.caching = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.658865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.658948 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.659112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.659190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.659340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.659416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.659636 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.660225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.660397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.660590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.660675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.660877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.660954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.661121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.661199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.661356 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.661432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.661588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.661666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.661827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.661905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.662056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.662132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.662290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.662366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.662555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.662634 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.662796 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.662873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.663046 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.663122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.663276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.663354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.663529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.663605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.663777 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.663854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.664015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.664094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.664249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.664325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.664479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.664556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.664715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.664794 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.664944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.665274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.665427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.665512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.665664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.665740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.665899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.665975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.666141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.666226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.666369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.666460 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.666635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.666745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.666884 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.667004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.667119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.667259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.667367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.667483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.667614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.667720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.667844 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.667972 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.668079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.668224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.668301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.668463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.668542 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.668701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.668779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.668940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.669018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.669175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.669253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.669418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.669532 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.669680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.669788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.669915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.670042 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.670164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.670275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.670439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.670521 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.670690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.670770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.670928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.671007 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.671162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.671238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.671400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.671478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.671637 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.671714 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.671874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.671951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.672107 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.672187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.672357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.672434 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.672586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.672662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.672839 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.672917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.673083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.673158 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.673326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.673401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.673556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.673633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.673780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.673855 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.674014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.674090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.674247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.674325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.674502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.674580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.674731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.674807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.674976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.675055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.675247 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.675326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.675487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.675714 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.675799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.675963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.676038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.676206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.676283 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.676443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.676532 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.676680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.676757 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.676917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.676994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.677165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.677250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.677399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.677476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.677631 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.677711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.677866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.677951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.678107 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.678183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.678340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.678436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.678619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.678711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.678845 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.678921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.679088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.679164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.679322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.679407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.679558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.679634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.679792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.679868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.680028 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.680111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.680264 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.680340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.680495 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.680572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.680730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.680814 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.680961 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.681037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] resource.caching = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.681207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.681344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.681494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.681568 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.681674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.681751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.681920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.682004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.682166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.682247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.682442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.682524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.682660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.682738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.682899 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.682978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.683128 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.683204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.683359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] role.caching = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.683445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.683600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] role.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.683679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.683829 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.683906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.684075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.684151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.684322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.684469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.684567 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.684710 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.684812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.684965 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.685049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.685220 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.685297 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.685473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.685549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.685725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.685811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.685963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.686040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.686206 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.686281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.686480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.686571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.686724 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.686802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.686957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.687034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.687191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.687343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.687420 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.687582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.687705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.687834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.687921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.688086 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.688163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.688336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.688412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.688586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.688670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.688815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.688890 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.689050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.689126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.689288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.689372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.689527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.689608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.689756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.689832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.689986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.690071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.690216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.690292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.690490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.690572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.691288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.691512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.691595 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.691656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.691736 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.691974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.692205 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.692297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.692371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.692441 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.692587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.692665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.692832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] token.caching = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.692918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.693071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.693150 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.693324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.693410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.693562 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.693639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.693820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.693899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.694070 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.694147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.694309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.694401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.694579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.694659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.694823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.694900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.695068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.695152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.695302 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.695380 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.695538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.695614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.695770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.695846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.696012 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.696090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.696250 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.696328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.696495 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.696579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.696728 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.696806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.696978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.697063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.697212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.697296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.connection = **** {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.697456 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.697534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.697685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.697765 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.697923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.698000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.698157 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.698234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.698313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 23:13:40.698434 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.698636 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.698872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.699107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.699349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.699583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.699823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.700054 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.700300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.700534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.700775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.701006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.701244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.701478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:13:40.701646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 23:13:40.728388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.728619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.728849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.730582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.730815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.731040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.737258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.739639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.766075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.766305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.768024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.768256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.820401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.821147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.870570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.870802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.871498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:40.871732 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.026066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.026294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.026482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.026576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.026716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.026803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.026940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.027023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.027166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.027303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.027378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.027576 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.050964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.051201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.051433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.051534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.051664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.051749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.051889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.051971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.052110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.052195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.052330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.052414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.052545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.052761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.063427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.063588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.076139 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.076375 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.076458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.076600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.076684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.076821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.076904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.077039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.077132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.077251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.077332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.077464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.077545 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.077676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:13:41.095121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.095320 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.095412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 23:13:41.095529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 23:13:41.095672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.095869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.095955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 23:13:41.096067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 23:13:41.096149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.096336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.096426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.096592 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.096675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.096849 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.096929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.097154 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.106695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.106980 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.107070 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.107258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.107349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.107549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.107640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.107826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.115076 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.116062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.117974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.118264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.118579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.118868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.118959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.119157 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.119261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.119421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.119512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.119694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.119783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.119969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.120060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.120241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.120332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.120517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.120616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.120787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.120877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.121056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.121327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.121592 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.143974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.145422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.145529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.145716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.146915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.147198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.150371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.150746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.151035 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.151824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.152108 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.152391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.157354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.157645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.158685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.158973 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.163501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.163804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.164101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.164395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.164680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.164927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.165266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.165479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.165569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.165755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.165852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.166040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.166315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.166610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.166877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.167147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.181913 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.182205 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.183232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.183510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.186065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.187311 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.189342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.189651 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.190478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.190846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.194763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.196590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.197883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.199664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.201067 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.201371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.201661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.201945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.202224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.202528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.202839 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.203137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.203423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.203708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.203985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.204260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.218050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.218342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.218640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.218907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.220048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.220335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.220603 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.220868 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.225656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.227205 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.228134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.228711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.228991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.229663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.231225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.231503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.231687 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.231981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.232267 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.232552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.232945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.234289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.234601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.234889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.235173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.235557 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.244583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.244874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.245160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.245448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.245833 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.246125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.246436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.247462 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.247745 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.248024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.248303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.248677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.248953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.249242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.262230 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.265127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.265214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.268039 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.268123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.269580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.271074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.271328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.271410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.271759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.272770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.274206 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.274522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.274931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.278120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.279562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.281219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.282477 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.282688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.282879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.283173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.283458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.285889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.286281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.286602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.286884 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.291764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.292058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.292344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.294857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.295141 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.295419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.299228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.299519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.299804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.300085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.300885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.301168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.301447 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.301727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.301999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.302276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.302575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.302855 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.303073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:13:41.303209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.303341 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.303467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.303628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.303904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.304177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.304449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.304723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.305017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.305285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.305560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.305837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.306123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.306442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.306757 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:13:41.337735 dv-cinder-852009-7-smb devstack@keystone.service[81386]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5650e82679c0 pid: 81386 (default app) Sep 12 23:13:41.341026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6673079-7673-4108-ae4c-2ef912abc3b7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:41.341316 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6673079-7673-4108-ae4c-2ef912abc3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:41.341483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5650e82679c0 pid: 81387 (default app) Sep 12 23:13:41.341587 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6673079-7673-4108-ae4c-2ef912abc3b7 None None] PATH_INFO: `/v3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:41.345758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Mon Sep 12 23:13:41 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:13:48.148156 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be2579-ed00-4a01-8192-e669adafe5b2 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:48.148697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be2579-ed00-4a01-8192-e669adafe5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:48.148697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be2579-ed00-4a01-8192-e669adafe5b2 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:48.152982 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:13:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:13:48.158266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f80e2-9ffb-4a83-a3eb-fc2a8a4f5683 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:48.158783 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f80e2-9ffb-4a83-a3eb-fc2a8a4f5683 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:48.158887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f80e2-9ffb-4a83-a3eb-fc2a8a4f5683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:48.231779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: INFO dbcounter [None req-b10f80e2-9ffb-4a83-a3eb-fc2a8a4f5683 None None] Registered counter for database keystone Sep 12 23:13:48.250760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG oslo_db.sqlalchemy.engines [None req-b10f80e2-9ffb-4a83-a3eb-fc2a8a4f5683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:13:48.257582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writer thread running {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:13:48.439598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG passlib.handlers.bcrypt [None req-b10f80e2-9ffb-4a83-a3eb-fc2a8a4f5683 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81386) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 12 23:13:48.439915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG passlib.handlers.bcrypt [None req-b10f80e2-9ffb-4a83-a3eb-fc2a8a4f5683 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81386) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 12 23:13:48.497959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b10f80e2-9ffb-4a83-a3eb-fc2a8a4f5683 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:13:48.499606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b10f80e2-9ffb-4a83-a3eb-fc2a8a4f5683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:13:48.627759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:13:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 12 23:13:48.915666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be2579-ed00-4a01-8192-e669adafe5b2 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:48.985096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: INFO dbcounter [None req-48be2579-ed00-4a01-8192-e669adafe5b2 None None] Registered counter for database keystone Sep 12 23:13:49.006859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG oslo_db.sqlalchemy.engines [None req-48be2579-ed00-4a01-8192-e669adafe5b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:13:49.013424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writer thread running {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:13:49.137865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be2579-ed00-4a01-8192-e669adafe5b2 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:49.142082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33f15-9ca7-4765-9661-c82df49e44e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:49.142735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33f15-9ca7-4765-9661-c82df49e44e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:49.143018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33f15-9ca7-4765-9661-c82df49e44e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:49.143289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33f15-9ca7-4765-9661-c82df49e44e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:49.151749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c33f15-9ca7-4765-9661-c82df49e44e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:49.203446 dv-cinder-852009-7-smb devstack@keystone.service[81387]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e7c33f15-9ca7-4765-9661-c82df49e44e1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 12 23:13:49.203733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c33f15-9ca7-4765-9661-c82df49e44e1 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:49.213284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Mon Sep 12 23:13:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:13:49.219203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f80e2-9ffb-4a83-a3eb-fc2a8a4f5683 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:49.236314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f80e2-9ffb-4a83-a3eb-fc2a8a4f5683 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:49.241424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dc5c5-620d-41b1-a358-691431f763c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:49.242571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dc5c5-620d-41b1-a358-691431f763c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:49.242860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dc5c5-620d-41b1-a358-691431f763c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:49.243132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dc5c5-620d-41b1-a358-691431f763c6 admin admin] PATH_INFO: `/v3/projects/0a803ea5f3c94589b38112108dcb63f7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:49.244711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dc5c5-620d-41b1-a358-691431f763c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a803ea5f3c94589b38112108dcb63f7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:49.296860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3b3dc5c5-620d-41b1-a358-691431f763c6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 12 23:13:49.297204 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dc5c5-620d-41b1-a358-691431f763c6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:49.302453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Mon Sep 12 23:13:49 2022] GET /identity/v3/projects/0a803ea5f3c94589b38112108dcb63f7 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:13:51.411310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeeba1-1274-49a0-840d-b64de34e1091 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:51.411763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeeba1-1274-49a0-840d-b64de34e1091 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:51.411871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeeba1-1274-49a0-840d-b64de34e1091 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:51.416221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:13:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:13:51.421598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b45c9-76f4-4a3c-88f9-ec46d7e25f25 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:51.421961 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b45c9-76f4-4a3c-88f9-ec46d7e25f25 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:51.422147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b45c9-76f4-4a3c-88f9-ec46d7e25f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:51.443450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ef8b45c9-76f4-4a3c-88f9-ec46d7e25f25 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:13:51.444944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ef8b45c9-76f4-4a3c-88f9-ec46d7e25f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:13:51.452623 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:13:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 12 23:13:51.725822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeeba1-1274-49a0-840d-b64de34e1091 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:51.738480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeeba1-1274-49a0-840d-b64de34e1091 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:51.742667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fecaa6-ca77-44b9-a913-965b47e58f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:51.743259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fecaa6-ca77-44b9-a913-965b47e58f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:51.743537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fecaa6-ca77-44b9-a913-965b47e58f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:51.743810 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fecaa6-ca77-44b9-a913-965b47e58f23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:51.751226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fecaa6-ca77-44b9-a913-965b47e58f23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:51.752992 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fecaa6-ca77-44b9-a913-965b47e58f23 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:51.762448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Mon Sep 12 23:13:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:13:51.767643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b45c9-76f4-4a3c-88f9-ec46d7e25f25 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:51.777435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b45c9-76f4-4a3c-88f9-ec46d7e25f25 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:51.781711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d1ce-454e-4261-a3d1-eb9a7397cec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:51.782329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d1ce-454e-4261-a3d1-eb9a7397cec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:51.782630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d1ce-454e-4261-a3d1-eb9a7397cec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:51.782902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d1ce-454e-4261-a3d1-eb9a7397cec4 admin admin] PATH_INFO: `/v3/users/2b404d3419014a9a8edff785259ec500` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:51.784196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52d1ce-454e-4261-a3d1-eb9a7397cec4 admin admin] RBAC: Authorizing `identity:get_user(user_id=2b404d3419014a9a8edff785259ec500)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:51.786368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52d1ce-454e-4261-a3d1-eb9a7397cec4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:51.787871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Mon Sep 12 23:13:51 2022] GET /identity/v3/users/2b404d3419014a9a8edff785259ec500 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:13:53.992692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8f384-0803-4535-a368-67962f7802b3 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:53.993273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8f384-0803-4535-a368-67962f7802b3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:53.993273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8f384-0803-4535-a368-67962f7802b3 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:53.994602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:13:53.999953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58518b-cee7-4f68-80c3-c8a04a96bb54 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:54.000381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58518b-cee7-4f68-80c3-c8a04a96bb54 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:54.000509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58518b-cee7-4f68-80c3-c8a04a96bb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:54.019467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fb58518b-cee7-4f68-80c3-c8a04a96bb54 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:13:54.020652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fb58518b-cee7-4f68-80c3-c8a04a96bb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:13:54.041386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd89cc-cbad-4ae1-8661-7da5b3c3302f None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:54.041676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd89cc-cbad-4ae1-8661-7da5b3c3302f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:54.041957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd89cc-cbad-4ae1-8661-7da5b3c3302f None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:54.043312 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:13:54.048277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4feaaa-6bdb-4c25-90df-028302340768 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:54.048562 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4feaaa-6bdb-4c25-90df-028302340768 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:54.048835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4feaaa-6bdb-4c25-90df-028302340768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:54.091614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG passlib.handlers.bcrypt [None req-cd4feaaa-6bdb-4c25-90df-028302340768 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81387) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 12 23:13:54.092040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG passlib.handlers.bcrypt [None req-cd4feaaa-6bdb-4c25-90df-028302340768 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81387) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 12 23:13:54.105813 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:13:54.141101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cd4feaaa-6bdb-4c25-90df-028302340768 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:13:54.142751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cd4feaaa-6bdb-4c25-90df-028302340768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:13:54.243552 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:13:54.385064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58518b-cee7-4f68-80c3-c8a04a96bb54 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:54.410387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:54.495729 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58518b-cee7-4f68-80c3-c8a04a96bb54 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:54.511049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4feaaa-6bdb-4c25-90df-028302340768 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:54.529816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b320a8e-f7f2-403d-8452-a01ce3652cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:54.530490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b320a8e-f7f2-403d-8452-a01ce3652cae None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:54.530773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b320a8e-f7f2-403d-8452-a01ce3652cae None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:54.531049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b320a8e-f7f2-403d-8452-a01ce3652cae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:54.543184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b320a8e-f7f2-403d-8452-a01ce3652cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0b320a8e-f7f2-403d-8452-a01ce3652cae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:13:54.552628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:13:54.553809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:13:54.554680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:13:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:13:54.559515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b320a8e-f7f2-403d-8452-a01ce3652cae None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:54.612719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4feaaa-6bdb-4c25-90df-028302340768 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:54.615014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:54.640874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:54.651278 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f761c1-7806-43ad-b675-d010c67b34ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:54.652143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f761c1-7806-43ad-b675-d010c67b34ef None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:54.652426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f761c1-7806-43ad-b675-d010c67b34ef None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:54.652699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f761c1-7806-43ad-b675-d010c67b34ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:54.660476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b320a8e-f7f2-403d-8452-a01ce3652cae None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:54.698722 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90694f-384c-4fe4-9e7d-2735dcf61cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:54.699370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90694f-384c-4fe4-9e7d-2735dcf61cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:54.699655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90694f-384c-4fe4-9e7d-2735dcf61cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:54.699932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90694f-384c-4fe4-9e7d-2735dcf61cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:54.700599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90694f-384c-4fe4-9e7d-2735dcf61cf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:13:54.700905 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90694f-384c-4fe4-9e7d-2735dcf61cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:54.702306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90694f-384c-4fe4-9e7d-2735dcf61cf5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:54.714811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:13:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:13:54.720377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90694f-384c-4fe4-9e7d-2735dcf61cf5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:54.724858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f761c1-7806-43ad-b675-d010c67b34ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:54.726437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f761c1-7806-43ad-b675-d010c67b34ef None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:54.818341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90694f-384c-4fe4-9e7d-2735dcf61cf5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:54.823920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:13:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:13:54.829421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f761c1-7806-43ad-b675-d010c67b34ef None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:54.832712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:54.852073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d7330-a46d-49e7-af51-4dfaa7e45958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:54.852711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7330-a46d-49e7-af51-4dfaa7e45958 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:54.852992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7330-a46d-49e7-af51-4dfaa7e45958 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:54.853264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7330-a46d-49e7-af51-4dfaa7e45958 None admin] PATH_INFO: `/v3/users/2b404d3419014a9a8edff785259ec500` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:54.854416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d7330-a46d-49e7-af51-4dfaa7e45958 None admin] RBAC: Authorizing `identity:get_user(user_id=2b404d3419014a9a8edff785259ec500)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:54.855876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d7330-a46d-49e7-af51-4dfaa7e45958 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:54.857433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:13:54 2022] GET /identity/v3/users/2b404d3419014a9a8edff785259ec500 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:13:54.863403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d7330-a46d-49e7-af51-4dfaa7e45958 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:54.877307 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:54.926999 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f761c1-7806-43ad-b675-d010c67b34ef None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:54.960332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f262-2f88-4133-acd9-f9ca09c52fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:54.961174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f262-2f88-4133-acd9-f9ca09c52fcb None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:54.961456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f262-2f88-4133-acd9-f9ca09c52fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:54.961723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f262-2f88-4133-acd9-f9ca09c52fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:54.962136 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d7330-a46d-49e7-af51-4dfaa7e45958 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:54.980718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857f262-2f88-4133-acd9-f9ca09c52fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:54.982197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857f262-2f88-4133-acd9-f9ca09c52fcb None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:54.998528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f1254-98e7-40dd-abad-9c9618195d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:54.999163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1254-98e7-40dd-abad-9c9618195d30 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:54.999445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1254-98e7-40dd-abad-9c9618195d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:54.999717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1254-98e7-40dd-abad-9c9618195d30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-c857f262-2f88-4133-acd9-f9ca09c52fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:13:55.000142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:13:55.001399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:13:55.002178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:13:55.002178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:13:55.002178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:13:55.002344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f1254-98e7-40dd-abad-9c9618195d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:55.002828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 9/18] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:13:55.002909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f1254-98e7-40dd-abad-9c9618195d30 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:55.004377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 10/19] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:13:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:13:55.007858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f262-2f88-4133-acd9-f9ca09c52fcb None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:55.009846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f1254-98e7-40dd-abad-9c9618195d30 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:55.063172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:55.089355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:55.108932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f1254-98e7-40dd-abad-9c9618195d30 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:55.110423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f262-2f88-4133-acd9-f9ca09c52fcb None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:55.142586 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0877-f603-4aa5-a34d-98f633470cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:55.143190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0877-f603-4aa5-a34d-98f633470cca None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:55.143472 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0877-f603-4aa5-a34d-98f633470cca None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:55.144553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0877-f603-4aa5-a34d-98f633470cca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:55.145133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0877-f603-4aa5-a34d-98f633470cca None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.domain.id=default, user.id=2b404d3419014a9a8edff785259ec500) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:13:55.145410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0877-f603-4aa5-a34d-98f633470cca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:55.145760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a571d6-2a58-4386-bc3a-121e347d984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:55.146397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a571d6-2a58-4386-bc3a-121e347d984e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:55.146694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a571d6-2a58-4386-bc3a-121e347d984e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:55.146929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0877-f603-4aa5-a34d-98f633470cca None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:55.147023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a571d6-2a58-4386-bc3a-121e347d984e None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:55.147597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a571d6-2a58-4386-bc3a-121e347d984e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:13:55.147896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a571d6-2a58-4386-bc3a-121e347d984e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:55.149324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a571d6-2a58-4386-bc3a-121e347d984e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:55.153658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1322 bytes} [Mon Sep 12 23:13:55 2022] GET /identity/v3/role_assignments?user.id=2b404d3419014a9a8edff785259ec500&scope.domain.id=default&role.id=6413aac4240a46ba816472c29e305973 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:13:55.168439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:13:57.527007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc45f8-b70a-4095-a1f0-a42cc0ceb0a1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:57.528037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc45f8-b70a-4095-a1f0-a42cc0ceb0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:57.528528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc45f8-b70a-4095-a1f0-a42cc0ceb0a1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:57.530423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:13:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:13:57.536892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bf74a-855a-4479-b818-a09b8d45e492 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:57.537782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bf74a-855a-4479-b818-a09b8d45e492 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:57.538253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bf74a-855a-4479-b818-a09b8d45e492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:57.567508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-129bf74a-855a-4479-b818-a09b8d45e492 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:13:57.569072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-129bf74a-855a-4479-b818-a09b8d45e492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:13:57.580545 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0563b-c931-4201-9e71-d10f6346365c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:57.581739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0563b-c931-4201-9e71-d10f6346365c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:57.582552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0563b-c931-4201-9e71-d10f6346365c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:57.584270 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 13/23] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:13:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:13:57.589735 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac8704-b380-44f3-89eb-70def6e557b5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:57.590278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac8704-b380-44f3-89eb-70def6e557b5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:57.590794 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac8704-b380-44f3-89eb-70def6e557b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:57.627378 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4aac8704-b380-44f3-89eb-70def6e557b5 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:13:57.629245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4aac8704-b380-44f3-89eb-70def6e557b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:13:57.710566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 11/24] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:13:57.765857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 14/25] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:13:58.071600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bf74a-855a-4479-b818-a09b8d45e492 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:58.133648 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:58.207060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bf74a-855a-4479-b818-a09b8d45e492 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:58.265698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16307a36-0c20-4ead-b175-a375488a3591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:58.266358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307a36-0c20-4ead-b175-a375488a3591 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:58.266664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307a36-0c20-4ead-b175-a375488a3591 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:58.266938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307a36-0c20-4ead-b175-a375488a3591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:58.278050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16307a36-0c20-4ead-b175-a375488a3591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:58.279582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16307a36-0c20-4ead-b175-a375488a3591 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:58.309058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac8704-b380-44f3-89eb-70def6e557b5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-16307a36-0c20-4ead-b175-a375488a3591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:13:58.309276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:13:58.310043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:13:58.311277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:13:58.311277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:13:58.311277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:13:58.311277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 12/26] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:13:58.317282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16307a36-0c20-4ead-b175-a375488a3591 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:58.465031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:58.472047 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:58.476264 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16307a36-0c20-4ead-b175-a375488a3591 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:58.490025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac8704-b380-44f3-89eb-70def6e557b5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:58.514066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d99fd-3c4e-45b2-a6cb-649a7876e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:58.514950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d99fd-3c4e-45b2-a6cb-649a7876e928 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:58.515367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d99fd-3c4e-45b2-a6cb-649a7876e928 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:58.515796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d99fd-3c4e-45b2-a6cb-649a7876e928 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:58.516580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d99fd-3c4e-45b2-a6cb-649a7876e928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:13:58.517024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d99fd-3c4e-45b2-a6cb-649a7876e928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:58.519434 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d99fd-3c4e-45b2-a6cb-649a7876e928 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:58.526162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb1868-96ef-427a-bcdb-fb00d78910b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:58.526842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb1868-96ef-427a-bcdb-fb00d78910b1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:58.527304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb1868-96ef-427a-bcdb-fb00d78910b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:58.528162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb1868-96ef-427a-bcdb-fb00d78910b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:58.532391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 13/27] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:13:58.533808 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaeb17-7469-45d6-bcc9-1cade0a3de80 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:58.534897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaeb17-7469-45d6-bcc9-1cade0a3de80 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:58.535588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaeb17-7469-45d6-bcc9-1cade0a3de80 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:58.537228 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 14/28] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:13:58.543308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0250a-cfc9-4128-8d24-92888b75d554 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:58.543743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0250a-cfc9-4128-8d24-92888b75d554 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:58.544167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0250a-cfc9-4128-8d24-92888b75d554 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:58.545271 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb1868-96ef-427a-bcdb-fb00d78910b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:13:58.545926 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 15/29] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:13:58.547282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3ce43-514c-469d-901c-93c94e03b78b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:58.547698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3ce43-514c-469d-901c-93c94e03b78b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:58.548118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3ce43-514c-469d-901c-93c94e03b78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3adb1868-96ef-427a-bcdb-fb00d78910b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:13:58.555231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:13:58.556319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 15/30] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:13:58.557240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb1868-96ef-427a-bcdb-fb00d78910b1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:58.571119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-a0c3ce43-514c-469d-901c-93c94e03b78b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:13:58.572622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a0c3ce43-514c-469d-901c-93c94e03b78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:13:58.650679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 16/31] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:13:58.652226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f791c4-af85-4728-a411-965687593ec1 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:58.652682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f791c4-af85-4728-a411-965687593ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:58.653192 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f791c4-af85-4728-a411-965687593ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:58.659784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb1868-96ef-427a-bcdb-fb00d78910b1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:58.688169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-52f791c4-af85-4728-a411-965687593ec1 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:13:58.689383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-52f791c4-af85-4728-a411-965687593ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:13:58.702774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bddfc0-b60f-4941-bd16-d27b7c6893ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:58.703430 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bddfc0-b60f-4941-bd16-d27b7c6893ac None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:58.703712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bddfc0-b60f-4941-bd16-d27b7c6893ac None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:58.705455 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bddfc0-b60f-4941-bd16-d27b7c6893ac None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:58.706182 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bddfc0-b60f-4941-bd16-d27b7c6893ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:58.708625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bddfc0-b60f-4941-bd16-d27b7c6893ac None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:58.719864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:58.833097 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 17/32] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:13:58.833996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f791c4-af85-4728-a411-965687593ec1 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:58.899840 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:58.914070 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 16/33] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:13:58 2022] POST /identity/v3/projects => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:13:59.001793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bddfc0-b60f-4941-bd16-d27b7c6893ac None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:59.055900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f791c4-af85-4728-a411-965687593ec1 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:59.124941 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a232ce-acd6-4ac9-8783-7177907d39a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:59.125582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a232ce-acd6-4ac9-8783-7177907d39a2 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:59.125869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a232ce-acd6-4ac9-8783-7177907d39a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:59.126148 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a232ce-acd6-4ac9-8783-7177907d39a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:59.126874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a232ce-acd6-4ac9-8783-7177907d39a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:13:59.127287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a232ce-acd6-4ac9-8783-7177907d39a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:59.129582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a232ce-acd6-4ac9-8783-7177907d39a2 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:59.154437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 18/34] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:13:59.161226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a232ce-acd6-4ac9-8783-7177907d39a2 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:59.213345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bddfc0-b60f-4941-bd16-d27b7c6893ac None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:59.265509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ff2b0-e4d9-4d96-a6a9-036178f20fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:59.266399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ff2b0-e4d9-4d96-a6a9-036178f20fbf None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:59.267078 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ff2b0-e4d9-4d96-a6a9-036178f20fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:59.267362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ff2b0-e4d9-4d96-a6a9-036178f20fbf None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:59.268046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ff2b0-e4d9-4d96-a6a9-036178f20fbf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:59.272057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ff2b0-e4d9-4d96-a6a9-036178f20fbf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:59.293984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 17/35] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Sep 12 23:13:59 2022] POST /identity/v3/roles => generated 225 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:13:59.294898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ff2b0-e4d9-4d96-a6a9-036178f20fbf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:59.299231 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:59.325291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a232ce-acd6-4ac9-8783-7177907d39a2 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:59.371091 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:59.372530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb2394-b5ca-473e-809f-178b287f4314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:59.373194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb2394-b5ca-473e-809f-178b287f4314 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:59.380634 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb2394-b5ca-473e-809f-178b287f4314 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:59.380634 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb2394-b5ca-473e-809f-178b287f4314 None admin] PATH_INFO: `/v3/users/2b404d3419014a9a8edff785259ec500` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:59.384774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb2394-b5ca-473e-809f-178b287f4314 None admin] RBAC: Authorizing `identity:get_user(user_id=2b404d3419014a9a8edff785259ec500)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:59.390446 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb2394-b5ca-473e-809f-178b287f4314 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:59.390446 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 19/36] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:13:59 2022] GET /identity/v3/users/2b404d3419014a9a8edff785259ec500 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:13:59.408773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb2394-b5ca-473e-809f-178b287f4314 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:59.524426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ff2b0-e4d9-4d96-a6a9-036178f20fbf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:59.562218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb2394-b5ca-473e-809f-178b287f4314 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:59.581303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991ad6d-c701-44f0-8281-d31f728a147b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:59.582624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991ad6d-c701-44f0-8281-d31f728a147b None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:59.583108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991ad6d-c701-44f0-8281-d31f728a147b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:59.583582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991ad6d-c701-44f0-8281-d31f728a147b None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:59.584470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991ad6d-c701-44f0-8281-d31f728a147b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:59.586082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991ad6d-c701-44f0-8281-d31f728a147b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:59.604251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe409f-5f19-4162-885d-c4200ea47981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:59.604984 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe409f-5f19-4162-885d-c4200ea47981 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:59.605254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe409f-5f19-4162-885d-c4200ea47981 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:59.605522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe409f-5f19-4162-885d-c4200ea47981 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:59.606650 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe409f-5f19-4162-885d-c4200ea47981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:59.610408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe409f-5f19-4162-885d-c4200ea47981 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:59.610408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:13:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:13:59.610728 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 18/38] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Sep 12 23:13:59 2022] POST /identity/v3/roles => generated 219 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:13:59.616040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd1861-095d-4c5b-9995-d790da00614f None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:59.616322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd1861-095d-4c5b-9995-d790da00614f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:59.616651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd1861-095d-4c5b-9995-d790da00614f None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:59.618120 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 21/39] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:13:59.620498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991ad6d-c701-44f0-8281-d31f728a147b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:13:59.624946 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5edddd-3e62-4870-ae8f-ea7186c4181f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:59.625241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5edddd-3e62-4870-ae8f-ea7186c4181f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:59.625487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5edddd-3e62-4870-ae8f-ea7186c4181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:59.647273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cf5edddd-3e62-4870-ae8f-ea7186c4181f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:13:59.648683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cf5edddd-3e62-4870-ae8f-ea7186c4181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:13:59.663401 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:59.735991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 22/40] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:13:59.737173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a1639-96bf-45b3-ab4b-fbac7854fe3f None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:59.738544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a1639-96bf-45b3-ab4b-fbac7854fe3f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:59.738835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a1639-96bf-45b3-ab4b-fbac7854fe3f None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:59.740558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 23/41] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:13:59.746215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8d2c2-8242-4eae-9601-43dfbf93e708 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:59.746519 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8d2c2-8242-4eae-9601-43dfbf93e708 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:59.746800 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8d2c2-8242-4eae-9601-43dfbf93e708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:59.755446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991ad6d-c701-44f0-8281-d31f728a147b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:13:59.763885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:13:59.771157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-55a8d2c2-8242-4eae-9601-43dfbf93e708 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:13:59.773003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-55a8d2c2-8242-4eae-9601-43dfbf93e708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:13:59.804948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dc929-9b85-4247-a7f1-5c18ec2de5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:13:59.805605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dc929-9b85-4247-a7f1-5c18ec2de5cf None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:13:59.805897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dc929-9b85-4247-a7f1-5c18ec2de5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:13:59.806176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dc929-9b85-4247-a7f1-5c18ec2de5cf None admin] PATH_INFO: `/v3/domains/default/users/2b404d3419014a9a8edff785259ec500/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:13:59.808326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dc929-9b85-4247-a7f1-5c18ec2de5cf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2b404d3419014a9a8edff785259ec500, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:13:59.809826 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dc929-9b85-4247-a7f1-5c18ec2de5cf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:13:59.828451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 19/42] 10.222.0.33 () {58 vars in 1361 bytes} [Mon Sep 12 23:13:59 2022] PUT /identity/v3/domains/default/users/2b404d3419014a9a8edff785259ec500/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:13:59.857785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 24/43] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:14:00.013027 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dc929-9b85-4247-a7f1-5c18ec2de5cf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:00.118643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dc929-9b85-4247-a7f1-5c18ec2de5cf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:00.126874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8d2c2-8242-4eae-9601-43dfbf93e708 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:00.155266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06250ed9-5d99-4330-921b-1b50b009ffba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:00.155917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06250ed9-5d99-4330-921b-1b50b009ffba None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:00.156204 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06250ed9-5d99-4330-921b-1b50b009ffba None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:00.156484 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06250ed9-5d99-4330-921b-1b50b009ffba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:00.157610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06250ed9-5d99-4330-921b-1b50b009ffba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:00.159657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06250ed9-5d99-4330-921b-1b50b009ffba None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:00.162417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 20/44] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:00.166967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06250ed9-5d99-4330-921b-1b50b009ffba None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:00.204851 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:00.209886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:00.235860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8d2c2-8242-4eae-9601-43dfbf93e708 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:00.274893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a8e3e-5e27-419f-ad6e-342002e61b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:00.275506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a8e3e-5e27-419f-ad6e-342002e61b1d None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:00.275787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a8e3e-5e27-419f-ad6e-342002e61b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:00.276059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a8e3e-5e27-419f-ad6e-342002e61b1d None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:00.276724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a8e3e-5e27-419f-ad6e-342002e61b1d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:00.277310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06250ed9-5d99-4330-921b-1b50b009ffba None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:00.278110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a8e3e-5e27-419f-ad6e-342002e61b1d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:00.407028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 25/45] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Sep 12 23:14:00 2022] POST /identity/v3/roles => generated 223 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:14:00.419026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace0f8e-5462-48ff-837b-a5d900afe313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:00.419671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0f8e-5462-48ff-837b-a5d900afe313 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:00.419956 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0f8e-5462-48ff-837b-a5d900afe313 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:00.420230 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0f8e-5462-48ff-837b-a5d900afe313 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:00.420912 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace0f8e-5462-48ff-837b-a5d900afe313 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:00.422457 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace0f8e-5462-48ff-837b-a5d900afe313 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:00.453912 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 21/46] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:14:00 2022] POST /identity/v3/projects => generated 312 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:14:02.015712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5f3c3-9ef5-4970-bbf2-0e41d8341895 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:02.016251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5f3c3-9ef5-4970-bbf2-0e41d8341895 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:02.016251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5f3c3-9ef5-4970-bbf2-0e41d8341895 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:02.017627 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 26/47] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:02.023754 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6bcee-191f-4034-b618-755649458710 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:02.024170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6bcee-191f-4034-b618-755649458710 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:02.024309 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6bcee-191f-4034-b618-755649458710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:02.042763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-26d6bcee-191f-4034-b618-755649458710 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:02.044274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-26d6bcee-191f-4034-b618-755649458710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:02.110877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 22/48] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:02.387821 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5f3c3-9ef5-4970-bbf2-0e41d8341895 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:02.492997 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5f3c3-9ef5-4970-bbf2-0e41d8341895 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:02.529687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e9acf-e639-4635-be68-f8b1372977d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:02.530335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e9acf-e639-4635-be68-f8b1372977d0 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:02.530807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e9acf-e639-4635-be68-f8b1372977d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:02.531078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e9acf-e639-4635-be68-f8b1372977d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:02.535179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:02.545550 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e9acf-e639-4635-be68-f8b1372977d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-464e9acf-e639-4635-be68-f8b1372977d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:02.552032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:02.552887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:02.553645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 27/49] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:14:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:02.558968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6bcee-191f-4034-b618-755649458710 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:02.576641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:02.621970 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1abdb-48a4-4f4a-b74c-7b065a0444a5 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:02.622261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1abdb-48a4-4f4a-b74c-7b065a0444a5 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:02.622573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1abdb-48a4-4f4a-b74c-7b065a0444a5 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:02.623912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 28/50] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:14:02.629651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b522a0-80f9-410a-b134-8665f5bc2fda None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:02.629932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b522a0-80f9-410a-b134-8665f5bc2fda None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:02.630214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b522a0-80f9-410a-b134-8665f5bc2fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:02.648901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-83b522a0-80f9-410a-b134-8665f5bc2fda None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:02.650354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-83b522a0-80f9-410a-b134-8665f5bc2fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:02.661084 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6bcee-191f-4034-b618-755649458710 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:02.695467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadaacab-efdc-45b7-83d6-d0f333a36fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:02.696085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaacab-efdc-45b7-83d6-d0f333a36fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:02.696367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaacab-efdc-45b7-83d6-d0f333a36fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:02.696642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaacab-efdc-45b7-83d6-d0f333a36fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:02.697336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaacab-efdc-45b7-83d6-d0f333a36fc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:02.697640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaacab-efdc-45b7-83d6-d0f333a36fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:02.699064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaacab-efdc-45b7-83d6-d0f333a36fc0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:02.707686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 23/51] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:02.713269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadaacab-efdc-45b7-83d6-d0f333a36fc0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:02.724702 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 29/52] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:14:02.790788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:02.812958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadaacab-efdc-45b7-83d6-d0f333a36fc0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:02.846025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2d0cc-bccc-47ed-abad-c79dfb511e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:02.847268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2d0cc-bccc-47ed-abad-c79dfb511e67 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:02.847553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2d0cc-bccc-47ed-abad-c79dfb511e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:02.847828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2d0cc-bccc-47ed-abad-c79dfb511e67 None admin] PATH_INFO: `/v3/users/2b404d3419014a9a8edff785259ec500` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:02.848980 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2d0cc-bccc-47ed-abad-c79dfb511e67 None admin] RBAC: Authorizing `identity:get_user(user_id=2b404d3419014a9a8edff785259ec500)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:02.850461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2d0cc-bccc-47ed-abad-c79dfb511e67 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:02.852053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 24/53] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:02 2022] GET /identity/v3/users/2b404d3419014a9a8edff785259ec500 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:02.857522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b522a0-80f9-410a-b134-8665f5bc2fda None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:02.994793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2d0cc-bccc-47ed-abad-c79dfb511e67 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:03.064163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b522a0-80f9-410a-b134-8665f5bc2fda None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:03.090319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:03.098963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2141de-a8fa-4fa6-8200-bbeba6100c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:03.099601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2141de-a8fa-4fa6-8200-bbeba6100c87 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:03.099885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2141de-a8fa-4fa6-8200-bbeba6100c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:03.100163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2141de-a8fa-4fa6-8200-bbeba6100c87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:03.101190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2d0cc-bccc-47ed-abad-c79dfb511e67 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:03.101600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2141de-a8fa-4fa6-8200-bbeba6100c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:03.102903 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2141de-a8fa-4fa6-8200-bbeba6100c87 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:03.104513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 30/54] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:03.110195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2141de-a8fa-4fa6-8200-bbeba6100c87 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:03.135621 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb9591-2463-4802-984c-e60ae400e48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:03.136254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb9591-2463-4802-984c-e60ae400e48b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:03.136533 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb9591-2463-4802-984c-e60ae400e48b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:03.136806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb9591-2463-4802-984c-e60ae400e48b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:03.137900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb9591-2463-4802-984c-e60ae400e48b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:03.139389 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb9591-2463-4802-984c-e60ae400e48b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:03.140950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 25/55] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:03.146996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb9591-2463-4802-984c-e60ae400e48b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:03.163248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:03.211578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2141de-a8fa-4fa6-8200-bbeba6100c87 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:03.244704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fd4aa-367a-4a68-b161-aa24aa085e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:03.245365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fd4aa-367a-4a68-b161-aa24aa085e4b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:03.245595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fd4aa-367a-4a68-b161-aa24aa085e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:03.245871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fd4aa-367a-4a68-b161-aa24aa085e4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:03.246642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fd4aa-367a-4a68-b161-aa24aa085e4b None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.domain.id=default, user.id=2b404d3419014a9a8edff785259ec500) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:03.246758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb9591-2463-4802-984c-e60ae400e48b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:03.246951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fd4aa-367a-4a68-b161-aa24aa085e4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:03.248381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fd4aa-367a-4a68-b161-aa24aa085e4b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:03.257809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 31/56] 10.222.0.33 () {56 vars in 1322 bytes} [Mon Sep 12 23:14:03 2022] GET /identity/v3/role_assignments?user.id=2b404d3419014a9a8edff785259ec500&scope.domain.id=default&role.id=6413aac4240a46ba816472c29e305973 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:03.282091 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf5851-c97a-4208-969d-854272e66827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:03.282750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf5851-c97a-4208-969d-854272e66827 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:03.283032 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf5851-c97a-4208-969d-854272e66827 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:03.283313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf5851-c97a-4208-969d-854272e66827 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:03.284016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf5851-c97a-4208-969d-854272e66827 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:03.285900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf5851-c97a-4208-969d-854272e66827 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:03.327614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 26/57] 10.222.0.33 () {60 vars in 1140 bytes} [Mon Sep 12 23:14:03 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:14:05.495912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21b65e-e8bb-4aad-b506-43771867cce6 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:05.496421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21b65e-e8bb-4aad-b506-43771867cce6 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:05.496502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21b65e-e8bb-4aad-b506-43771867cce6 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:05.497784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 32/58] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:05.503732 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd515e-accd-4568-89c8-0d01a6624319 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:05.504123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd515e-accd-4568-89c8-0d01a6624319 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:05.504284 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd515e-accd-4568-89c8-0d01a6624319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:05.522445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e9cd515e-accd-4568-89c8-0d01a6624319 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:05.523645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e9cd515e-accd-4568-89c8-0d01a6624319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:05.581782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:05.589847 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 27/59] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:05.857184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21b65e-e8bb-4aad-b506-43771867cce6 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:05.916919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:05.967473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21b65e-e8bb-4aad-b506-43771867cce6 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:06.000651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29f0f8-6df1-44c2-88fe-16ee112ffe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:06.001277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29f0f8-6df1-44c2-88fe-16ee112ffe51 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:06.001561 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29f0f8-6df1-44c2-88fe-16ee112ffe51 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:06.001839 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29f0f8-6df1-44c2-88fe-16ee112ffe51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:06.003108 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29f0f8-6df1-44c2-88fe-16ee112ffe51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:06.004570 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29f0f8-6df1-44c2-88fe-16ee112ffe51 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:06.006129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 33/60] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:06.012005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd515e-accd-4568-89c8-0d01a6624319 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:06.109822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd515e-accd-4568-89c8-0d01a6624319 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:06.142030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfba696-c7c9-4d77-8bbd-24e5a5389bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:06.142656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfba696-c7c9-4d77-8bbd-24e5a5389bf8 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:06.142943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfba696-c7c9-4d77-8bbd-24e5a5389bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:06.143219 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfba696-c7c9-4d77-8bbd-24e5a5389bf8 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:06.144482 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfba696-c7c9-4d77-8bbd-24e5a5389bf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:06.145929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfba696-c7c9-4d77-8bbd-24e5a5389bf8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:06.173073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 28/61] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:14:06 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:14:09.372424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a08ad-ebac-42b2-ac93-e5ccbac8fe9f None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:09.372934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a08ad-ebac-42b2-ac93-e5ccbac8fe9f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:09.373008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a08ad-ebac-42b2-ac93-e5ccbac8fe9f None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:09.385569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76caef-c7e5-48b0-9287-e635835c0bd4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:09.385992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76caef-c7e5-48b0-9287-e635835c0bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:09.386152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76caef-c7e5-48b0-9287-e635835c0bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:09.392956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 34/62] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:09 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:09.413815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7e76caef-c7e5-48b0-9287-e635835c0bd4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:09.415671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7e76caef-c7e5-48b0-9287-e635835c0bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:09.498851 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:09.523997 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 29/63] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:09.864180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5d9aa-edae-415f-ba3e-05dfdfd20602 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:09.864464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5d9aa-edae-415f-ba3e-05dfdfd20602 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:09.864907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5d9aa-edae-415f-ba3e-05dfdfd20602 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:09.866484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 35/64] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:09.872283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ad9ed-d9b2-4eef-9cfd-a6ce5bcda499 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:09.872711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ad9ed-d9b2-4eef-9cfd-a6ce5bcda499 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:09.873092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ad9ed-d9b2-4eef-9cfd-a6ce5bcda499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:09.903611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1b9ad9ed-d9b2-4eef-9cfd-a6ce5bcda499 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:09.904834 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1b9ad9ed-d9b2-4eef-9cfd-a6ce5bcda499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:09.912017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda6e58-d56a-4697-9d99-83d43c8deee5 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:09.912492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda6e58-d56a-4697-9d99-83d43c8deee5 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:09.912915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda6e58-d56a-4697-9d99-83d43c8deee5 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:09.916570 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 36/65] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:09.919820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e5038-9cf5-4fb2-b44d-8be57425fdd4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:09.920107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e5038-9cf5-4fb2-b44d-8be57425fdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:09.920574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e5038-9cf5-4fb2-b44d-8be57425fdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:09.940958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ee2e5038-9cf5-4fb2-b44d-8be57425fdd4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:09.942775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ee2e5038-9cf5-4fb2-b44d-8be57425fdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:09.981085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 30/66] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:09.982346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf4248-2db5-42ef-b6a5-db2be20c834d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:09.982849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf4248-2db5-42ef-b6a5-db2be20c834d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:09.983292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf4248-2db5-42ef-b6a5-db2be20c834d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:09.985054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 31/67] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:09.985925 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf4248-2db5-42ef-b6a5-db2be20c834d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:10.027155 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 37/68] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:10.028655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff915528-516a-4a85-a083-6702242fd695 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:10.029112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff915528-516a-4a85-a083-6702242fd695 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:10.029583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff915528-516a-4a85-a083-6702242fd695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:10.048656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ff915528-516a-4a85-a083-6702242fd695 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:10.050411 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ff915528-516a-4a85-a083-6702242fd695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:10.099363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf4248-2db5-42ef-b6a5-db2be20c834d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:10.108543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:10.117553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:10.128818 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 38/69] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:10.130285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae263b62-2d3f-4d75-81d9-faee154f6b46 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:10.130779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae263b62-2d3f-4d75-81d9-faee154f6b46 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:10.131232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae263b62-2d3f-4d75-81d9-faee154f6b46 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:10.132968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 39/70] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:10.137872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500da00b-a91a-4af8-a244-347c01814f81 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:10.138408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500da00b-a91a-4af8-a244-347c01814f81 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:10.138887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500da00b-a91a-4af8-a244-347c01814f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:10.153784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005fe5c-8515-45b6-a384-d77876813c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:10.154453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005fe5c-8515-45b6-a384-d77876813c7c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:10.154737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005fe5c-8515-45b6-a384-d77876813c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:10.155005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005fe5c-8515-45b6-a384-d77876813c7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:10.159660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-500da00b-a91a-4af8-a244-347c01814f81 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:10.161306 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-500da00b-a91a-4af8-a244-347c01814f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:10.175327 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005fe5c-8515-45b6-a384-d77876813c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d005fe5c-8515-45b6-a384-d77876813c7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:10.187240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:10.188080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:10.188819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:10.188819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:10.188819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:10.188819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:10.188819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:10.188819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:10.188819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:10.188819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:10.188819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:10.188819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:10.188819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:10.188819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:10.191682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 32/71] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:10.197501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005fe5c-8515-45b6-a384-d77876813c7c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:10.235818 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 40/72] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:10.258596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500da00b-a91a-4af8-a244-347c01814f81 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:10.374601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005fe5c-8515-45b6-a384-d77876813c7c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:10.402140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500da00b-a91a-4af8-a244-347c01814f81 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:10.422401 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:10.422684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ec786-c2aa-45c9-812e-0c81ad47ccc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:10.423306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ec786-c2aa-45c9-812e-0c81ad47ccc2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:10.423590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ec786-c2aa-45c9-812e-0c81ad47ccc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:10.423866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ec786-c2aa-45c9-812e-0c81ad47ccc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:10.425126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ec786-c2aa-45c9-812e-0c81ad47ccc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:10.425407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ec786-c2aa-45c9-812e-0c81ad47ccc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:10.426950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ec786-c2aa-45c9-812e-0c81ad47ccc2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:10.435489 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 33/73] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:10.436554 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ec786-c2aa-45c9-812e-0c81ad47ccc2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:10.458612 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bec25-af1a-4acb-919a-788486c4ce3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:10.459565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bec25-af1a-4acb-919a-788486c4ce3f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:10.460020 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bec25-af1a-4acb-919a-788486c4ce3f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:10.460554 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bec25-af1a-4acb-919a-788486c4ce3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:10.461887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bec25-af1a-4acb-919a-788486c4ce3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:10.463734 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bec25-af1a-4acb-919a-788486c4ce3f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:10.469644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 41/74] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:10.469644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bec25-af1a-4acb-919a-788486c4ce3f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:10.480591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:10.550996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ec786-c2aa-45c9-812e-0c81ad47ccc2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:10.583107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bec25-af1a-4acb-919a-788486c4ce3f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:10.584181 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b3204-2aec-46b9-82e0-d1f8a5b49194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:10.584821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b3204-2aec-46b9-82e0-d1f8a5b49194 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:10.585105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b3204-2aec-46b9-82e0-d1f8a5b49194 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:10.585392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b3204-2aec-46b9-82e0-d1f8a5b49194 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:10.595443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b3204-2aec-46b9-82e0-d1f8a5b49194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-289b3204-2aec-46b9-82e0-d1f8a5b49194 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:10.600799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:10.601634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:10.602366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 34/75] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:14:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:10.603470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b3204-2aec-46b9-82e0-d1f8a5b49194 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:10.619010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ede046-c8ba-44c9-8459-df322692e413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:10.619645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ede046-c8ba-44c9-8459-df322692e413 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:10.619926 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ede046-c8ba-44c9-8459-df322692e413 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:10.620198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ede046-c8ba-44c9-8459-df322692e413 None admin] PATH_INFO: `/v3/users/3cbe79decc7e47dbbe30a01873217e73` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:10.635846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ede046-c8ba-44c9-8459-df322692e413 None admin] RBAC: Authorizing `identity:get_user(user_id=3cbe79decc7e47dbbe30a01873217e73)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:10.637229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ede046-c8ba-44c9-8459-df322692e413 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:10.638889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 42/76] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:10 2022] GET /identity/v3/users/3cbe79decc7e47dbbe30a01873217e73 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:10.639654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ede046-c8ba-44c9-8459-df322692e413 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:10.684071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:10.698563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:10.705914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b3204-2aec-46b9-82e0-d1f8a5b49194 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:10.739803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182a0cd-869e-4d11-8f80-06c96c8f54ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:10.740413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182a0cd-869e-4d11-8f80-06c96c8f54ba None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:10.740694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182a0cd-869e-4d11-8f80-06c96c8f54ba None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:10.740968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182a0cd-869e-4d11-8f80-06c96c8f54ba None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:10.741076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ede046-c8ba-44c9-8459-df322692e413 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:10.741613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182a0cd-869e-4d11-8f80-06c96c8f54ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:10.743099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182a0cd-869e-4d11-8f80-06c96c8f54ba None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:10.763699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 35/77] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:14:10 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:14:10.764495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182a0cd-869e-4d11-8f80-06c96c8f54ba None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:10.782170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a10d46-a4d1-4503-85f8-36bdcf7f789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:10.782864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a10d46-a4d1-4503-85f8-36bdcf7f789f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:10.783149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a10d46-a4d1-4503-85f8-36bdcf7f789f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:10.783424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a10d46-a4d1-4503-85f8-36bdcf7f789f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:10.796494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a10d46-a4d1-4503-85f8-36bdcf7f789f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-f2a10d46-a4d1-4503-85f8-36bdcf7f789f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:10.801686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:10.802797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:10.803741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:10.803741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:10.803741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:10.803741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:10.803741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:10.803741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:10.803741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:10.803741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:10.803741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:10.803741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:10.803741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:10.803741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:10.807858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 43/78] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:10.808830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a10d46-a4d1-4503-85f8-36bdcf7f789f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:10.912659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182a0cd-869e-4d11-8f80-06c96c8f54ba None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:10.925709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a10d46-a4d1-4503-85f8-36bdcf7f789f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:10.927839 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:10.956954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c826f-a300-4a99-8ce1-03bcbfd04890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:10.957251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c826f-a300-4a99-8ce1-03bcbfd04890 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:10.957383 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c826f-a300-4a99-8ce1-03bcbfd04890 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:10.957660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c826f-a300-4a99-8ce1-03bcbfd04890 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:10.969095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c826f-a300-4a99-8ce1-03bcbfd04890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:10.973392 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd848751-5efb-4ac1-9a3a-f4faee89d7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:10.974008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd848751-5efb-4ac1-9a3a-f4faee89d7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:10.974291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd848751-5efb-4ac1-9a3a-f4faee89d7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:10.974679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd848751-5efb-4ac1-9a3a-f4faee89d7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-305c826f-a300-4a99-8ce1-03bcbfd04890 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:10.975218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:10.976051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:10.977211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:10.977211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:10.977211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:10.977211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:10.977211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:10.977211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:10.977211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:10.977211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:10.977211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:10.977211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:10.977211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:10.977211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:10.977959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd848751-5efb-4ac1-9a3a-f4faee89d7d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:10.977959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd848751-5efb-4ac1-9a3a-f4faee89d7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:10.978075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 36/79] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:14:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:10.978136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd848751-5efb-4ac1-9a3a-f4faee89d7d6 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:10.978196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c826f-a300-4a99-8ce1-03bcbfd04890 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:10.987995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 44/80] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:14:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:10.988832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd848751-5efb-4ac1-9a3a-f4faee89d7d6 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:10.996070 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:11.135044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd848751-5efb-4ac1-9a3a-f4faee89d7d6 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:11.147249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c826f-a300-4a99-8ce1-03bcbfd04890 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:11.187054 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4df908-056a-4359-9e0b-91abd8166006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:11.187370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210526f-8a5a-4ccd-8619-9b2f704c43ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:11.187951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210526f-8a5a-4ccd-8619-9b2f704c43ba None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:11.188238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210526f-8a5a-4ccd-8619-9b2f704c43ba None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:11.188516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210526f-8a5a-4ccd-8619-9b2f704c43ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:11.188817 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4df908-056a-4359-9e0b-91abd8166006 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:11.189338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4df908-056a-4359-9e0b-91abd8166006 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:11.189820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4df908-056a-4359-9e0b-91abd8166006 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:11.191073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4df908-056a-4359-9e0b-91abd8166006 None admin] RBAC: Adding query filter params (name=member) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:11.191863 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4df908-056a-4359-9e0b-91abd8166006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:11.194972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4df908-056a-4359-9e0b-91abd8166006 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:11.208115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 45/81] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:11.209251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4df908-056a-4359-9e0b-91abd8166006 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:11.263067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:11.293587 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210526f-8a5a-4ccd-8619-9b2f704c43ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:11.293587 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210526f-8a5a-4ccd-8619-9b2f704c43ba None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:11.312759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:11.400486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4df908-056a-4359-9e0b-91abd8166006 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:11.463692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbcf08-377d-4ab3-97a7-6997d9894e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:11.465053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbcf08-377d-4ab3-97a7-6997d9894e02 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:11.465531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbcf08-377d-4ab3-97a7-6997d9894e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:11.466019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbcf08-377d-4ab3-97a7-6997d9894e02 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:11.467147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbcf08-377d-4ab3-97a7-6997d9894e02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:11.468652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbcf08-377d-4ab3-97a7-6997d9894e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:11.470334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbcf08-377d-4ab3-97a7-6997d9894e02 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:11.487508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 37/82] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:11.492760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 46/83] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:11.492760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbcf08-377d-4ab3-97a7-6997d9894e02 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:11.494638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210526f-8a5a-4ccd-8619-9b2f704c43ba None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:11.614621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:11.616418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210526f-8a5a-4ccd-8619-9b2f704c43ba None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:11.628702 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:11.632067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbcf08-377d-4ab3-97a7-6997d9894e02 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:11.660345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df0deb-b0bb-4c50-9fdd-1cd9fe501f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:11.661429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df0deb-b0bb-4c50-9fdd-1cd9fe501f51 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:11.661715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df0deb-b0bb-4c50-9fdd-1cd9fe501f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:11.661990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df0deb-b0bb-4c50-9fdd-1cd9fe501f51 None admin] PATH_INFO: `/v3/users/3cbe79decc7e47dbbe30a01873217e73` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:11.663359 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df0deb-b0bb-4c50-9fdd-1cd9fe501f51 None admin] RBAC: Authorizing `identity:get_user(user_id=3cbe79decc7e47dbbe30a01873217e73)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:11.665748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df0deb-b0bb-4c50-9fdd-1cd9fe501f51 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:11.668097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 38/84] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:11 2022] GET /identity/v3/users/3cbe79decc7e47dbbe30a01873217e73 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:11.668673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df0deb-b0bb-4c50-9fdd-1cd9fe501f51 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:11.679247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf412-099f-48fc-abe3-faf842e5d841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:11.680232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf412-099f-48fc-abe3-faf842e5d841 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:11.680729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf412-099f-48fc-abe3-faf842e5d841 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:11.681202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf412-099f-48fc-abe3-faf842e5d841 None admin] PATH_INFO: `/v3/users/3cbe79decc7e47dbbe30a01873217e73` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:11.682657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf412-099f-48fc-abe3-faf842e5d841 None admin] RBAC: Authorizing `identity:get_user(user_id=3cbe79decc7e47dbbe30a01873217e73)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:11.684486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf412-099f-48fc-abe3-faf842e5d841 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:11.686310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 47/85] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:11 2022] GET /identity/v3/users/3cbe79decc7e47dbbe30a01873217e73 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:11.687491 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf412-099f-48fc-abe3-faf842e5d841 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:11.796863 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf412-099f-48fc-abe3-faf842e5d841 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:11.810281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df0deb-b0bb-4c50-9fdd-1cd9fe501f51 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:11.834351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0ebd2-4c53-42be-a9d6-bd8ed51da3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:11.835326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0ebd2-4c53-42be-a9d6-bd8ed51da3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:11.835752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0ebd2-4c53-42be-a9d6-bd8ed51da3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:11.836168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0ebd2-4c53-42be-a9d6-bd8ed51da3a7 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:11.837444 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0ebd2-4c53-42be-a9d6-bd8ed51da3a7 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:11.839154 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0ebd2-4c53-42be-a9d6-bd8ed51da3a7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:11.840996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 48/86] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:11 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:11.842075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0ebd2-4c53-42be-a9d6-bd8ed51da3a7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:11.857690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91665c1-185f-4b3b-8edc-364af5bb62ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:11.858340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91665c1-185f-4b3b-8edc-364af5bb62ef None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:11.858665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91665c1-185f-4b3b-8edc-364af5bb62ef None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:11.858942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91665c1-185f-4b3b-8edc-364af5bb62ef None admin] PATH_INFO: `/v3/users/2b404d3419014a9a8edff785259ec500` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:11.860381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91665c1-185f-4b3b-8edc-364af5bb62ef None admin] RBAC: Authorizing `identity:get_user(user_id=2b404d3419014a9a8edff785259ec500)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:11.863484 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91665c1-185f-4b3b-8edc-364af5bb62ef None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:11.865955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 39/87] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:11 2022] GET /identity/v3/users/2b404d3419014a9a8edff785259ec500 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:11.866558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91665c1-185f-4b3b-8edc-364af5bb62ef None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:11.874273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:11.937510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:11.967065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0ebd2-4c53-42be-a9d6-bd8ed51da3a7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:12.004965 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91665c1-185f-4b3b-8edc-364af5bb62ef None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:12.011912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917eb17-e020-4a06-ae73-34d248c61723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:12.012530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917eb17-e020-4a06-ae73-34d248c61723 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:12.012811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917eb17-e020-4a06-ae73-34d248c61723 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:12.013086 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917eb17-e020-4a06-ae73-34d248c61723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:12.045173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba21a1f-cb5a-48e2-9f23-85d2d0c858e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:12.046105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba21a1f-cb5a-48e2-9f23-85d2d0c858e1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:12.046698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba21a1f-cb5a-48e2-9f23-85d2d0c858e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:12.047244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba21a1f-cb5a-48e2-9f23-85d2d0c858e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:12.105500 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917eb17-e020-4a06-ae73-34d248c61723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:12.107685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917eb17-e020-4a06-ae73-34d248c61723 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:12.119491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba21a1f-cb5a-48e2-9f23-85d2d0c858e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:12.121252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba21a1f-cb5a-48e2-9f23-85d2d0c858e1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:12.140616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:12.172122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:12.246773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 40/88] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:12.247641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba21a1f-cb5a-48e2-9f23-85d2d0c858e1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:12.254960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 49/89] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:12.255666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917eb17-e020-4a06-ae73-34d248c61723 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:12.358207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba21a1f-cb5a-48e2-9f23-85d2d0c858e1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:12.380063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917eb17-e020-4a06-ae73-34d248c61723 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:12.398220 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4795d2-06fc-4b13-9034-08c9b34ad6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:12.398917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4795d2-06fc-4b13-9034-08c9b34ad6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:12.399203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4795d2-06fc-4b13-9034-08c9b34ad6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:12.399526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4795d2-06fc-4b13-9034-08c9b34ad6b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:12.400269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4795d2-06fc-4b13-9034-08c9b34ad6b8 None admin] RBAC: Adding query filter params (role.id=c6ff6f013f2f41d78fedabbe698ed13e, scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8, user.id=3cbe79decc7e47dbbe30a01873217e73) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:12.400584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4795d2-06fc-4b13-9034-08c9b34ad6b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:12.402061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4795d2-06fc-4b13-9034-08c9b34ad6b8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:12.407225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:12.407581 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 41/90] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:12 2022] GET /identity/v3/role_assignments?user.id=3cbe79decc7e47dbbe30a01873217e73&scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8&role.id=c6ff6f013f2f41d78fedabbe698ed13e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:12.408416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4795d2-06fc-4b13-9034-08c9b34ad6b8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:12.420917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27f600-e20a-4ad0-a21d-82371d10ca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:12.421772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27f600-e20a-4ad0-a21d-82371d10ca26 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:12.422191 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27f600-e20a-4ad0-a21d-82371d10ca26 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:12.422640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27f600-e20a-4ad0-a21d-82371d10ca26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:12.442807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:12.504233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27f600-e20a-4ad0-a21d-82371d10ca26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:12.506519 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27f600-e20a-4ad0-a21d-82371d10ca26 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:12.624952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 50/91] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:12.626107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27f600-e20a-4ad0-a21d-82371d10ca26 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:12.652581 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4795d2-06fc-4b13-9034-08c9b34ad6b8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:12.656693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:12.693886 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3648d45-8251-495d-a9fd-07a7891e16ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:12.694656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3648d45-8251-495d-a9fd-07a7891e16ac None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:12.694943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3648d45-8251-495d-a9fd-07a7891e16ac None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:12.695217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3648d45-8251-495d-a9fd-07a7891e16ac None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:12.696455 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3648d45-8251-495d-a9fd-07a7891e16ac None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:12.697917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3648d45-8251-495d-a9fd-07a7891e16ac None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:12.700448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 42/92] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:12 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:12.701215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3648d45-8251-495d-a9fd-07a7891e16ac None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:12.749106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27f600-e20a-4ad0-a21d-82371d10ca26 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:12.789190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909377ca-eda5-4e2f-9ee0-0d7b4847e897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:12.790225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909377ca-eda5-4e2f-9ee0-0d7b4847e897 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:12.790986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909377ca-eda5-4e2f-9ee0-0d7b4847e897 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:12.791450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909377ca-eda5-4e2f-9ee0-0d7b4847e897 None admin] PATH_INFO: `/v3/projects/1dc75a03ba954f35ab5bd3dda651aaff` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:12.793238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909377ca-eda5-4e2f-9ee0-0d7b4847e897 None admin] RBAC: Authorizing `identity:get_project(project_id=1dc75a03ba954f35ab5bd3dda651aaff)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:12.795009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909377ca-eda5-4e2f-9ee0-0d7b4847e897 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:12.797161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 51/93] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:12 2022] GET /identity/v3/projects/1dc75a03ba954f35ab5bd3dda651aaff => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:12.798126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909377ca-eda5-4e2f-9ee0-0d7b4847e897 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:12.906428 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:12.910262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:12.917276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909377ca-eda5-4e2f-9ee0-0d7b4847e897 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:12.955061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047aa7e-ffde-4a5f-9e51-4ae07e8160e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:12.956330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047aa7e-ffde-4a5f-9e51-4ae07e8160e4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:12.957013 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047aa7e-ffde-4a5f-9e51-4ae07e8160e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:12.957483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047aa7e-ffde-4a5f-9e51-4ae07e8160e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:12.958459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047aa7e-ffde-4a5f-9e51-4ae07e8160e4 None admin] RBAC: Adding query filter params (role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a, scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8, user.id=3cbe79decc7e47dbbe30a01873217e73) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:12.958977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047aa7e-ffde-4a5f-9e51-4ae07e8160e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:12.960615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047aa7e-ffde-4a5f-9e51-4ae07e8160e4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:12.966562 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 52/94] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:12 2022] GET /identity/v3/role_assignments?user.id=3cbe79decc7e47dbbe30a01873217e73&scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8&role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:12.967569 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047aa7e-ffde-4a5f-9e51-4ae07e8160e4 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:12.984709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3648d45-8251-495d-a9fd-07a7891e16ac None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:13.057628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbcc2c-a6b5-40d4-a8ac-dd525473309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:13.058290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbcc2c-a6b5-40d4-a8ac-dd525473309e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:13.058593 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbcc2c-a6b5-40d4-a8ac-dd525473309e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:13.058866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbcc2c-a6b5-40d4-a8ac-dd525473309e None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:13.063467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbcc2c-a6b5-40d4-a8ac-dd525473309e None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:13.064716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbcc2c-a6b5-40d4-a8ac-dd525473309e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:13.067166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 43/95] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:12 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:13.072908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbcc2c-a6b5-40d4-a8ac-dd525473309e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:13.085264 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047aa7e-ffde-4a5f-9e51-4ae07e8160e4 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:13.151163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4be167-cb04-4d04-99ec-772108962977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:13.152154 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4be167-cb04-4d04-99ec-772108962977 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:13.152668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4be167-cb04-4d04-99ec-772108962977 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:13.153134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4be167-cb04-4d04-99ec-772108962977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:13.154091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4be167-cb04-4d04-99ec-772108962977 None admin] RBAC: Adding query filter params (role.id=c6ff6f013f2f41d78fedabbe698ed13e, scope.project.id=1dc75a03ba954f35ab5bd3dda651aaff, user.id=3cbe79decc7e47dbbe30a01873217e73) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:13.154621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4be167-cb04-4d04-99ec-772108962977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:13.157107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4be167-cb04-4d04-99ec-772108962977 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:13.165136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 53/96] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:12 2022] GET /identity/v3/role_assignments?user.id=3cbe79decc7e47dbbe30a01873217e73&scope.project.id=1dc75a03ba954f35ab5bd3dda651aaff&role.id=c6ff6f013f2f41d78fedabbe698ed13e => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:13.271814 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbcc2c-a6b5-40d4-a8ac-dd525473309e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:13.326059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a4400-c07b-42d3-a949-ef2e955e67aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:13.326718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a4400-c07b-42d3-a949-ef2e955e67aa None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:13.326999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a4400-c07b-42d3-a949-ef2e955e67aa None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:13.327272 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a4400-c07b-42d3-a949-ef2e955e67aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:13.328017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a4400-c07b-42d3-a949-ef2e955e67aa None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8, user.id=2b404d3419014a9a8edff785259ec500) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:13.328327 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a4400-c07b-42d3-a949-ef2e955e67aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:13.329883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a4400-c07b-42d3-a949-ef2e955e67aa None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:13.341009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 44/97] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:13 2022] GET /identity/v3/role_assignments?user.id=2b404d3419014a9a8edff785259ec500&scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8&role.id=6413aac4240a46ba816472c29e305973 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:13.369696 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dcf66-7295-44b4-b901-ebc6e409f7e3 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:13.370349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dcf66-7295-44b4-b901-ebc6e409f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:13.370891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dcf66-7295-44b4-b901-ebc6e409f7e3 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:13.372918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 54/98] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:13.379630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd9e2e-7d29-4a0d-9c5b-37c0a5e593e8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:13.380279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd9e2e-7d29-4a0d-9c5b-37c0a5e593e8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:13.380751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd9e2e-7d29-4a0d-9c5b-37c0a5e593e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:13.419690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b9fd9e2e-7d29-4a0d-9c5b-37c0a5e593e8 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:13.420836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b9fd9e2e-7d29-4a0d-9c5b-37c0a5e593e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:13.424176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:13.464198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb0a0a-c7d4-44e1-8241-7c704621db85 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:13.464506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb0a0a-c7d4-44e1-8241-7c704621db85 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:13.464741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb0a0a-c7d4-44e1-8241-7c704621db85 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:13.466088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 55/99] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:14:13.485010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8324cf-9318-4801-b4ca-f02189504b6b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:13.485324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8324cf-9318-4801-b4ca-f02189504b6b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:13.485559 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8324cf-9318-4801-b4ca-f02189504b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:13.521663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-0d8324cf-9318-4801-b4ca-f02189504b6b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:13.522895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0d8324cf-9318-4801-b4ca-f02189504b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:13.533574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 45/100] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:13.547872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:13.624759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 56/101] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:14.009318 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd9e2e-7d29-4a0d-9c5b-37c0a5e593e8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:14.071804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8324cf-9318-4801-b4ca-f02189504b6b None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:14.209692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8324cf-9318-4801-b4ca-f02189504b6b None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:14.220364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd9e2e-7d29-4a0d-9c5b-37c0a5e593e8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:14.263788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e401a-3480-4a6f-9a0b-8fb9459d2529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:14.264661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e401a-3480-4a6f-9a0b-8fb9459d2529 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:14.265103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e401a-3480-4a6f-9a0b-8fb9459d2529 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:14.265524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e401a-3480-4a6f-9a0b-8fb9459d2529 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:14.283775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e401a-3480-4a6f-9a0b-8fb9459d2529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-1a6e401a-3480-4a6f-9a0b-8fb9459d2529 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:14.289807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:14.291175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:14.292095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:14.292095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:14.292095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:14.292095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:14.292095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:14.292095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:14.292095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:14.292095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:14.292095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:14.292095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:14.292095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:14.292095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:14.297729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 57/102] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:14:14.302089 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d862a69-0501-4fcc-b374-4e9b9d6c6d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:14.302935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d862a69-0501-4fcc-b374-4e9b9d6c6d62 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:14.303394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d862a69-0501-4fcc-b374-4e9b9d6c6d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:14.303866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d862a69-0501-4fcc-b374-4e9b9d6c6d62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:14.304855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e401a-3480-4a6f-9a0b-8fb9459d2529 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:14.309366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d862a69-0501-4fcc-b374-4e9b9d6c6d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:14.311048 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d862a69-0501-4fcc-b374-4e9b9d6c6d62 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:14.314494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 46/103] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:14.320214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d862a69-0501-4fcc-b374-4e9b9d6c6d62 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:14.328231 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:14.339800 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:14.480855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e401a-3480-4a6f-9a0b-8fb9459d2529 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:14.517643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191cfed-809a-4364-a1f0-aa242390ee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:14.518738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191cfed-809a-4364-a1f0-aa242390ee06 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:14.519308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191cfed-809a-4364-a1f0-aa242390ee06 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:14.520051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191cfed-809a-4364-a1f0-aa242390ee06 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:14.520860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191cfed-809a-4364-a1f0-aa242390ee06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:14.521303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191cfed-809a-4364-a1f0-aa242390ee06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:14.522870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191cfed-809a-4364-a1f0-aa242390ee06 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:14.531965 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 58/104] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:14.538533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191cfed-809a-4364-a1f0-aa242390ee06 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:14.552853 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d862a69-0501-4fcc-b374-4e9b9d6c6d62 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:14.642780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:14.671018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191cfed-809a-4364-a1f0-aa242390ee06 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:14.683730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb599cf-f413-44d1-bc6e-7a32ec63f109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:14.684379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb599cf-f413-44d1-bc6e-7a32ec63f109 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:14.684665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb599cf-f413-44d1-bc6e-7a32ec63f109 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:14.684941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb599cf-f413-44d1-bc6e-7a32ec63f109 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:14.685610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb599cf-f413-44d1-bc6e-7a32ec63f109 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:14.687352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb599cf-f413-44d1-bc6e-7a32ec63f109 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:14.710644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132ded0-0fb6-4d04-9ef3-7ade75bf6d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:14.711671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132ded0-0fb6-4d04-9ef3-7ade75bf6d30 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:14.712093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132ded0-0fb6-4d04-9ef3-7ade75bf6d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:14.712505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132ded0-0fb6-4d04-9ef3-7ade75bf6d30 None admin] PATH_INFO: `/v3/users/e817d0f626ae43e3a868b12b41537951` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:14.729092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132ded0-0fb6-4d04-9ef3-7ade75bf6d30 None admin] RBAC: Authorizing `identity:get_user(user_id=e817d0f626ae43e3a868b12b41537951)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:14.730938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132ded0-0fb6-4d04-9ef3-7ade75bf6d30 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:14.732801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 59/105] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:14 2022] GET /identity/v3/users/e817d0f626ae43e3a868b12b41537951 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:14.741226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132ded0-0fb6-4d04-9ef3-7ade75bf6d30 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:14.752972 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 47/106] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:14:14 2022] POST /identity/v3/projects => generated 302 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:14:14.859285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132ded0-0fb6-4d04-9ef3-7ade75bf6d30 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:14.892729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:14.899295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8c204-3d34-4bf8-8287-ec7f91a119ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:14.899835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8c204-3d34-4bf8-8287-ec7f91a119ec None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:14.900122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8c204-3d34-4bf8-8287-ec7f91a119ec None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:14.901281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8c204-3d34-4bf8-8287-ec7f91a119ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:14.978248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8c204-3d34-4bf8-8287-ec7f91a119ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:14.979776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8c204-3d34-4bf8-8287-ec7f91a119ec None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:15.092605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 60/107] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:15.098808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb599cf-f413-44d1-bc6e-7a32ec63f109 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:15.165762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:15.211103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb599cf-f413-44d1-bc6e-7a32ec63f109 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:15.246074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c14ce0-dd1c-484a-8058-a07bb6dc89f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:15.246806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c14ce0-dd1c-484a-8058-a07bb6dc89f9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:15.247149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c14ce0-dd1c-484a-8058-a07bb6dc89f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:15.247431 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c14ce0-dd1c-484a-8058-a07bb6dc89f9 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:15.248579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c14ce0-dd1c-484a-8058-a07bb6dc89f9 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:15.250094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c14ce0-dd1c-484a-8058-a07bb6dc89f9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:15.252068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 48/108] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:15 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:15.258308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8c204-3d34-4bf8-8287-ec7f91a119ec None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:15.304353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:15.386158 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8c204-3d34-4bf8-8287-ec7f91a119ec None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:15.437429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75027edc-faac-4732-9402-1270dbf137fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:15.437969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75027edc-faac-4732-9402-1270dbf137fa None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:15.438251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75027edc-faac-4732-9402-1270dbf137fa None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:15.438555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75027edc-faac-4732-9402-1270dbf137fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:15.439304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75027edc-faac-4732-9402-1270dbf137fa None admin] RBAC: Adding query filter params (role.id=cca59383436e4294a41556fbdf237853, scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8, user.id=e817d0f626ae43e3a868b12b41537951) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:15.439616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75027edc-faac-4732-9402-1270dbf137fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:15.441506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75027edc-faac-4732-9402-1270dbf137fa None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:15.447866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 61/109] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:15 2022] GET /identity/v3/role_assignments?user.id=e817d0f626ae43e3a868b12b41537951&scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8&role.id=cca59383436e4294a41556fbdf237853 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:15.507695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56609f06-a65a-4634-8606-332e557e6278 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:15.507974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56609f06-a65a-4634-8606-332e557e6278 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:15.508417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56609f06-a65a-4634-8606-332e557e6278 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:15.509964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 49/110] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:15.515969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a633-6743-4c98-9e9a-4588d0289572 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:15.516278 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a633-6743-4c98-9e9a-4588d0289572 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:15.516534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6a633-6743-4c98-9e9a-4588d0289572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:15.543467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e8a6a633-6743-4c98-9e9a-4588d0289572 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:15.544706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e8a6a633-6743-4c98-9e9a-4588d0289572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:15.633065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 62/111] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:15.896673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccc77b-5dd7-4280-8b6a-c88addcf2d30 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:15.896984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccc77b-5dd7-4280-8b6a-c88addcf2d30 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:15.897252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccc77b-5dd7-4280-8b6a-c88addcf2d30 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:15.898648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 50/112] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:15.904057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884ac71-9dcf-474c-bec0-88916cc0fe76 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:15.904349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884ac71-9dcf-474c-bec0-88916cc0fe76 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:15.904631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884ac71-9dcf-474c-bec0-88916cc0fe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:15.928235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-a884ac71-9dcf-474c-bec0-88916cc0fe76 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:15.929492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a884ac71-9dcf-474c-bec0-88916cc0fe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:15.954705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:16.001060 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccc77b-5dd7-4280-8b6a-c88addcf2d30 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:16.023637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 63/113] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:14:16.146799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccc77b-5dd7-4280-8b6a-c88addcf2d30 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:16.180677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:16.191659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc4f0e-fa6c-447a-8ab7-d0fc53997164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:16.192326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc4f0e-fa6c-447a-8ab7-d0fc53997164 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:16.192614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc4f0e-fa6c-447a-8ab7-d0fc53997164 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:16.192891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc4f0e-fa6c-447a-8ab7-d0fc53997164 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:16.209842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc4f0e-fa6c-447a-8ab7-d0fc53997164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-27fc4f0e-fa6c-447a-8ab7-d0fc53997164 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:16.214807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:16.215654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:16.216799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 51/114] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:14:16.222818 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884ac71-9dcf-474c-bec0-88916cc0fe76 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:16.357200 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884ac71-9dcf-474c-bec0-88916cc0fe76 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:16.411719 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc4f0e-fa6c-447a-8ab7-d0fc53997164 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:16.415037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe90e0-a6b2-452f-a3b6-2550c0e53875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:16.416193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe90e0-a6b2-452f-a3b6-2550c0e53875 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:16.416670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe90e0-a6b2-452f-a3b6-2550c0e53875 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:16.417150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe90e0-a6b2-452f-a3b6-2550c0e53875 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:16.418079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe90e0-a6b2-452f-a3b6-2550c0e53875 None admin] RBAC: Adding query filter params (name=member) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:16.418617 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe90e0-a6b2-452f-a3b6-2550c0e53875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:16.420291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe90e0-a6b2-452f-a3b6-2550c0e53875 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:16.439286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 64/115] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:16.443436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe90e0-a6b2-452f-a3b6-2550c0e53875 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:16.483738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:16.582179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe90e0-a6b2-452f-a3b6-2550c0e53875 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:16.615524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc4f0e-fa6c-447a-8ab7-d0fc53997164 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:16.619289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00d2f2-621c-4105-94fb-a30fb177fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:16.620152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00d2f2-621c-4105-94fb-a30fb177fb1f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:16.620628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00d2f2-621c-4105-94fb-a30fb177fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:16.621093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00d2f2-621c-4105-94fb-a30fb177fb1f None admin] PATH_INFO: `/v3/users/3cbe79decc7e47dbbe30a01873217e73` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:16.622798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00d2f2-621c-4105-94fb-a30fb177fb1f None admin] RBAC: Authorizing `identity:get_user(user_id=3cbe79decc7e47dbbe30a01873217e73)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:16.624512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00d2f2-621c-4105-94fb-a30fb177fb1f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:16.626746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 65/116] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:16 2022] GET /identity/v3/users/3cbe79decc7e47dbbe30a01873217e73 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:16.634933 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00d2f2-621c-4105-94fb-a30fb177fb1f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:16.694572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2bce3-48ef-4afe-aec5-27f3bcc6e492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:16.695144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2bce3-48ef-4afe-aec5-27f3bcc6e492 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:16.695429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2bce3-48ef-4afe-aec5-27f3bcc6e492 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:16.695707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2bce3-48ef-4afe-aec5-27f3bcc6e492 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:16.728915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2bce3-48ef-4afe-aec5-27f3bcc6e492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-15a2bce3-48ef-4afe-aec5-27f3bcc6e492 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:16.734331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:16.735188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:16.735922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 52/117] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:14:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:16.745837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2bce3-48ef-4afe-aec5-27f3bcc6e492 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:16.856940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:16.872620 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:16.916822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00d2f2-621c-4105-94fb-a30fb177fb1f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:16.975871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2bce3-48ef-4afe-aec5-27f3bcc6e492 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:16.983104 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a9891-5460-4159-bf4f-738e05d12661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:16.983768 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a9891-5460-4159-bf4f-738e05d12661 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:16.984058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a9891-5460-4159-bf4f-738e05d12661 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:16.984333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a9891-5460-4159-bf4f-738e05d12661 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:16.985536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a9891-5460-4159-bf4f-738e05d12661 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:16.987112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a9891-5460-4159-bf4f-738e05d12661 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:16.988987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 66/118] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:16 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:16.994707 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a9891-5460-4159-bf4f-738e05d12661 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:17.047896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c3127-2451-4472-bb86-4a9f62fec20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:17.049502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c3127-2451-4472-bb86-4a9f62fec20b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:17.051495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c3127-2451-4472-bb86-4a9f62fec20b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:17.052012 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c3127-2451-4472-bb86-4a9f62fec20b None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:17.052939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c3127-2451-4472-bb86-4a9f62fec20b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:17.054367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c3127-2451-4472-bb86-4a9f62fec20b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:17.056806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c3127-2451-4472-bb86-4a9f62fec20b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:17.075485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 53/119] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:14:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:17.077638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3d069-cb29-4b9c-81be-432fd2b73559 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:17.079527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3d069-cb29-4b9c-81be-432fd2b73559 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:17.080168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3d069-cb29-4b9c-81be-432fd2b73559 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:17.082163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 54/120] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:17.084580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3d069-cb29-4b9c-81be-432fd2b73559 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:17.179741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a9891-5460-4159-bf4f-738e05d12661 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:17.215854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c04e9a-b9c1-4579-883b-01de311ffe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:17.216530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c04e9a-b9c1-4579-883b-01de311ffe46 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:17.216816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c04e9a-b9c1-4579-883b-01de311ffe46 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:17.217103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c04e9a-b9c1-4579-883b-01de311ffe46 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8/users/3cbe79decc7e47dbbe30a01873217e73/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:17.219241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c04e9a-b9c1-4579-883b-01de311ffe46 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8, user_id=3cbe79decc7e47dbbe30a01873217e73, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:17.220852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c04e9a-b9c1-4579-883b-01de311ffe46 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:17.235639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3d069-cb29-4b9c-81be-432fd2b73559 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:17.239548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 67/121] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:14:16 2022] PUT /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8/users/3cbe79decc7e47dbbe30a01873217e73/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:14:17.241903 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251e17a-7a77-488a-b022-bb4928c097df None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:17.242815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251e17a-7a77-488a-b022-bb4928c097df None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:17.243159 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251e17a-7a77-488a-b022-bb4928c097df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:17.252672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:17.269292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-a251e17a-7a77-488a-b022-bb4928c097df None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:17.270873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a251e17a-7a77-488a-b022-bb4928c097df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:17.279271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:17.286018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63011d6e-e95f-42f9-a244-48bc1638021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:17.287024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63011d6e-e95f-42f9-a244-48bc1638021a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:17.287318 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63011d6e-e95f-42f9-a244-48bc1638021a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:17.287608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63011d6e-e95f-42f9-a244-48bc1638021a None admin] PATH_INFO: `/v3/users/3cbe79decc7e47dbbe30a01873217e73` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:17.288997 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63011d6e-e95f-42f9-a244-48bc1638021a None admin] RBAC: Authorizing `identity:get_user(user_id=3cbe79decc7e47dbbe30a01873217e73)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:17.291222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63011d6e-e95f-42f9-a244-48bc1638021a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:17.293478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 55/122] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:17 2022] GET /identity/v3/users/3cbe79decc7e47dbbe30a01873217e73 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:17.295062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66649e-271e-4927-b257-4da12961bd3e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:17.295351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66649e-271e-4927-b257-4da12961bd3e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:17.295633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66649e-271e-4927-b257-4da12961bd3e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:17.297861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 56/123] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:17.304457 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66649e-271e-4927-b257-4da12961bd3e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:17.370729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 68/124] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:17.370729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74a8f-4a99-4f80-9617-597488b3505f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:17.370729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74a8f-4a99-4f80-9617-597488b3505f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:17.370729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74a8f-4a99-4f80-9617-597488b3505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:17.408749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-9da74a8f-4a99-4f80-9617-597488b3505f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:17.410963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9da74a8f-4a99-4f80-9617-597488b3505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:17.511910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 69/125] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:17.523774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66649e-271e-4927-b257-4da12961bd3e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:17.583606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2bad0-309e-40df-aaf3-deb83ae06b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:17.584262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2bad0-309e-40df-aaf3-deb83ae06b1b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:17.584550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2bad0-309e-40df-aaf3-deb83ae06b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:17.584830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2bad0-309e-40df-aaf3-deb83ae06b1b None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:17.591090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2bad0-309e-40df-aaf3-deb83ae06b1b None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:17.592570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2bad0-309e-40df-aaf3-deb83ae06b1b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:17.594590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 57/126] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:17 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:17.600762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da74a8f-4a99-4f80-9617-597488b3505f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:17.700564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:17.732114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da74a8f-4a99-4f80-9617-597488b3505f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:17.742952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2bad0-309e-40df-aaf3-deb83ae06b1b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:17.769303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef7a26-a35b-42a7-9d9b-a7bd753d00f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:17.770170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef7a26-a35b-42a7-9d9b-a7bd753d00f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:17.770481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef7a26-a35b-42a7-9d9b-a7bd753d00f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:17.770764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef7a26-a35b-42a7-9d9b-a7bd753d00f0 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8/users/3cbe79decc7e47dbbe30a01873217e73/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:17.773031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef7a26-a35b-42a7-9d9b-a7bd753d00f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8, user_id=3cbe79decc7e47dbbe30a01873217e73, role_id=ac7eb9c247e94edda4cd6ad66b5e6a9a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:17.774632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef7a26-a35b-42a7-9d9b-a7bd753d00f0 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:17.790676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 70/127] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:14:17 2022] PUT /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8/users/3cbe79decc7e47dbbe30a01873217e73/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:14:17.839044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:17.912618 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2bad0-309e-40df-aaf3-deb83ae06b1b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:17.968116 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc2e39-3104-40a3-95d4-0f7476db4be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:17.968781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2e39-3104-40a3-95d4-0f7476db4be9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:17.969068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2e39-3104-40a3-95d4-0f7476db4be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:17.969354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2e39-3104-40a3-95d4-0f7476db4be9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:17.986387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc2e39-3104-40a3-95d4-0f7476db4be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-79cc2e39-3104-40a3-95d4-0f7476db4be9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:17.992778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:17.993615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:17.994342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 58/128] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:17.999447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef7a26-a35b-42a7-9d9b-a7bd753d00f0 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:18.045877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc2e39-3104-40a3-95d4-0f7476db4be9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:18.157590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef7a26-a35b-42a7-9d9b-a7bd753d00f0 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:18.194842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:18.202554 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045df0-339f-4ecd-aec5-486b2a473b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:18.203020 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045df0-339f-4ecd-aec5-486b2a473b31 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:18.203304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045df0-339f-4ecd-aec5-486b2a473b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:18.203580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045df0-339f-4ecd-aec5-486b2a473b31 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:18.204259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66045df0-339f-4ecd-aec5-486b2a473b31 None admin] RBAC: Adding query filter params (name=member) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:18.204566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66045df0-339f-4ecd-aec5-486b2a473b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:18.208667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66045df0-339f-4ecd-aec5-486b2a473b31 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:18.226632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 71/129] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:18.231608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045df0-339f-4ecd-aec5-486b2a473b31 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:18.267823 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc2e39-3104-40a3-95d4-0f7476db4be9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:18.282174 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:18.369201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99d90b-bc69-416b-af02-0b8a97b1f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:18.369864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99d90b-bc69-416b-af02-0b8a97b1f39f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:18.370146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99d90b-bc69-416b-af02-0b8a97b1f39f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:18.370438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99d90b-bc69-416b-af02-0b8a97b1f39f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:18.405269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99d90b-bc69-416b-af02-0b8a97b1f39f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bf99d90b-bc69-416b-af02-0b8a97b1f39f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:18.411336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:18.412168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:18.412902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 59/130] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:14:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:18.414287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1547d63-2f57-4592-b80f-9b00cc9d7d47 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:18.414287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1547d63-2f57-4592-b80f-9b00cc9d7d47 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:18.414287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1547d63-2f57-4592-b80f-9b00cc9d7d47 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:18.423344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045df0-339f-4ecd-aec5-486b2a473b31 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:18.427764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 60/131] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:18 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:18.428589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1547d63-2f57-4592-b80f-9b00cc9d7d47 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:18.480455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db84ee-1f9c-4418-a9f6-8423c8858582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:18.481634 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db84ee-1f9c-4418-a9f6-8423c8858582 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:18.482145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db84ee-1f9c-4418-a9f6-8423c8858582 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:18.482640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db84ee-1f9c-4418-a9f6-8423c8858582 None admin] PATH_INFO: `/v3/users/3cbe79decc7e47dbbe30a01873217e73` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:18.484030 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db84ee-1f9c-4418-a9f6-8423c8858582 None admin] RBAC: Authorizing `identity:get_user(user_id=3cbe79decc7e47dbbe30a01873217e73)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:18.485723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db84ee-1f9c-4418-a9f6-8423c8858582 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:18.488440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 72/132] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:18 2022] GET /identity/v3/users/3cbe79decc7e47dbbe30a01873217e73 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:18.490210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a37216-6794-4927-b629-931621792857 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:18.490725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a37216-6794-4927-b629-931621792857 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:18.491199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a37216-6794-4927-b629-931621792857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:18.526438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e5a37216-6794-4927-b629-931621792857 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:18.531869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e5a37216-6794-4927-b629-931621792857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:18.627739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:18.647840 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 73/133] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:18.648696 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a37216-6794-4927-b629-931621792857 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:18.669232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1547d63-2f57-4592-b80f-9b00cc9d7d47 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:18.735503 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93e0dc-3f98-493e-b5f0-b1b6dc57b11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:18.736379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93e0dc-3f98-493e-b5f0-b1b6dc57b11a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:18.737270 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93e0dc-3f98-493e-b5f0-b1b6dc57b11a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:18.737754 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93e0dc-3f98-493e-b5f0-b1b6dc57b11a None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:18.738483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93e0dc-3f98-493e-b5f0-b1b6dc57b11a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:18.739265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93e0dc-3f98-493e-b5f0-b1b6dc57b11a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:18.740981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93e0dc-3f98-493e-b5f0-b1b6dc57b11a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:18.757033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 61/134] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:18.763308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93e0dc-3f98-493e-b5f0-b1b6dc57b11a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:18.816294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:18.891692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a37216-6794-4927-b629-931621792857 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:18.933776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f3479-c04e-4c44-a3ac-52b79e45dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:18.935453 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f3479-c04e-4c44-a3ac-52b79e45dbac None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:18.937655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93e0dc-3f98-493e-b5f0-b1b6dc57b11a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:18.938150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f3479-c04e-4c44-a3ac-52b79e45dbac None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:18.938645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f3479-c04e-4c44-a3ac-52b79e45dbac None admin] PATH_INFO: `/v3/projects/1dc75a03ba954f35ab5bd3dda651aaff` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:18.941209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f3479-c04e-4c44-a3ac-52b79e45dbac None admin] RBAC: Authorizing `identity:get_project(project_id=1dc75a03ba954f35ab5bd3dda651aaff)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:18.942993 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f3479-c04e-4c44-a3ac-52b79e45dbac None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:18.945865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 74/135] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:18 2022] GET /identity/v3/projects/1dc75a03ba954f35ab5bd3dda651aaff => generated 312 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:18.948267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5108a-bd48-4582-b306-00122965a6f5 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:18.953050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5108a-bd48-4582-b306-00122965a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:18.953580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5108a-bd48-4582-b306-00122965a6f5 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:18.955125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 75/136] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:18.956204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5108a-bd48-4582-b306-00122965a6f5 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:19.010025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d340c4-ff3e-4e65-b13d-30f79e9ba5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:19.012379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d340c4-ff3e-4e65-b13d-30f79e9ba5df None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:19.012902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d340c4-ff3e-4e65-b13d-30f79e9ba5df None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:19.014206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d340c4-ff3e-4e65-b13d-30f79e9ba5df None admin] PATH_INFO: `/v3/users/2b404d3419014a9a8edff785259ec500` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:19.016815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d340c4-ff3e-4e65-b13d-30f79e9ba5df None admin] RBAC: Authorizing `identity:get_user(user_id=2b404d3419014a9a8edff785259ec500)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:19.020419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d340c4-ff3e-4e65-b13d-30f79e9ba5df None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:19.022733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 62/137] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:18 2022] GET /identity/v3/users/2b404d3419014a9a8edff785259ec500 => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:19.025299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb90479-9e82-44ea-a9ee-8cbd352f3acd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:19.026686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb90479-9e82-44ea-a9ee-8cbd352f3acd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:19.028199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb90479-9e82-44ea-a9ee-8cbd352f3acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:19.061087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dbb90479-9e82-44ea-a9ee-8cbd352f3acd None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:19.062352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dbb90479-9e82-44ea-a9ee-8cbd352f3acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:19.078523 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:19.126207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5108a-bd48-4582-b306-00122965a6f5 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:19.139234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 63/138] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:19.144020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb90479-9e82-44ea-a9ee-8cbd352f3acd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:19.179956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe368c3-4dde-4d06-a8ea-8dec000f41ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:19.180636 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe368c3-4dde-4d06-a8ea-8dec000f41ac None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:19.180917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe368c3-4dde-4d06-a8ea-8dec000f41ac None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:19.181193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe368c3-4dde-4d06-a8ea-8dec000f41ac None admin] PATH_INFO: `/v3/projects/1dc75a03ba954f35ab5bd3dda651aaff/users/3cbe79decc7e47dbbe30a01873217e73/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:19.183118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe368c3-4dde-4d06-a8ea-8dec000f41ac None admin] RBAC: Authorizing `identity:create_grant(project_id=1dc75a03ba954f35ab5bd3dda651aaff, user_id=3cbe79decc7e47dbbe30a01873217e73, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:19.184571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe368c3-4dde-4d06-a8ea-8dec000f41ac None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:19.195302 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:19.209130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 76/139] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:14:18 2022] PUT /identity/v3/projects/1dc75a03ba954f35ab5bd3dda651aaff/users/3cbe79decc7e47dbbe30a01873217e73/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:14:19.209950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe368c3-4dde-4d06-a8ea-8dec000f41ac None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:19.333633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb90479-9e82-44ea-a9ee-8cbd352f3acd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:19.403689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf909e24-cbee-4c39-9df6-7326769d6f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:19.404697 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf909e24-cbee-4c39-9df6-7326769d6f45 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:19.405245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf909e24-cbee-4c39-9df6-7326769d6f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:19.405720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf909e24-cbee-4c39-9df6-7326769d6f45 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:19.407101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf909e24-cbee-4c39-9df6-7326769d6f45 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:19.408956 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf909e24-cbee-4c39-9df6-7326769d6f45 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:19.410998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 64/140] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:19 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:19.416982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf909e24-cbee-4c39-9df6-7326769d6f45 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:19.434804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe368c3-4dde-4d06-a8ea-8dec000f41ac None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:19.485858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:19.531074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00d426-61fb-4854-8d75-43f74fd6b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:19.531788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d426-61fb-4854-8d75-43f74fd6b554 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:19.532075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d426-61fb-4854-8d75-43f74fd6b554 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:19.532351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d426-61fb-4854-8d75-43f74fd6b554 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:19.533700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00d426-61fb-4854-8d75-43f74fd6b554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:19.535700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00d426-61fb-4854-8d75-43f74fd6b554 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:19.537289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 77/141] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:19.538059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00d426-61fb-4854-8d75-43f74fd6b554 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:19.576453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:19.587594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf909e24-cbee-4c39-9df6-7326769d6f45 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:19.632678 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba5c43-2ef0-483d-92c3-1785159c172a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:19.633832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba5c43-2ef0-483d-92c3-1785159c172a None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:19.634319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba5c43-2ef0-483d-92c3-1785159c172a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:19.635207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba5c43-2ef0-483d-92c3-1785159c172a None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8/users/2b404d3419014a9a8edff785259ec500/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:19.638240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba5c43-2ef0-483d-92c3-1785159c172a None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8, user_id=2b404d3419014a9a8edff785259ec500, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:19.639974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba5c43-2ef0-483d-92c3-1785159c172a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:19.662554 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00d426-61fb-4854-8d75-43f74fd6b554 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:19.668207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 65/142] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:14:19 2022] PUT /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8/users/2b404d3419014a9a8edff785259ec500/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:14:19.668785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba5c43-2ef0-483d-92c3-1785159c172a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:19.729814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8a635-605f-426e-89a5-e9f0d63f314f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:19.730585 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8a635-605f-426e-89a5-e9f0d63f314f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:19.730951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8a635-605f-426e-89a5-e9f0d63f314f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:19.731236 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8a635-605f-426e-89a5-e9f0d63f314f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:19.755748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8a635-605f-426e-89a5-e9f0d63f314f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-1ad8a635-605f-426e-89a5-e9f0d63f314f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:19.761052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:19.761878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:19.762661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:19.762661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:19.762661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:19.762661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:19.762661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:19.762661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:19.762661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:19.762661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:19.762661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:19.762661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:19.762661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:19.762661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:19.766756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 78/143] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:19.768753 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8a635-605f-426e-89a5-e9f0d63f314f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:19.836715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba5c43-2ef0-483d-92c3-1785159c172a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:19.889106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:19.967346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d94dcb-0230-479f-8f3c-ee5398e40ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:19.967905 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94dcb-0230-479f-8f3c-ee5398e40ad2 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:19.968194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94dcb-0230-479f-8f3c-ee5398e40ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:19.968474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94dcb-0230-479f-8f3c-ee5398e40ad2 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:19.969173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d94dcb-0230-479f-8f3c-ee5398e40ad2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:19.970705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d94dcb-0230-479f-8f3c-ee5398e40ad2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:19.989034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8a635-605f-426e-89a5-e9f0d63f314f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:20.021324 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 66/144] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:14:19 2022] POST /identity/v3/users => generated 283 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:14:20.080308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e563c1-31f2-4838-91bf-a0e5b175d5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:20.081947 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e563c1-31f2-4838-91bf-a0e5b175d5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:20.082228 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e563c1-31f2-4838-91bf-a0e5b175d5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:20.082547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e563c1-31f2-4838-91bf-a0e5b175d5c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:20.083212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e563c1-31f2-4838-91bf-a0e5b175d5c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:20.083516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e563c1-31f2-4838-91bf-a0e5b175d5c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:20.084935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e563c1-31f2-4838-91bf-a0e5b175d5c5 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:20.102025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 79/145] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:20.108184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d94dcb-0230-479f-8f3c-ee5398e40ad2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:20.122792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:20.243704 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d94dcb-0230-479f-8f3c-ee5398e40ad2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:20.274907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d502b-0963-4f44-8796-acc31f674974 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:20.275218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d502b-0963-4f44-8796-acc31f674974 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:20.275447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d502b-0963-4f44-8796-acc31f674974 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:20.276908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 80/146] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:14:20.285151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19933cb-6dd6-44bf-ac87-98faca335bed None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:20.285450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19933cb-6dd6-44bf-ac87-98faca335bed None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:20.285689 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19933cb-6dd6-44bf-ac87-98faca335bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:20.321690 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c19933cb-6dd6-44bf-ac87-98faca335bed None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:20.322940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c19933cb-6dd6-44bf-ac87-98faca335bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:20.325745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b99bba-1a7a-4ba5-8977-41f37f542fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:20.326428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99bba-1a7a-4ba5-8977-41f37f542fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:20.326711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99bba-1a7a-4ba5-8977-41f37f542fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:20.326986 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99bba-1a7a-4ba5-8977-41f37f542fd7 None admin] PATH_INFO: `/v3/users/e817d0f626ae43e3a868b12b41537951` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:20.328234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b99bba-1a7a-4ba5-8977-41f37f542fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=e817d0f626ae43e3a868b12b41537951)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:20.329784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b99bba-1a7a-4ba5-8977-41f37f542fd7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:20.332538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 67/147] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:20 2022] GET /identity/v3/users/e817d0f626ae43e3a868b12b41537951 => generated 289 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:20.339554 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b99bba-1a7a-4ba5-8977-41f37f542fd7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:20.425075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 81/148] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:14:20.468412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:20.496930 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b99bba-1a7a-4ba5-8977-41f37f542fd7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:20.514204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ebb98-efd7-4106-844e-b7af8f4f01b7 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:20.514857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ebb98-efd7-4106-844e-b7af8f4f01b7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:20.515347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ebb98-efd7-4106-844e-b7af8f4f01b7 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:20.516898 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 82/149] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:14:20.522333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf4eae-cf94-40f5-8686-e5bd7f8f672a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:20.522936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf4eae-cf94-40f5-8686-e5bd7f8f672a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:20.523425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf4eae-cf94-40f5-8686-e5bd7f8f672a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:20.543314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319384c-fd55-4284-b930-0682613c9f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:20.543972 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319384c-fd55-4284-b930-0682613c9f66 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:20.544254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319384c-fd55-4284-b930-0682613c9f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:20.544546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319384c-fd55-4284-b930-0682613c9f66 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:20.548765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319384c-fd55-4284-b930-0682613c9f66 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:20.552159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319384c-fd55-4284-b930-0682613c9f66 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:20.552852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 68/150] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:20 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:20.556971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-6dbf4eae-cf94-40f5-8686-e5bd7f8f672a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:20.558112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319384c-fd55-4284-b930-0682613c9f66 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:20.558647 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6dbf4eae-cf94-40f5-8686-e5bd7f8f672a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:20.598589 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:20.638258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 83/151] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:20.687314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319384c-fd55-4284-b930-0682613c9f66 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:20.731992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ba57a-ca57-4293-bd2f-b9ca56e9f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:20.733030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ba57a-ca57-4293-bd2f-b9ca56e9f064 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:20.733545 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ba57a-ca57-4293-bd2f-b9ca56e9f064 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:20.734017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ba57a-ca57-4293-bd2f-b9ca56e9f064 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8/users/e817d0f626ae43e3a868b12b41537951/roles/cca59383436e4294a41556fbdf237853` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:20.736198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ba57a-ca57-4293-bd2f-b9ca56e9f064 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8, user_id=e817d0f626ae43e3a868b12b41537951, role_id=cca59383436e4294a41556fbdf237853)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:20.737978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ba57a-ca57-4293-bd2f-b9ca56e9f064 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:20.743087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf4eae-cf94-40f5-8686-e5bd7f8f672a None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:20.762064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 69/152] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:14:20 2022] PUT /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8/users/e817d0f626ae43e3a868b12b41537951/roles/cca59383436e4294a41556fbdf237853 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:14:20.878515 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf4eae-cf94-40f5-8686-e5bd7f8f672a None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:20.919032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b38d7-48c4-4bf3-aad2-7cb915f08ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:20.919735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b38d7-48c4-4bf3-aad2-7cb915f08ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:20.920019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b38d7-48c4-4bf3-aad2-7cb915f08ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:20.920295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b38d7-48c4-4bf3-aad2-7cb915f08ad9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:20.932649 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b38d7-48c4-4bf3-aad2-7cb915f08ad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-9a4b38d7-48c4-4bf3-aad2-7cb915f08ad9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:20.937894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:20.938769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:20.940033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 84/153] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:14:20.945343 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ba57a-ca57-4293-bd2f-b9ca56e9f064 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:20.956362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:21.082148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ba57a-ca57-4293-bd2f-b9ca56e9f064 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:21.118857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b38d7-48c4-4bf3-aad2-7cb915f08ad9 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:21.144491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41700ff-4b0d-4dff-922f-cf349f6b18a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:21.147437 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41700ff-4b0d-4dff-922f-cf349f6b18a0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:21.147728 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41700ff-4b0d-4dff-922f-cf349f6b18a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:21.148005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41700ff-4b0d-4dff-922f-cf349f6b18a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:21.150139 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41700ff-4b0d-4dff-922f-cf349f6b18a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:21.150494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41700ff-4b0d-4dff-922f-cf349f6b18a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:21.151918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41700ff-4b0d-4dff-922f-cf349f6b18a0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:21.172775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 70/154] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:21.180738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:21.205099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41700ff-4b0d-4dff-922f-cf349f6b18a0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:21.316862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b38d7-48c4-4bf3-aad2-7cb915f08ad9 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:21.357681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ff070-3047-4a68-929c-e50dd5d465db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:21.358244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ff070-3047-4a68-929c-e50dd5d465db None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:21.358587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ff070-3047-4a68-929c-e50dd5d465db None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:21.358868 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ff070-3047-4a68-929c-e50dd5d465db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:21.371396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ff070-3047-4a68-929c-e50dd5d465db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-dd2ff070-3047-4a68-929c-e50dd5d465db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:21.377763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:21.378662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:21.380060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:21.380060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:21.380060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:21.380060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:21.380060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:21.380060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:21.380060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:21.380060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:21.380060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:21.380060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:21.380060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:21.380060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:21.380867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 85/155] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:14:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:14:21.386170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ff070-3047-4a68-929c-e50dd5d465db None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:21.390232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:21.473723 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41700ff-4b0d-4dff-922f-cf349f6b18a0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:21.491507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:21.501113 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ff070-3047-4a68-929c-e50dd5d465db None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:21.551117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379afa9-bcdf-4dcc-b806-e6f8491105c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:21.551843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379afa9-bcdf-4dcc-b806-e6f8491105c8 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:21.552128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379afa9-bcdf-4dcc-b806-e6f8491105c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:21.552399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379afa9-bcdf-4dcc-b806-e6f8491105c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:21.553083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379afa9-bcdf-4dcc-b806-e6f8491105c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:21.553451 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379afa9-bcdf-4dcc-b806-e6f8491105c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:21.554956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379afa9-bcdf-4dcc-b806-e6f8491105c8 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:21.563105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d9b3f-08c5-4d6b-9f47-e289c403db72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:21.563767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d9b3f-08c5-4d6b-9f47-e289c403db72 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:21.564050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d9b3f-08c5-4d6b-9f47-e289c403db72 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:21.564209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 86/156] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:14:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:21.564377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d9b3f-08c5-4d6b-9f47-e289c403db72 None admin] PATH_INFO: `/v3/users/3cbe79decc7e47dbbe30a01873217e73` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:21.569779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379afa9-bcdf-4dcc-b806-e6f8491105c8 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:21.571143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d9b3f-08c5-4d6b-9f47-e289c403db72 None admin] RBAC: Authorizing `identity:get_user(user_id=3cbe79decc7e47dbbe30a01873217e73)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:21.572713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d9b3f-08c5-4d6b-9f47-e289c403db72 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:21.574622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 71/157] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:21 2022] GET /identity/v3/users/3cbe79decc7e47dbbe30a01873217e73 => generated 275 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:21.579654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d9b3f-08c5-4d6b-9f47-e289c403db72 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:21.686156 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379afa9-bcdf-4dcc-b806-e6f8491105c8 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:21.727222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983db29e-bea8-4b51-8dcc-2fc9fdf398f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:21.727921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983db29e-bea8-4b51-8dcc-2fc9fdf398f4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:21.728203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983db29e-bea8-4b51-8dcc-2fc9fdf398f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:21.728478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983db29e-bea8-4b51-8dcc-2fc9fdf398f4 None admin] PATH_INFO: `/v3/users/3cbe79decc7e47dbbe30a01873217e73` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:21.729628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983db29e-bea8-4b51-8dcc-2fc9fdf398f4 None admin] RBAC: Authorizing `identity:get_user(user_id=3cbe79decc7e47dbbe30a01873217e73)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:21.731122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983db29e-bea8-4b51-8dcc-2fc9fdf398f4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:21.733421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 87/158] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:21 2022] GET /identity/v3/users/3cbe79decc7e47dbbe30a01873217e73 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:21.739294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983db29e-bea8-4b51-8dcc-2fc9fdf398f4 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:21.774838 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:21.857244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983db29e-bea8-4b51-8dcc-2fc9fdf398f4 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:21.887057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d9b3f-08c5-4d6b-9f47-e289c403db72 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:21.897963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25eb7de-d705-45db-a302-5b89167f4ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:21.898637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eb7de-d705-45db-a302-5b89167f4ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:21.898920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eb7de-d705-45db-a302-5b89167f4ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:21.899194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eb7de-d705-45db-a302-5b89167f4ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:21.974855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25eb7de-d705-45db-a302-5b89167f4ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:21.976431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25eb7de-d705-45db-a302-5b89167f4ee7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:21.983675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a68ece-3599-4c56-8750-de4b6bea9e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:21.984312 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a68ece-3599-4c56-8750-de4b6bea9e75 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:21.984592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a68ece-3599-4c56-8750-de4b6bea9e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:21.984866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a68ece-3599-4c56-8750-de4b6bea9e75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:21.993856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:22.011079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:22.093952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 88/159] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:14:22.100485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25eb7de-d705-45db-a302-5b89167f4ee7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:22.141758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a68ece-3599-4c56-8750-de4b6bea9e75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:22.143733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a68ece-3599-4c56-8750-de4b6bea9e75 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:22.219362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25eb7de-d705-45db-a302-5b89167f4ee7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:22.248551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:22.261005 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd06a1-fd4e-4f20-aa6d-59eb0e57598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:22.261704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd06a1-fd4e-4f20-aa6d-59eb0e57598c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:22.261993 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd06a1-fd4e-4f20-aa6d-59eb0e57598c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:22.262274 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd06a1-fd4e-4f20-aa6d-59eb0e57598c None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:22.263712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd06a1-fd4e-4f20-aa6d-59eb0e57598c None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:22.265560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd06a1-fd4e-4f20-aa6d-59eb0e57598c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:22.267656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 89/160] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:22 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:22.274551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd06a1-fd4e-4f20-aa6d-59eb0e57598c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:22.402241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 72/161] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 823 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:22.407385 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a68ece-3599-4c56-8750-de4b6bea9e75 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:22.421872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd06a1-fd4e-4f20-aa6d-59eb0e57598c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:22.457491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:22.478118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552eb94-30ee-493c-b63f-22667a5f54d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:22.479120 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552eb94-30ee-493c-b63f-22667a5f54d8 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:22.479778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552eb94-30ee-493c-b63f-22667a5f54d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:22.480191 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552eb94-30ee-493c-b63f-22667a5f54d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:22.481079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552eb94-30ee-493c-b63f-22667a5f54d8 None admin] RBAC: Adding query filter params (role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a, scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8, user.id=3cbe79decc7e47dbbe30a01873217e73) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:22.481529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552eb94-30ee-493c-b63f-22667a5f54d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:22.483175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552eb94-30ee-493c-b63f-22667a5f54d8 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:22.493434 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 90/162] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:22 2022] GET /identity/v3/role_assignments?user.id=3cbe79decc7e47dbbe30a01873217e73&scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8&role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:22.537649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a68ece-3599-4c56-8750-de4b6bea9e75 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:22.575442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87171821-a470-4bbd-816c-f7940e35356d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:22.576101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87171821-a470-4bbd-816c-f7940e35356d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:22.576382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87171821-a470-4bbd-816c-f7940e35356d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:22.576656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87171821-a470-4bbd-816c-f7940e35356d None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:22.577809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87171821-a470-4bbd-816c-f7940e35356d None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:22.579301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87171821-a470-4bbd-816c-f7940e35356d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:22.581475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 73/163] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:22 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:22.587606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552eb94-30ee-493c-b63f-22667a5f54d8 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:22.674127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:22.744767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552eb94-30ee-493c-b63f-22667a5f54d8 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:22.788401 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb170d-66e9-4e04-8d3f-3b151565899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:22.789667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb170d-66e9-4e04-8d3f-3b151565899e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:22.790115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb170d-66e9-4e04-8d3f-3b151565899e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:22.790824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb170d-66e9-4e04-8d3f-3b151565899e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:22.791709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb170d-66e9-4e04-8d3f-3b151565899e None admin] RBAC: Adding query filter params (role.id=c6ff6f013f2f41d78fedabbe698ed13e, scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8, user.id=3cbe79decc7e47dbbe30a01873217e73) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:22.792162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb170d-66e9-4e04-8d3f-3b151565899e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:22.793767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb170d-66e9-4e04-8d3f-3b151565899e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:22.803417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 91/164] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:22 2022] GET /identity/v3/role_assignments?user.id=3cbe79decc7e47dbbe30a01873217e73&scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8&role.id=c6ff6f013f2f41d78fedabbe698ed13e => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:23.115156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b9bce-2b33-41a2-913a-0d22e2ef2422 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:23.115410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b9bce-2b33-41a2-913a-0d22e2ef2422 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:23.115624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b9bce-2b33-41a2-913a-0d22e2ef2422 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:23.117208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 74/165] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:23.123058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ef90d-6234-40e6-9e2f-2e9f9d37382f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:23.123593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ef90d-6234-40e6-9e2f-2e9f9d37382f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:23.124020 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ef90d-6234-40e6-9e2f-2e9f9d37382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:23.149577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-8e5ef90d-6234-40e6-9e2f-2e9f9d37382f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:23.151093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8e5ef90d-6234-40e6-9e2f-2e9f9d37382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:23.232601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 92/166] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:23.685683 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63a1ac-cb84-4e91-928e-f3fa9193f7fd None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:23.686172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63a1ac-cb84-4e91-928e-f3fa9193f7fd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:23.686172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63a1ac-cb84-4e91-928e-f3fa9193f7fd None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:23.687732 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ef90d-6234-40e6-9e2f-2e9f9d37382f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:23.687854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 75/167] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:23.707337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c6ad8-d8c9-4535-bdbe-fda939cf8984 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:23.707638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c6ad8-d8c9-4535-bdbe-fda939cf8984 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:23.707884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c6ad8-d8c9-4535-bdbe-fda939cf8984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:23.731630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-344c6ad8-d8c9-4535-bdbe-fda939cf8984 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:23.732822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-344c6ad8-d8c9-4535-bdbe-fda939cf8984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:23.744258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:23.818959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 76/168] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:23.843843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ef90d-6234-40e6-9e2f-2e9f9d37382f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:23.898520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a49adc-8a5b-4a34-aeaf-a59136c39875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:23.899164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49adc-8a5b-4a34-aeaf-a59136c39875 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:23.899447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49adc-8a5b-4a34-aeaf-a59136c39875 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:23.899720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49adc-8a5b-4a34-aeaf-a59136c39875 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:23.914340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a49adc-8a5b-4a34-aeaf-a59136c39875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-a9a49adc-8a5b-4a34-aeaf-a59136c39875 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:23.919938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:23.920816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:23.921668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:23.921668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:23.921668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:23.921668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:23.921668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:23.921668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:23.921668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:23.921668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:23.921668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:23.921668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:23.921668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:23.921668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:23.923949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 93/169] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:23.930406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c6ad8-d8c9-4535-bdbe-fda939cf8984 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:23.970400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:24.052610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c6ad8-d8c9-4535-bdbe-fda939cf8984 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:24.096465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18935e3-e3fd-40b5-8810-d3ab32970f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:24.097101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18935e3-e3fd-40b5-8810-d3ab32970f04 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:24.097383 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18935e3-e3fd-40b5-8810-d3ab32970f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:24.097658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18935e3-e3fd-40b5-8810-d3ab32970f04 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:24.098337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18935e3-e3fd-40b5-8810-d3ab32970f04 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:24.098666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18935e3-e3fd-40b5-8810-d3ab32970f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:24.100074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18935e3-e3fd-40b5-8810-d3ab32970f04 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:24.114604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 77/170] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:24.120054 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a49adc-8a5b-4a34-aeaf-a59136c39875 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:24.174582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18935e3-e3fd-40b5-8810-d3ab32970f04 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:24.240090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a49adc-8a5b-4a34-aeaf-a59136c39875 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:24.249047 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:24.285604 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bb63d-8076-445c-acf0-ca3e9a0322cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:24.286246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bb63d-8076-445c-acf0-ca3e9a0322cc None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:24.286549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bb63d-8076-445c-acf0-ca3e9a0322cc None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:24.286822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bb63d-8076-445c-acf0-ca3e9a0322cc None admin] PATH_INFO: `/v3/users/3cbe79decc7e47dbbe30a01873217e73` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:24.289017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bb63d-8076-445c-acf0-ca3e9a0322cc None admin] RBAC: Authorizing `identity:get_user(user_id=3cbe79decc7e47dbbe30a01873217e73)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:24.292189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bb63d-8076-445c-acf0-ca3e9a0322cc None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:24.298368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 94/171] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:24 2022] GET /identity/v3/users/3cbe79decc7e47dbbe30a01873217e73 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:24.300708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bb63d-8076-445c-acf0-ca3e9a0322cc None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:24.398742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:24.406862 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18935e3-e3fd-40b5-8810-d3ab32970f04 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:24.458751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df3821-9371-4870-9486-97be33d48dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:24.459424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df3821-9371-4870-9486-97be33d48dcb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:24.459706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df3821-9371-4870-9486-97be33d48dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:24.459983 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df3821-9371-4870-9486-97be33d48dcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:24.478260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df3821-9371-4870-9486-97be33d48dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d0df3821-9371-4870-9486-97be33d48dcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:24.484817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:24.485865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:24.486759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 78/172] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:14:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:24.494181 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df3821-9371-4870-9486-97be33d48dcb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:24.609098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bb63d-8076-445c-acf0-ca3e9a0322cc None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:24.687549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29487a-ba49-493a-a5d8-7c2a0b01e12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:24.688163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29487a-ba49-493a-a5d8-7c2a0b01e12e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:24.688505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29487a-ba49-493a-a5d8-7c2a0b01e12e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:24.688807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29487a-ba49-493a-a5d8-7c2a0b01e12e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:24.692996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df3821-9371-4870-9486-97be33d48dcb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:24.743101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea2371-d380-4123-8cf4-6136495035ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:24.744155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2371-d380-4123-8cf4-6136495035ae None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:24.744703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2371-d380-4123-8cf4-6136495035ae None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:24.745168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2371-d380-4123-8cf4-6136495035ae None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:24.745990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea2371-d380-4123-8cf4-6136495035ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:24.746539 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea2371-d380-4123-8cf4-6136495035ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:24.748169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea2371-d380-4123-8cf4-6136495035ae None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:24.765606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 79/173] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:24.767100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f747437-ce7b-40ac-ab37-414b0fb82c4f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:24.767547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f747437-ce7b-40ac-ab37-414b0fb82c4f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:24.768007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f747437-ce7b-40ac-ab37-414b0fb82c4f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:24.769461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 80/174] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:24.774331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:24.775572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910179c-97bd-4839-a220-8414e0215e25 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:24.775856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910179c-97bd-4839-a220-8414e0215e25 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:24.776132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910179c-97bd-4839-a220-8414e0215e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:24.781607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29487a-ba49-493a-a5d8-7c2a0b01e12e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:24.781607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29487a-ba49-493a-a5d8-7c2a0b01e12e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:24.824294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9910179c-97bd-4839-a220-8414e0215e25 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:24.825513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9910179c-97bd-4839-a220-8414e0215e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:24.858739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:24.936167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 95/175] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:24.937939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29487a-ba49-493a-a5d8-7c2a0b01e12e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:25.022854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:25.023898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 81/176] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:25.024562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910179c-97bd-4839-a220-8414e0215e25 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:25.048151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29487a-ba49-493a-a5d8-7c2a0b01e12e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:25.086026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe19f00-0f66-456b-9d16-c54cf68d8ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:25.087480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19f00-0f66-456b-9d16-c54cf68d8ddd None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.087972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19f00-0f66-456b-9d16-c54cf68d8ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.088583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19f00-0f66-456b-9d16-c54cf68d8ddd None admin] PATH_INFO: `/v3/users/2b404d3419014a9a8edff785259ec500` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.094996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe19f00-0f66-456b-9d16-c54cf68d8ddd None admin] RBAC: Authorizing `identity:get_user(user_id=2b404d3419014a9a8edff785259ec500)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:25.097335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe19f00-0f66-456b-9d16-c54cf68d8ddd None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:25.099232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 96/177] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:24 2022] GET /identity/v3/users/2b404d3419014a9a8edff785259ec500 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:25.105303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe19f00-0f66-456b-9d16-c54cf68d8ddd None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:25.216341 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe19f00-0f66-456b-9d16-c54cf68d8ddd None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:25.258741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbccdd-eb15-424c-8b1b-d304362b18cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:25.259903 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbccdd-eb15-424c-8b1b-d304362b18cd None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.260399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbccdd-eb15-424c-8b1b-d304362b18cd None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.260874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbccdd-eb15-424c-8b1b-d304362b18cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.265557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910179c-97bd-4839-a220-8414e0215e25 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:25.274828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:25.306736 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73a604-238b-4547-8858-6647f25fc21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:25.307477 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73a604-238b-4547-8858-6647f25fc21e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.307822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73a604-238b-4547-8858-6647f25fc21e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.308184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73a604-238b-4547-8858-6647f25fc21e None admin] PATH_INFO: `/v3/projects/1dc75a03ba954f35ab5bd3dda651aaff` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.309734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73a604-238b-4547-8858-6647f25fc21e None admin] RBAC: Authorizing `identity:get_project(project_id=1dc75a03ba954f35ab5bd3dda651aaff)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:25.311785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73a604-238b-4547-8858-6647f25fc21e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:25.313938 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 82/178] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:25 2022] GET /identity/v3/projects/1dc75a03ba954f35ab5bd3dda651aaff => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:25.315733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b403d-aaf5-406d-911b-30f7b86241d2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.316105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b403d-aaf5-406d-911b-30f7b86241d2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.316463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b403d-aaf5-406d-911b-30f7b86241d2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.318635 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 83/179] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:25.325241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a91667-dd6b-4629-9010-442e5cc6ceae None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.325525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a91667-dd6b-4629-9010-442e5cc6ceae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.325799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a91667-dd6b-4629-9010-442e5cc6ceae None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.327123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 84/180] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:25.327907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a91667-dd6b-4629-9010-442e5cc6ceae None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:25.345840 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbccdd-eb15-424c-8b1b-d304362b18cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:25.348281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:25.348959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbccdd-eb15-424c-8b1b-d304362b18cd None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:25.440663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a91667-dd6b-4629-9010-442e5cc6ceae None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:25.455185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 97/181] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:25.457111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca3f1-1061-4e68-a5ee-6355ce867e74 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.457455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca3f1-1061-4e68-a5ee-6355ce867e74 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.457730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca3f1-1061-4e68-a5ee-6355ce867e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.475518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ea7ca3f1-1061-4e68-a5ee-6355ce867e74 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:25.476699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ea7ca3f1-1061-4e68-a5ee-6355ce867e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:25.478106 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d0cc0-7293-48f6-8e13-15238c796522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:25.478751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0cc0-7293-48f6-8e13-15238c796522 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.479033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0cc0-7293-48f6-8e13-15238c796522 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.479306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0cc0-7293-48f6-8e13-15238c796522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.480034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0cc0-7293-48f6-8e13-15238c796522 None admin] RBAC: Adding query filter params (role.id=c6ff6f013f2f41d78fedabbe698ed13e, scope.project.id=1dc75a03ba954f35ab5bd3dda651aaff, user.id=3cbe79decc7e47dbbe30a01873217e73) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:25.480344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0cc0-7293-48f6-8e13-15238c796522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:25.481792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0cc0-7293-48f6-8e13-15238c796522 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:25.488016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 85/182] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:25 2022] GET /identity/v3/role_assignments?user.id=3cbe79decc7e47dbbe30a01873217e73&scope.project.id=1dc75a03ba954f35ab5bd3dda651aaff&role.id=c6ff6f013f2f41d78fedabbe698ed13e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:25.489005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4113a-c921-4645-8c9b-891ea2bd65af None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.489288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4113a-c921-4645-8c9b-891ea2bd65af None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.489564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4113a-c921-4645-8c9b-891ea2bd65af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.516018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4ad4113a-c921-4645-8c9b-891ea2bd65af None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:25.517268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4ad4113a-c921-4645-8c9b-891ea2bd65af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:25.524402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:25.565529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 98/183] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:25.567872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a299b-343b-4772-9ba8-e1fe68e4d482 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.568249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a299b-343b-4772-9ba8-e1fe68e4d482 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.568856 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a299b-343b-4772-9ba8-e1fe68e4d482 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.570140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 99/184] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:25.574463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a299b-343b-4772-9ba8-e1fe68e4d482 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:25.602414 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 86/185] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:25.603767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4113a-c921-4645-8c9b-891ea2bd65af None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:25.617179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:25.694569 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a299b-343b-4772-9ba8-e1fe68e4d482 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:25.738734 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5905f-1734-4e34-8cba-5bbe704fcad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:25.739481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5905f-1734-4e34-8cba-5bbe704fcad3 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.739799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5905f-1734-4e34-8cba-5bbe704fcad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.740110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5905f-1734-4e34-8cba-5bbe704fcad3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.751208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4113a-c921-4645-8c9b-891ea2bd65af None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:25.753133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5905f-1734-4e34-8cba-5bbe704fcad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-4da5905f-1734-4e34-8cba-5bbe704fcad3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:25.761194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:25.762255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:25.763398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 100/186] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:14:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:25.768952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c4c23-f3ee-497a-a351-04e9b990ab6e None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.769401 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c4c23-f3ee-497a-a351-04e9b990ab6e None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.769816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c4c23-f3ee-497a-a351-04e9b990ab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.792839 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b06c4c23-f3ee-497a-a351-04e9b990ab6e None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:25.794239 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b06c4c23-f3ee-497a-a351-04e9b990ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:25.801334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be965a-7bb5-4e53-9519-582e0aaf56ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:25.802018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be965a-7bb5-4e53-9519-582e0aaf56ce None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.802299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be965a-7bb5-4e53-9519-582e0aaf56ce None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.802595 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be965a-7bb5-4e53-9519-582e0aaf56ce None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.803767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be965a-7bb5-4e53-9519-582e0aaf56ce None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:25.805286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be965a-7bb5-4e53-9519-582e0aaf56ce None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:25.807042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 87/187] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:25 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:25.807785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be965a-7bb5-4e53-9519-582e0aaf56ce None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:25.825072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:25.869262 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 101/188] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:25.870186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c4c23-f3ee-497a-a351-04e9b990ab6e None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:25.910317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:25.936964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be965a-7bb5-4e53-9519-582e0aaf56ce None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:25.980595 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cffd5e-1a22-4fdb-94e6-6961f0176c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:25.981213 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cffd5e-1a22-4fdb-94e6-6961f0176c90 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:25.981529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cffd5e-1a22-4fdb-94e6-6961f0176c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:25.981809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cffd5e-1a22-4fdb-94e6-6961f0176c90 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:25.982953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cffd5e-1a22-4fdb-94e6-6961f0176c90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:25.982953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cffd5e-1a22-4fdb-94e6-6961f0176c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:25.983661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c4c23-f3ee-497a-a351-04e9b990ab6e None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:25.984144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cffd5e-1a22-4fdb-94e6-6961f0176c90 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:25.996788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 88/189] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:25.997708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cffd5e-1a22-4fdb-94e6-6961f0176c90 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:26.021633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2636352-3e0e-43bc-b9e9-3286f1285339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:26.022246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2636352-3e0e-43bc-b9e9-3286f1285339 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:26.022561 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2636352-3e0e-43bc-b9e9-3286f1285339 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:26.022836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2636352-3e0e-43bc-b9e9-3286f1285339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:26.023569 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2636352-3e0e-43bc-b9e9-3286f1285339 None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8, user.id=2b404d3419014a9a8edff785259ec500) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:26.023879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2636352-3e0e-43bc-b9e9-3286f1285339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:26.025336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2636352-3e0e-43bc-b9e9-3286f1285339 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:26.031213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 102/190] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:25 2022] GET /identity/v3/role_assignments?user.id=2b404d3419014a9a8edff785259ec500&scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8&role.id=6413aac4240a46ba816472c29e305973 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:26.031990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2636352-3e0e-43bc-b9e9-3286f1285339 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:26.071289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:26.154728 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cffd5e-1a22-4fdb-94e6-6961f0176c90 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:26.165340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2636352-3e0e-43bc-b9e9-3286f1285339 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:26.201192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e1460-8730-44c9-8f69-659618ce8a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:26.202127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e1460-8730-44c9-8f69-659618ce8a84 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:26.202427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e1460-8730-44c9-8f69-659618ce8a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:26.202755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e1460-8730-44c9-8f69-659618ce8a84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:26.205855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b331182-4530-416a-abc9-8e39d2b4f119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:26.206545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b331182-4530-416a-abc9-8e39d2b4f119 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:26.206831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b331182-4530-416a-abc9-8e39d2b4f119 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:26.207109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b331182-4530-416a-abc9-8e39d2b4f119 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:26.212308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:26.217341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e1460-8730-44c9-8f69-659618ce8a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:26.219705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b331182-4530-416a-abc9-8e39d2b4f119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1e1e1460-8730-44c9-8f69-659618ce8a84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:26.223206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:26.224142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:26.224908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:26.224908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:26.224908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:26.224908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:26.224908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:26.224908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:26.224908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:26.224908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:26.224908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:26.224908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:26.224908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:26.224908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-8b331182-4530-416a-abc9-8e39d2b4f119 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:26.226010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:26.231009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 103/191] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:26.231755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b331182-4530-416a-abc9-8e39d2b4f119 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:26.232481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 89/192] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:14:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:26.232481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e1460-8730-44c9-8f69-659618ce8a84 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:26.333852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:26.344436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e1460-8730-44c9-8f69-659618ce8a84 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:26.349376 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b331182-4530-416a-abc9-8e39d2b4f119 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:26.381202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91943f00-e706-40ba-b702-02a628daf868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:26.381903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91943f00-e706-40ba-b702-02a628daf868 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:26.382190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91943f00-e706-40ba-b702-02a628daf868 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:26.382495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91943f00-e706-40ba-b702-02a628daf868 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:26.383672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91943f00-e706-40ba-b702-02a628daf868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:26.385028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4499d1-71e3-4310-99d3-d10f97b231b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:26.385144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91943f00-e706-40ba-b702-02a628daf868 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:26.385662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4499d1-71e3-4310-99d3-d10f97b231b3 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:26.385944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4499d1-71e3-4310-99d3-d10f97b231b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:26.386216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4499d1-71e3-4310-99d3-d10f97b231b3 None admin] PATH_INFO: `/v3/users/a11b9a6d49c14c5f81a742b87cb3b3d6` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:26.386907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 90/193] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:26.387574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91943f00-e706-40ba-b702-02a628daf868 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:26.403431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4499d1-71e3-4310-99d3-d10f97b231b3 None admin] RBAC: Authorizing `identity:get_user(user_id=a11b9a6d49c14c5f81a742b87cb3b3d6)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:26.404954 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4499d1-71e3-4310-99d3-d10f97b231b3 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:26.406569 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 104/194] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:26 2022] GET /identity/v3/users/a11b9a6d49c14c5f81a742b87cb3b3d6 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:26.407322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4499d1-71e3-4310-99d3-d10f97b231b3 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:26.455866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:26.489282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91943f00-e706-40ba-b702-02a628daf868 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:26.506263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4499d1-71e3-4310-99d3-d10f97b231b3 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:26.522954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16590fa0-7e40-4b1e-a455-eacd2ca16541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:26.523569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16590fa0-7e40-4b1e-a455-eacd2ca16541 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:26.523850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16590fa0-7e40-4b1e-a455-eacd2ca16541 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:26.524131 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16590fa0-7e40-4b1e-a455-eacd2ca16541 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:26.524790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16590fa0-7e40-4b1e-a455-eacd2ca16541 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:26.525094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16590fa0-7e40-4b1e-a455-eacd2ca16541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:26.526519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16590fa0-7e40-4b1e-a455-eacd2ca16541 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:26.534956 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 91/195] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:14:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:26.535726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16590fa0-7e40-4b1e-a455-eacd2ca16541 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:26.540899 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeebac-93b4-41ae-a8f1-38e8bce5b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:26.541508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeebac-93b4-41ae-a8f1-38e8bce5b378 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:26.541789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeebac-93b4-41ae-a8f1-38e8bce5b378 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:26.542059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeebac-93b4-41ae-a8f1-38e8bce5b378 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:26.542758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeebac-93b4-41ae-a8f1-38e8bce5b378 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:26.543062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeebac-93b4-41ae-a8f1-38e8bce5b378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:26.544480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeebac-93b4-41ae-a8f1-38e8bce5b378 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:26.553615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 105/196] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:26.553615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeebac-93b4-41ae-a8f1-38e8bce5b378 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:26.562841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:26.640151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16590fa0-7e40-4b1e-a455-eacd2ca16541 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:26.653802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeebac-93b4-41ae-a8f1-38e8bce5b378 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:26.669064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:26.675597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5934f-35c7-453f-9df8-033b8b22e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:26.676226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5934f-35c7-453f-9df8-033b8b22e4f4 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:26.676502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5934f-35c7-453f-9df8-033b8b22e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:26.676774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5934f-35c7-453f-9df8-033b8b22e4f4 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:26.677423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5934f-35c7-453f-9df8-033b8b22e4f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:26.678916 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5934f-35c7-453f-9df8-033b8b22e4f4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:26.690903 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5cd5e-ecb9-42f5-8d59-249b2e36240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:26.691485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5cd5e-ecb9-42f5-8d59-249b2e36240f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:26.691766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5cd5e-ecb9-42f5-8d59-249b2e36240f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:26.692047 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5cd5e-ecb9-42f5-8d59-249b2e36240f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:26.700291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 92/197] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:14:26 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:14:26.700291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5934f-35c7-453f-9df8-033b8b22e4f4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:26.777546 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5cd5e-ecb9-42f5-8d59-249b2e36240f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:26.779367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5cd5e-ecb9-42f5-8d59-249b2e36240f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:26.788640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:26.819738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5934f-35c7-453f-9df8-033b8b22e4f4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:26.859013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d2aed-8156-4559-b055-bf0f23096b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:26.859646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d2aed-8156-4559-b055-bf0f23096b3b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:26.859926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d2aed-8156-4559-b055-bf0f23096b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:26.860200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d2aed-8156-4559-b055-bf0f23096b3b None admin] PATH_INFO: `/v3/users/a11b9a6d49c14c5f81a742b87cb3b3d6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:26.861391 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d2aed-8156-4559-b055-bf0f23096b3b None admin] RBAC: Authorizing `identity:get_user(user_id=a11b9a6d49c14c5f81a742b87cb3b3d6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:26.862936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d2aed-8156-4559-b055-bf0f23096b3b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:26.869579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 93/198] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:26 2022] GET /identity/v3/users/a11b9a6d49c14c5f81a742b87cb3b3d6 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:26.869579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d2aed-8156-4559-b055-bf0f23096b3b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:26.904203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 106/199] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:26.904919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5cd5e-ecb9-42f5-8d59-249b2e36240f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:26.944573 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:27.005675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d2aed-8156-4559-b055-bf0f23096b3b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:27.041288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5cd5e-ecb9-42f5-8d59-249b2e36240f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:27.052634 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:27.055353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a92a9-6ede-4b9d-874e-cde6b7f872ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:27.055619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a92a9-6ede-4b9d-874e-cde6b7f872ef None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:27.056486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a92a9-6ede-4b9d-874e-cde6b7f872ef None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:27.056762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a92a9-6ede-4b9d-874e-cde6b7f872ef None admin] PATH_INFO: `/v3/users/e817d0f626ae43e3a868b12b41537951` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:27.057932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a92a9-6ede-4b9d-874e-cde6b7f872ef None admin] RBAC: Authorizing `identity:get_user(user_id=e817d0f626ae43e3a868b12b41537951)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:27.060118 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a92a9-6ede-4b9d-874e-cde6b7f872ef None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:27.061720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 94/200] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:26 2022] GET /identity/v3/users/e817d0f626ae43e3a868b12b41537951 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:27.065252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a92a9-6ede-4b9d-874e-cde6b7f872ef None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:27.105602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0133f-3739-41d3-a822-d791fdfa8863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:27.106237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0133f-3739-41d3-a822-d791fdfa8863 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:27.106549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0133f-3739-41d3-a822-d791fdfa8863 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:27.106825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0133f-3739-41d3-a822-d791fdfa8863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:27.188954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a92a9-6ede-4b9d-874e-cde6b7f872ef None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:27.214647 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0133f-3739-41d3-a822-d791fdfa8863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:27.216082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0133f-3739-41d3-a822-d791fdfa8863 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:27.222685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:27.238646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ac207-185e-4fca-af53-5eb8dd72cacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:27.239308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ac207-185e-4fca-af53-5eb8dd72cacd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:27.239589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ac207-185e-4fca-af53-5eb8dd72cacd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:27.239869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ac207-185e-4fca-af53-5eb8dd72cacd None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:27.241540 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ac207-185e-4fca-af53-5eb8dd72cacd None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:27.243628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ac207-185e-4fca-af53-5eb8dd72cacd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:27.245411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 95/201] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:27 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:27.253083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ac207-185e-4fca-af53-5eb8dd72cacd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:27.367099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 107/202] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:27.372035 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ac207-185e-4fca-af53-5eb8dd72cacd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:27.373332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0133f-3739-41d3-a822-d791fdfa8863 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:27.390599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:27.418575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb579f-ce73-4663-bd66-67da9fb581d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:27.419076 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb579f-ce73-4663-bd66-67da9fb581d3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:27.419364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb579f-ce73-4663-bd66-67da9fb581d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:27.419729 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb579f-ce73-4663-bd66-67da9fb581d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:27.497598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:27.509637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0133f-3739-41d3-a822-d791fdfa8863 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:27.513451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb579f-ce73-4663-bd66-67da9fb581d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:27.515064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb579f-ce73-4663-bd66-67da9fb581d3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:27.552850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd26573-8bb7-47df-aa3b-53d6a0a27c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:27.553731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd26573-8bb7-47df-aa3b-53d6a0a27c06 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:27.554176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd26573-8bb7-47df-aa3b-53d6a0a27c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:27.554615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd26573-8bb7-47df-aa3b-53d6a0a27c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:27.555502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd26573-8bb7-47df-aa3b-53d6a0a27c06 None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23, user.id=a11b9a6d49c14c5f81a742b87cb3b3d6) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:27.555938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd26573-8bb7-47df-aa3b-53d6a0a27c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:27.557516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd26573-8bb7-47df-aa3b-53d6a0a27c06 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:27.564211 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 108/203] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:27 2022] GET /identity/v3/role_assignments?user.id=a11b9a6d49c14c5f81a742b87cb3b3d6&scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23&role.id=6413aac4240a46ba816472c29e305973 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:27.566407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd26573-8bb7-47df-aa3b-53d6a0a27c06 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:27.660117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:27.704111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd26573-8bb7-47df-aa3b-53d6a0a27c06 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:27.726418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 96/204] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:27.738536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb579f-ce73-4663-bd66-67da9fb581d3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:27.759812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db5ac5-4154-443e-8527-9197e05bc2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:27.761153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db5ac5-4154-443e-8527-9197e05bc2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:27.761943 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db5ac5-4154-443e-8527-9197e05bc2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:27.762862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db5ac5-4154-443e-8527-9197e05bc2f4 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:27.770048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db5ac5-4154-443e-8527-9197e05bc2f4 None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:27.772041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db5ac5-4154-443e-8527-9197e05bc2f4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:27.777494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 109/205] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:27 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:27.791053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db5ac5-4154-443e-8527-9197e05bc2f4 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:27.937004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:27.954195 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb579f-ce73-4663-bd66-67da9fb581d3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:27.968420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db5ac5-4154-443e-8527-9197e05bc2f4 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:28.028269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec384f2-915f-415f-bd66-8aba26508b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:28.029160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70fd2e-0b95-4e64-9caa-30d7a6c9ed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:28.030015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec384f2-915f-415f-bd66-8aba26508b10 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:28.030894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70fd2e-0b95-4e64-9caa-30d7a6c9ed0e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:28.031350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec384f2-915f-415f-bd66-8aba26508b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:28.031809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70fd2e-0b95-4e64-9caa-30d7a6c9ed0e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:28.032250 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec384f2-915f-415f-bd66-8aba26508b10 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:28.032696 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70fd2e-0b95-4e64-9caa-30d7a6c9ed0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:28.034799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70fd2e-0b95-4e64-9caa-30d7a6c9ed0e None admin] RBAC: Adding query filter params (role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a, scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23, user.id=a11b9a6d49c14c5f81a742b87cb3b3d6) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:28.035323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70fd2e-0b95-4e64-9caa-30d7a6c9ed0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:28.036105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec384f2-915f-415f-bd66-8aba26508b10 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:28.037752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70fd2e-0b95-4e64-9caa-30d7a6c9ed0e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:28.039387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec384f2-915f-415f-bd66-8aba26508b10 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:28.043383 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 97/206] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:27 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:28.051057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec384f2-915f-415f-bd66-8aba26508b10 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:28.055862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 110/207] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:27 2022] GET /identity/v3/role_assignments?user.id=a11b9a6d49c14c5f81a742b87cb3b3d6&scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23&role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:28.186662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec384f2-915f-415f-bd66-8aba26508b10 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:28.237883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7b38-9351-4676-8802-9c1b3d78c6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:28.238898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7b38-9351-4676-8802-9c1b3d78c6fd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:28.239355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7b38-9351-4676-8802-9c1b3d78c6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:28.239799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7b38-9351-4676-8802-9c1b3d78c6fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:28.240709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc7b38-9351-4676-8802-9c1b3d78c6fd None admin] RBAC: Adding query filter params (role.id=cca59383436e4294a41556fbdf237853, scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8, user.id=e817d0f626ae43e3a868b12b41537951) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:28.241208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc7b38-9351-4676-8802-9c1b3d78c6fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:28.242964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc7b38-9351-4676-8802-9c1b3d78c6fd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:28.253138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 98/208] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:28 2022] GET /identity/v3/role_assignments?user.id=e817d0f626ae43e3a868b12b41537951&scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8&role.id=cca59383436e4294a41556fbdf237853 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:29.292962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007028f-930d-4b9e-8584-af68e19e2cb1 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:29.293477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007028f-930d-4b9e-8584-af68e19e2cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:29.293477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007028f-930d-4b9e-8584-af68e19e2cb1 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:29.295034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 111/209] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:29.300941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8ab04-dc14-4ecd-99db-b5e11283b90d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:29.301352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8ab04-dc14-4ecd-99db-b5e11283b90d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:29.301526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8ab04-dc14-4ecd-99db-b5e11283b90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:29.319375 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f1dfc-21eb-4400-b436-dc4809d19fdc None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:29.320019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f1dfc-21eb-4400-b436-dc4809d19fdc None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:29.320497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f1dfc-21eb-4400-b436-dc4809d19fdc None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:29.320616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f8b8ab04-dc14-4ecd-99db-b5e11283b90d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:29.321746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f8b8ab04-dc14-4ecd-99db-b5e11283b90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:29.322715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 112/210] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:14:29.327921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0c7d4-7dc2-42d6-9077-eb8d8a85d0fc None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:29.328450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0c7d4-7dc2-42d6-9077-eb8d8a85d0fc None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:29.328919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0c7d4-7dc2-42d6-9077-eb8d8a85d0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:29.336254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:29.340897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:29.354195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-bbe0c7d4-7dc2-42d6-9077-eb8d8a85d0fc None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:29.355855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bbe0c7d4-7dc2-42d6-9077-eb8d8a85d0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:29.403643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 99/211] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:29.445479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 113/212] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:14:29.694543 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8ab04-dc14-4ecd-99db-b5e11283b90d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:29.720003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0c7d4-7dc2-42d6-9077-eb8d8a85d0fc None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:29.824429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8ab04-dc14-4ecd-99db-b5e11283b90d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:29.844756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0c7d4-7dc2-42d6-9077-eb8d8a85d0fc None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:29.871261 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0991ef-fedd-466b-ad73-150be9147d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:29.872533 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0991ef-fedd-466b-ad73-150be9147d45 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:29.873282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0991ef-fedd-466b-ad73-150be9147d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:29.873769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0991ef-fedd-466b-ad73-150be9147d45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:29.880897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:29.888074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f08b4e-7328-4954-b0b9-f2d2032a5937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:29.888788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f08b4e-7328-4954-b0b9-f2d2032a5937 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:29.889138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f08b4e-7328-4954-b0b9-f2d2032a5937 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:29.889477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f08b4e-7328-4954-b0b9-f2d2032a5937 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:29.890818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0991ef-fedd-466b-ad73-150be9147d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:29.890927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f08b4e-7328-4954-b0b9-f2d2032a5937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:29.892524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f08b4e-7328-4954-b0b9-f2d2032a5937 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:29.895352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 114/213] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-af0991ef-fedd-466b-ad73-150be9147d45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:29.897567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:29.898429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:29.899524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:29.899524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:29.899524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:29.899524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:29.899524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:29.899524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:29.899524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:29.899524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:29.899524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:29.899524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:29.899524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:29.899524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:29.901045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f08b4e-7328-4954-b0b9-f2d2032a5937 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:29.902004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 100/214] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:29.910185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0991ef-fedd-466b-ad73-150be9147d45 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:29.929778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:30.027845 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f08b4e-7328-4954-b0b9-f2d2032a5937 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:30.046771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0991ef-fedd-466b-ad73-150be9147d45 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:30.072434 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba1de5-3d72-463a-b89c-46001ec5df2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:30.073227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba1de5-3d72-463a-b89c-46001ec5df2f None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:30.073602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba1de5-3d72-463a-b89c-46001ec5df2f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:30.074000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba1de5-3d72-463a-b89c-46001ec5df2f None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:30.074809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba1de5-3d72-463a-b89c-46001ec5df2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:30.076420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba1de5-3d72-463a-b89c-46001ec5df2f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:30.092556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa000a-8e07-4823-859c-af26ac191e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:30.093434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa000a-8e07-4823-859c-af26ac191e72 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:30.093857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa000a-8e07-4823-859c-af26ac191e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:30.094268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa000a-8e07-4823-859c-af26ac191e72 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:30.095141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa000a-8e07-4823-859c-af26ac191e72 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:30.095615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa000a-8e07-4823-859c-af26ac191e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:30.097223 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa000a-8e07-4823-859c-af26ac191e72 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:30.109292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 101/215] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:30.116205 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa000a-8e07-4823-859c-af26ac191e72 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:30.117332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 115/216] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:14:29 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:14:30.194249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795fd4d-91a1-45fb-808d-5a929d3e177a None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:30.194584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795fd4d-91a1-45fb-808d-5a929d3e177a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:30.194846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795fd4d-91a1-45fb-808d-5a929d3e177a None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:30.196456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 116/217] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:14:30.203204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a9f2d-9d84-42b1-b344-6bfece6030d3 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:30.203811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a9f2d-9d84-42b1-b344-6bfece6030d3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:30.204383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a9f2d-9d84-42b1-b344-6bfece6030d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:30.217507 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:30.227251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cb6a9f2d-9d84-42b1-b344-6bfece6030d3 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:30.228886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cb6a9f2d-9d84-42b1-b344-6bfece6030d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:30.253072 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa000a-8e07-4823-859c-af26ac191e72 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:30.307597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:30.310230 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731c86b-c10c-4e55-81f5-c8ab36dd3dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:30.312113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731c86b-c10c-4e55-81f5-c8ab36dd3dfc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:30.312387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731c86b-c10c-4e55-81f5-c8ab36dd3dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:30.312660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731c86b-c10c-4e55-81f5-c8ab36dd3dfc None admin] PATH_INFO: `/v3/users/59d17768d0874be69280b70fc761b31a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:30.334469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 117/218] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:30.334660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731c86b-c10c-4e55-81f5-c8ab36dd3dfc None admin] RBAC: Authorizing `identity:get_user(user_id=59d17768d0874be69280b70fc761b31a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:30.335459 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731c86b-c10c-4e55-81f5-c8ab36dd3dfc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:30.337254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 102/219] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:30 2022] GET /identity/v3/users/59d17768d0874be69280b70fc761b31a => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:30.342721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a9f2d-9d84-42b1-b344-6bfece6030d3 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:30.394691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880a329-1a48-4588-8b12-0f4f5613cccc None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:30.394973 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880a329-1a48-4588-8b12-0f4f5613cccc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:30.395575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880a329-1a48-4588-8b12-0f4f5613cccc None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:30.396844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 103/220] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:30.401802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9187b-6572-4c16-acd0-82f5c1b38ee4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:30.402066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9187b-6572-4c16-acd0-82f5c1b38ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:30.402341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9187b-6572-4c16-acd0-82f5c1b38ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:30.425525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1be9187b-6572-4c16-acd0-82f5c1b38ee4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:30.426765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1be9187b-6572-4c16-acd0-82f5c1b38ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:30.465159 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a9f2d-9d84-42b1-b344-6bfece6030d3 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:30.505643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e79d74-90e5-4abb-a214-f6015a109944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:30.506317 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e79d74-90e5-4abb-a214-f6015a109944 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:30.506633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e79d74-90e5-4abb-a214-f6015a109944 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:30.506907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e79d74-90e5-4abb-a214-f6015a109944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:30.520966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 104/221] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:30.566437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:30.584083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e79d74-90e5-4abb-a214-f6015a109944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:30.585640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e79d74-90e5-4abb-a214-f6015a109944 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:30.623617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9187b-6572-4c16-acd0-82f5c1b38ee4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:30.711190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 118/222] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:14:30.717449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e79d74-90e5-4abb-a214-f6015a109944 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:30.719552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:30.782899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9187b-6572-4c16-acd0-82f5c1b38ee4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:30.842239 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:30.847165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9feb8c-a437-4f3f-a4df-a00ccdba333f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:30.848706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9feb8c-a437-4f3f-a4df-a00ccdba333f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:30.848994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9feb8c-a437-4f3f-a4df-a00ccdba333f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:30.849269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9feb8c-a437-4f3f-a4df-a00ccdba333f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:30.866164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e79d74-90e5-4abb-a214-f6015a109944 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:30.866985 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9feb8c-a437-4f3f-a4df-a00ccdba333f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bd9feb8c-a437-4f3f-a4df-a00ccdba333f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:30.873235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:30.874105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:30.874955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 105/223] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:14:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:14:30.875584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9feb8c-a437-4f3f-a4df-a00ccdba333f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:30.910657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af113c6-0c30-4cf1-b402-626e93a35b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:30.911309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af113c6-0c30-4cf1-b402-626e93a35b4c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:30.911586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af113c6-0c30-4cf1-b402-626e93a35b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:30.911856 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af113c6-0c30-4cf1-b402-626e93a35b4c None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:30.913004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af113c6-0c30-4cf1-b402-626e93a35b4c None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:30.914485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af113c6-0c30-4cf1-b402-626e93a35b4c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:30.916555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 119/224] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:30 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:30.917142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af113c6-0c30-4cf1-b402-626e93a35b4c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:30.993060 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9feb8c-a437-4f3f-a4df-a00ccdba333f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:31.019263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:31.024522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af113c6-0c30-4cf1-b402-626e93a35b4c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:31.032600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806b0df-4817-43a4-b8a7-dbd364c45ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:31.033969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b0df-4817-43a4-b8a7-dbd364c45ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:31.034414 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b0df-4817-43a4-b8a7-dbd364c45ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:31.034825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b0df-4817-43a4-b8a7-dbd364c45ac6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:31.046333 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806b0df-4817-43a4-b8a7-dbd364c45ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c806b0df-4817-43a4-b8a7-dbd364c45ac6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:31.051511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:31.052588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:31.053534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:31.053534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:31.053534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:31.053534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:31.053534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:31.053534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:31.053534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:31.053534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:31.053534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:31.053534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:31.053534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:31.053534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:31.055332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 106/225] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:14:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:31.057362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806b0df-4817-43a4-b8a7-dbd364c45ac6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:31.062071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa888152-60cf-49f3-adc2-6b98fb8078e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:31.062712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa888152-60cf-49f3-adc2-6b98fb8078e0 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:31.062990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa888152-60cf-49f3-adc2-6b98fb8078e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:31.063259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa888152-60cf-49f3-adc2-6b98fb8078e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:31.063927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa888152-60cf-49f3-adc2-6b98fb8078e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:31.064234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa888152-60cf-49f3-adc2-6b98fb8078e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:31.066390 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa888152-60cf-49f3-adc2-6b98fb8078e0 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:31.076953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 120/226] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:31.077775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa888152-60cf-49f3-adc2-6b98fb8078e0 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:31.098078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:31.199998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa888152-60cf-49f3-adc2-6b98fb8078e0 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:31.201420 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806b0df-4817-43a4-b8a7-dbd364c45ac6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:31.238792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a9226-beca-4013-a452-a2ce7285b2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:31.239411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a9226-beca-4013-a452-a2ce7285b2bb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:31.239690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a9226-beca-4013-a452-a2ce7285b2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:31.239961 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a9226-beca-4013-a452-a2ce7285b2bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:31.240677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a9226-beca-4013-a452-a2ce7285b2bb None admin] RBAC: Adding query filter params (role.id=c6ff6f013f2f41d78fedabbe698ed13e, scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23, user.id=59d17768d0874be69280b70fc761b31a) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:31.240980 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a9226-beca-4013-a452-a2ce7285b2bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:31.242576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a9226-beca-4013-a452-a2ce7285b2bb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:31.245146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aa44b-4d46-44b5-b2c1-e2dbab3aaa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:31.246492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aa44b-4d46-44b5-b2c1-e2dbab3aaa9f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:31.247261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aa44b-4d46-44b5-b2c1-e2dbab3aaa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:31.247698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aa44b-4d46-44b5-b2c1-e2dbab3aaa9f None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:31.248524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aa44b-4d46-44b5-b2c1-e2dbab3aaa9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:31.248636 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 107/227] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:31 2022] GET /identity/v3/role_assignments?user.id=59d17768d0874be69280b70fc761b31a&scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23&role.id=c6ff6f013f2f41d78fedabbe698ed13e => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:31.254717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a9226-beca-4013-a452-a2ce7285b2bb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:31.256256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aa44b-4d46-44b5-b2c1-e2dbab3aaa9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:31.257356 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aa44b-4d46-44b5-b2c1-e2dbab3aaa9f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:31.277023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 121/228] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:14:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:31.282797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aa44b-4d46-44b5-b2c1-e2dbab3aaa9f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:31.345023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:31.420390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a9226-beca-4013-a452-a2ce7285b2bb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:31.464203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110fbb0-bd10-482d-92c9-f4cb313aa6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:31.465457 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110fbb0-bd10-482d-92c9-f4cb313aa6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:31.465940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110fbb0-bd10-482d-92c9-f4cb313aa6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:31.466442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110fbb0-bd10-482d-92c9-f4cb313aa6e4 None admin] PATH_INFO: `/v3/users/a11b9a6d49c14c5f81a742b87cb3b3d6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:31.467899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110fbb0-bd10-482d-92c9-f4cb313aa6e4 None admin] RBAC: Authorizing `identity:get_user(user_id=a11b9a6d49c14c5f81a742b87cb3b3d6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:31.470644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110fbb0-bd10-482d-92c9-f4cb313aa6e4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:31.472906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 108/229] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:31 2022] GET /identity/v3/users/a11b9a6d49c14c5f81a742b87cb3b3d6 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:31.479138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110fbb0-bd10-482d-92c9-f4cb313aa6e4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:31.500420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:31.543827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aa44b-4d46-44b5-b2c1-e2dbab3aaa9f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:31.593948 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79199c42-2abb-4b8a-b22a-082e2a145425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:31.594625 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79199c42-2abb-4b8a-b22a-082e2a145425 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:31.594905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79199c42-2abb-4b8a-b22a-082e2a145425 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:31.595178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79199c42-2abb-4b8a-b22a-082e2a145425 None admin] PATH_INFO: `/v3/users/a11b9a6d49c14c5f81a742b87cb3b3d6` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:31.597337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79199c42-2abb-4b8a-b22a-082e2a145425 None admin] RBAC: Authorizing `identity:get_user(user_id=a11b9a6d49c14c5f81a742b87cb3b3d6)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:31.598911 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79199c42-2abb-4b8a-b22a-082e2a145425 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:31.600519 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 122/230] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:31 2022] GET /identity/v3/users/a11b9a6d49c14c5f81a742b87cb3b3d6 => generated 283 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:31.607007 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79199c42-2abb-4b8a-b22a-082e2a145425 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:31.622615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110fbb0-bd10-482d-92c9-f4cb313aa6e4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:31.647842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:31.685313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e760ee-2758-4be6-9582-d0bf9d77e970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:31.685956 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e760ee-2758-4be6-9582-d0bf9d77e970 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:31.686237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e760ee-2758-4be6-9582-d0bf9d77e970 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:31.686551 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e760ee-2758-4be6-9582-d0bf9d77e970 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:31.688418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e760ee-2758-4be6-9582-d0bf9d77e970 None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:31.690456 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e760ee-2758-4be6-9582-d0bf9d77e970 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:31.692105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 109/231] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:31 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:31.699101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e760ee-2758-4be6-9582-d0bf9d77e970 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:31.792048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79199c42-2abb-4b8a-b22a-082e2a145425 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:31.856052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8228c-06ea-42d5-8f23-450797ec0320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:31.856750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8228c-06ea-42d5-8f23-450797ec0320 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:31.857039 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8228c-06ea-42d5-8f23-450797ec0320 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:31.857318 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8228c-06ea-42d5-8f23-450797ec0320 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:31.859528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8228c-06ea-42d5-8f23-450797ec0320 None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:31.861001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8228c-06ea-42d5-8f23-450797ec0320 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:31.863098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 123/232] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:31 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:31.869518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8228c-06ea-42d5-8f23-450797ec0320 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:31.876677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e760ee-2758-4be6-9582-d0bf9d77e970 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:31.899634 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:31.937688 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e87fca-3efc-492e-823e-b6751c5fe4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:31.938366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e87fca-3efc-492e-823e-b6751c5fe4b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:31.938674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e87fca-3efc-492e-823e-b6751c5fe4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:31.938948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e87fca-3efc-492e-823e-b6751c5fe4b1 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23/users/a11b9a6d49c14c5f81a742b87cb3b3d6/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:31.946300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e87fca-3efc-492e-823e-b6751c5fe4b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5f1cb41b1834dee86dc7f0ae7165f23, user_id=a11b9a6d49c14c5f81a742b87cb3b3d6, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:31.948074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e87fca-3efc-492e-823e-b6751c5fe4b1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:31.970445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 110/233] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:14:31 2022] PUT /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23/users/a11b9a6d49c14c5f81a742b87cb3b3d6/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:14:32.038505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8228c-06ea-42d5-8f23-450797ec0320 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:32.085549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322bfd2-71c4-4500-8397-0abfaa260fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:32.086217 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322bfd2-71c4-4500-8397-0abfaa260fb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:32.086540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322bfd2-71c4-4500-8397-0abfaa260fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:32.086851 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322bfd2-71c4-4500-8397-0abfaa260fb6 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23/users/a11b9a6d49c14c5f81a742b87cb3b3d6/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:32.089012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322bfd2-71c4-4500-8397-0abfaa260fb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5f1cb41b1834dee86dc7f0ae7165f23, user_id=a11b9a6d49c14c5f81a742b87cb3b3d6, role_id=ac7eb9c247e94edda4cd6ad66b5e6a9a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:32.090518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322bfd2-71c4-4500-8397-0abfaa260fb6 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:32.113431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 124/234] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:14:31 2022] PUT /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23/users/a11b9a6d49c14c5f81a742b87cb3b3d6/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:14:32.782743 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc71083-8c02-4587-8b4a-8665715d89a3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:32.783940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc71083-8c02-4587-8b4a-8665715d89a3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:32.783940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc71083-8c02-4587-8b4a-8665715d89a3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:32.785300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 111/235] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:32.791724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bda151-dd97-494f-bea1-04027f142675 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:32.792263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bda151-dd97-494f-bea1-04027f142675 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:32.792263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bda151-dd97-494f-bea1-04027f142675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:32.819500 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b3bda151-dd97-494f-bea1-04027f142675 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:32.820716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b3bda151-dd97-494f-bea1-04027f142675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:32.897766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192246f-65c4-41dd-b771-1d525b1b8c72 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:32.898117 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192246f-65c4-41dd-b771-1d525b1b8c72 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:32.898316 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192246f-65c4-41dd-b771-1d525b1b8c72 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:32.899684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 112/236] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:32.912237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c5661-f6a9-4b9e-8606-bdef6f6ac922 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:32.912515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c5661-f6a9-4b9e-8606-bdef6f6ac922 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:32.912777 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c5661-f6a9-4b9e-8606-bdef6f6ac922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:32.916896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 125/237] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:32.932249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-757c5661-f6a9-4b9e-8606-bdef6f6ac922 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:32.933430 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-757c5661-f6a9-4b9e-8606-bdef6f6ac922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:32.979610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:33.021211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 113/238] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:14:33.284183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bda151-dd97-494f-bea1-04027f142675 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:33.287415 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:33.424624 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bda151-dd97-494f-bea1-04027f142675 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:33.468271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31996509-d9e7-4f49-ae50-a65bc51e0bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:33.468908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996509-d9e7-4f49-ae50-a65bc51e0bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:33.469186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996509-d9e7-4f49-ae50-a65bc51e0bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:33.469457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996509-d9e7-4f49-ae50-a65bc51e0bf2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:33.487228 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31996509-d9e7-4f49-ae50-a65bc51e0bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-31996509-d9e7-4f49-ae50-a65bc51e0bf2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:33.492129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:33.492976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:33.493749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 126/239] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:33.499114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c5661-f6a9-4b9e-8606-bdef6f6ac922 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:33.567306 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31996509-d9e7-4f49-ae50-a65bc51e0bf2 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:33.642208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c5661-f6a9-4b9e-8606-bdef6f6ac922 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:33.703970 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:33.712789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4627574-4dd0-4c0f-9d66-2dc08e9e9946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:33.713412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4627574-4dd0-4c0f-9d66-2dc08e9e9946 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:33.713689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4627574-4dd0-4c0f-9d66-2dc08e9e9946 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:33.713960 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4627574-4dd0-4c0f-9d66-2dc08e9e9946 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:33.714666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4627574-4dd0-4c0f-9d66-2dc08e9e9946 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:33.714969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4627574-4dd0-4c0f-9d66-2dc08e9e9946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:33.716376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4627574-4dd0-4c0f-9d66-2dc08e9e9946 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:33.733712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 114/240] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:33.739318 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4627574-4dd0-4c0f-9d66-2dc08e9e9946 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:33.774888 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31996509-d9e7-4f49-ae50-a65bc51e0bf2 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:33.802124 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:33.841979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21199156-cdf4-49f2-85aa-bf6c0a237ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:33.842638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21199156-cdf4-49f2-85aa-bf6c0a237ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:33.842836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21199156-cdf4-49f2-85aa-bf6c0a237ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:33.843105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21199156-cdf4-49f2-85aa-bf6c0a237ba5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:33.846560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21199156-cdf4-49f2-85aa-bf6c0a237ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:33.848173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21199156-cdf4-49f2-85aa-bf6c0a237ba5 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:33.849874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 127/241] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:33.855492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21199156-cdf4-49f2-85aa-bf6c0a237ba5 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:33.948539 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4627574-4dd0-4c0f-9d66-2dc08e9e9946 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:33.987988 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21199156-cdf4-49f2-85aa-bf6c0a237ba5 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:34.014483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01035e5a-c083-412d-97c4-46b76f6d4d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:34.015376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01035e5a-c083-412d-97c4-46b76f6d4d3d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.015664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01035e5a-c083-412d-97c4-46b76f6d4d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.016384 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01035e5a-c083-412d-97c4-46b76f6d4d3d None admin] PATH_INFO: `/v3/users/36d35d5f3993417ba6a222bfcd543088` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.020067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:34.026996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9acd7c-4f52-4a51-9959-66fc7c174096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:34.027776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9acd7c-4f52-4a51-9959-66fc7c174096 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.028221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9acd7c-4f52-4a51-9959-66fc7c174096 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.028647 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9acd7c-4f52-4a51-9959-66fc7c174096 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.029444 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9acd7c-4f52-4a51-9959-66fc7c174096 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:34.031209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9acd7c-4f52-4a51-9959-66fc7c174096 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:34.034684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01035e5a-c083-412d-97c4-46b76f6d4d3d None admin] RBAC: Authorizing `identity:get_user(user_id=36d35d5f3993417ba6a222bfcd543088)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:34.036261 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01035e5a-c083-412d-97c4-46b76f6d4d3d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:34.038204 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 115/242] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:33 2022] GET /identity/v3/users/36d35d5f3993417ba6a222bfcd543088 => generated 297 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:34.043856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecde30-e1f2-4f70-a29e-ac8f756e0ae2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.043856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecde30-e1f2-4f70-a29e-ac8f756e0ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.043856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecde30-e1f2-4f70-a29e-ac8f756e0ae2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.043856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 116/243] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:34.045982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecde30-e1f2-4f70-a29e-ac8f756e0ae2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:34.063623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 128/244] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:14:33 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:14:34.065862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497f794-1863-4518-803e-0308b8db707c None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.066684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497f794-1863-4518-803e-0308b8db707c None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.067197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497f794-1863-4518-803e-0308b8db707c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.088514 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-a497f794-1863-4518-803e-0308b8db707c None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:34.090044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a497f794-1863-4518-803e-0308b8db707c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:34.224241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 129/245] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:34.230018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:34.242131 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecde30-e1f2-4f70-a29e-ac8f756e0ae2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:34.280441 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b3b5a-3607-4115-93da-becd5b14027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:34.281053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b3b5a-3607-4115-93da-becd5b14027d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.281335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b3b5a-3607-4115-93da-becd5b14027d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.281600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b3b5a-3607-4115-93da-becd5b14027d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.363071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b3b5a-3607-4115-93da-becd5b14027d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:34.364741 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b3b5a-3607-4115-93da-becd5b14027d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:34.461889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:34.473570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 117/246] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:34.479543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497f794-1863-4518-803e-0308b8db707c None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:34.571051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b3b5a-3607-4115-93da-becd5b14027d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:34.599726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497f794-1863-4518-803e-0308b8db707c None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:34.620857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:34.644431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7429b37-1154-4efc-a705-d69cab804378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:34.645095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7429b37-1154-4efc-a705-d69cab804378 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.645374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7429b37-1154-4efc-a705-d69cab804378 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.645648 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7429b37-1154-4efc-a705-d69cab804378 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.646895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7429b37-1154-4efc-a705-d69cab804378 None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:34.648389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7429b37-1154-4efc-a705-d69cab804378 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:34.653121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 130/247] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:34 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:34.658571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7429b37-1154-4efc-a705-d69cab804378 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:34.697740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b3b5a-3607-4115-93da-becd5b14027d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:34.740037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d637803-248e-4f23-abcc-cd2a196667a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:34.740699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d637803-248e-4f23-abcc-cd2a196667a0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.740984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d637803-248e-4f23-abcc-cd2a196667a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.741253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d637803-248e-4f23-abcc-cd2a196667a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.754325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d637803-248e-4f23-abcc-cd2a196667a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2d637803-248e-4f23-abcc-cd2a196667a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:34.759634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:34.760582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:34.761354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:34.761354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:34.761354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:34.761354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:34.761354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:34.761354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:34.761354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:34.761354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:34.761354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:34.761354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:34.761354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:34.761354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:34.765984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 118/248] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:14:34.767462 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d637803-248e-4f23-abcc-cd2a196667a0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:34.775126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7429b37-1154-4efc-a705-d69cab804378 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:34.814087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd9c1e-f72b-4091-9775-2fe8a0513215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:34.815258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd9c1e-f72b-4091-9775-2fe8a0513215 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.815532 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd9c1e-f72b-4091-9775-2fe8a0513215 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.815960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd9c1e-f72b-4091-9775-2fe8a0513215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.816701 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd9c1e-f72b-4091-9775-2fe8a0513215 None admin] RBAC: Adding query filter params (role.id=cca59383436e4294a41556fbdf237853, scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23, user.id=36d35d5f3993417ba6a222bfcd543088) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:34.817004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd9c1e-f72b-4091-9775-2fe8a0513215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:34.818496 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd9c1e-f72b-4091-9775-2fe8a0513215 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:34.824246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 131/249] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:34 2022] GET /identity/v3/role_assignments?user.id=36d35d5f3993417ba6a222bfcd543088&scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23&role.id=cca59383436e4294a41556fbdf237853 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:34.825460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aaa1e-fd84-4777-8e0f-dbdc76cf1840 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.825738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aaa1e-fd84-4777-8e0f-dbdc76cf1840 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.826014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aaa1e-fd84-4777-8e0f-dbdc76cf1840 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.827242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 132/250] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:34.833161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77e79f-386d-42dd-aa5e-21e48951e9ab None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.833436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77e79f-386d-42dd-aa5e-21e48951e9ab None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.833660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:34.834092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77e79f-386d-42dd-aa5e-21e48951e9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.855266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-de77e79f-386d-42dd-aa5e-21e48951e9ab None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:34.856511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-de77e79f-386d-42dd-aa5e-21e48951e9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:34.894767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d637803-248e-4f23-abcc-cd2a196667a0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:34.909187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:34.937531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 133/251] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:14:34.941490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e290b-66a8-4725-8544-833e197a3b44 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.941490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e290b-66a8-4725-8544-833e197a3b44 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.941490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e290b-66a8-4725-8544-833e197a3b44 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.941843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 134/252] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:34.947728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74986a-5c3c-4a55-b36a-29e7b3cd2164 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.948150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74986a-5c3c-4a55-b36a-29e7b3cd2164 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.948546 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74986a-5c3c-4a55-b36a-29e7b3cd2164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.951140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d1e57-646e-490a-8065-e7be5b2a99b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:34.952147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d1e57-646e-490a-8065-e7be5b2a99b0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:34.952637 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d1e57-646e-490a-8065-e7be5b2a99b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:34.953049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d1e57-646e-490a-8065-e7be5b2a99b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:34.954017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d1e57-646e-490a-8065-e7be5b2a99b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:34.954514 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d1e57-646e-490a-8065-e7be5b2a99b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:34.957873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d1e57-646e-490a-8065-e7be5b2a99b0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:34.973376 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-bb74986a-5c3c-4a55-b36a-29e7b3cd2164 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:34.975138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bb74986a-5c3c-4a55-b36a-29e7b3cd2164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:34.977710 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 119/253] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:34.987522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d1e57-646e-490a-8065-e7be5b2a99b0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:35.133852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 135/254] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:35.164509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d1e57-646e-490a-8065-e7be5b2a99b0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:35.183443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:35.214786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039232e1-628d-4394-90bc-2b9c549e2094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:35.215434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039232e1-628d-4394-90bc-2b9c549e2094 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:35.215718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039232e1-628d-4394-90bc-2b9c549e2094 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:35.215995 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039232e1-628d-4394-90bc-2b9c549e2094 None admin] PATH_INFO: `/v3/users/59d17768d0874be69280b70fc761b31a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:35.217150 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039232e1-628d-4394-90bc-2b9c549e2094 None admin] RBAC: Authorizing `identity:get_user(user_id=59d17768d0874be69280b70fc761b31a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:35.218638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039232e1-628d-4394-90bc-2b9c549e2094 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:35.220225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 120/255] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:34 2022] GET /identity/v3/users/59d17768d0874be69280b70fc761b31a => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:35.225983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74986a-5c3c-4a55-b36a-29e7b3cd2164 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:35.349613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74986a-5c3c-4a55-b36a-29e7b3cd2164 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:35.365374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:35.404528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039232e1-628d-4394-90bc-2b9c549e2094 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:35.424230 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8786d9e-fa36-4c1c-9eba-7b6f152a152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:35.425605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8786d9e-fa36-4c1c-9eba-7b6f152a152d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:35.425893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8786d9e-fa36-4c1c-9eba-7b6f152a152d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:35.426166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8786d9e-fa36-4c1c-9eba-7b6f152a152d None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:35.431091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8786d9e-fa36-4c1c-9eba-7b6f152a152d None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:35.433126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8786d9e-fa36-4c1c-9eba-7b6f152a152d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:35.434904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 136/256] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:35 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:35.441073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8786d9e-fa36-4c1c-9eba-7b6f152a152d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:35.589825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039232e1-628d-4394-90bc-2b9c549e2094 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:35.621225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8786d9e-fa36-4c1c-9eba-7b6f152a152d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:35.664541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892074c-1e1d-4d32-962f-8208e8493db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:35.665109 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892074c-1e1d-4d32-962f-8208e8493db0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:35.665390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892074c-1e1d-4d32-962f-8208e8493db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:35.665924 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892074c-1e1d-4d32-962f-8208e8493db0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:35.672396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9999a-b4b0-4a3a-b4c9-5b02c3f1777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:35.673069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9999a-b4b0-4a3a-b4c9-5b02c3f1777c None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:35.673348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9999a-b4b0-4a3a-b4c9-5b02c3f1777c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:35.673620 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9999a-b4b0-4a3a-b4c9-5b02c3f1777c None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23/users/59d17768d0874be69280b70fc761b31a/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:35.679346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9999a-b4b0-4a3a-b4c9-5b02c3f1777c None admin] RBAC: Authorizing `identity:create_grant(project_id=e5f1cb41b1834dee86dc7f0ae7165f23, user_id=59d17768d0874be69280b70fc761b31a, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:35.680806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9999a-b4b0-4a3a-b4c9-5b02c3f1777c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:35.691787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892074c-1e1d-4d32-962f-8208e8493db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d892074c-1e1d-4d32-962f-8208e8493db0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:35.698730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:35.699920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:35.701080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:35.701080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:35.701080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:35.701080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:35.701080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:35.701080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:35.701080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:35.701080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:35.701080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:35.701080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:35.701080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:35.701080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:35.708894 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 121/257] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:14:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:14:35.710108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892074c-1e1d-4d32-962f-8208e8493db0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:35.723387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 137/258] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:14:35 2022] PUT /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23/users/59d17768d0874be69280b70fc761b31a/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:14:35.725509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9999a-b4b0-4a3a-b4c9-5b02c3f1777c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:35.784386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:35.800343 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:35.892288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9999a-b4b0-4a3a-b4c9-5b02c3f1777c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:35.963676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892074c-1e1d-4d32-962f-8208e8493db0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:35.964183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb77ac-19d0-4a20-a136-6fc1f1bb6c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:35.964720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb77ac-19d0-4a20-a136-6fc1f1bb6c64 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:35.965001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb77ac-19d0-4a20-a136-6fc1f1bb6c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:35.965477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb77ac-19d0-4a20-a136-6fc1f1bb6c64 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:35.966151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb77ac-19d0-4a20-a136-6fc1f1bb6c64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:35.966476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb77ac-19d0-4a20-a136-6fc1f1bb6c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:35.967869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb77ac-19d0-4a20-a136-6fc1f1bb6c64 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:35.985674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 138/259] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:14:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:35.992677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb77ac-19d0-4a20-a136-6fc1f1bb6c64 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:36.053794 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2a6eb-67d5-40b1-8f1f-54c1126fd413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:36.054471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2a6eb-67d5-40b1-8f1f-54c1126fd413 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:36.054755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2a6eb-67d5-40b1-8f1f-54c1126fd413 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:36.055029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2a6eb-67d5-40b1-8f1f-54c1126fd413 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:36.079343 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2a6eb-67d5-40b1-8f1f-54c1126fd413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c1a2a6eb-67d5-40b1-8f1f-54c1126fd413 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:36.085734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:36.086652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:36.087444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:36.087444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:36.087444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:36.087444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:36.087444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:36.087444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:36.087444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:36.087444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:36.087444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:36.087444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:36.087444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:36.087444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:36.094177 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 122/260] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:14:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:36.100198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2a6eb-67d5-40b1-8f1f-54c1126fd413 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:36.154690 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:36.162873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb77ac-19d0-4a20-a136-6fc1f1bb6c64 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:36.221660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366d2dc-45fb-4b5b-8bf7-cdf55a4d6a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:36.222456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366d2dc-45fb-4b5b-8bf7-cdf55a4d6a4f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:36.223248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366d2dc-45fb-4b5b-8bf7-cdf55a4d6a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:36.223530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366d2dc-45fb-4b5b-8bf7-cdf55a4d6a4f None admin] PATH_INFO: `/v3/users/a11b9a6d49c14c5f81a742b87cb3b3d6` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:36.224845 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366d2dc-45fb-4b5b-8bf7-cdf55a4d6a4f None admin] RBAC: Authorizing `identity:get_user(user_id=a11b9a6d49c14c5f81a742b87cb3b3d6)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:36.226303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366d2dc-45fb-4b5b-8bf7-cdf55a4d6a4f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:36.228241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 139/261] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:35 2022] GET /identity/v3/users/a11b9a6d49c14c5f81a742b87cb3b3d6 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:36.233653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366d2dc-45fb-4b5b-8bf7-cdf55a4d6a4f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:36.324115 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2a6eb-67d5-40b1-8f1f-54c1126fd413 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:36.325857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:36.345259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366d2dc-45fb-4b5b-8bf7-cdf55a4d6a4f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:36.389825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe51cb-41c1-456c-be43-4d6004c74922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:36.390476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe51cb-41c1-456c-be43-4d6004c74922 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:36.390755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe51cb-41c1-456c-be43-4d6004c74922 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:36.391031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe51cb-41c1-456c-be43-4d6004c74922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:36.399622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc80097-135b-4dca-b523-e328f2aa99fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:36.400251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80097-135b-4dca-b523-e328f2aa99fc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:36.400634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80097-135b-4dca-b523-e328f2aa99fc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:36.400911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80097-135b-4dca-b523-e328f2aa99fc None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:36.401586 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc80097-135b-4dca-b523-e328f2aa99fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:36.401890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc80097-135b-4dca-b523-e328f2aa99fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:36.403423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc80097-135b-4dca-b523-e328f2aa99fc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:36.421051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 123/262] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:36.427226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc80097-135b-4dca-b523-e328f2aa99fc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:36.428482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:36.463752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe51cb-41c1-456c-be43-4d6004c74922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:36.465284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe51cb-41c1-456c-be43-4d6004c74922 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:36.566231 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 140/263] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:14:36.575438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe51cb-41c1-456c-be43-4d6004c74922 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:36.647453 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:36.679205 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe51cb-41c1-456c-be43-4d6004c74922 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:36.680259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc80097-135b-4dca-b523-e328f2aa99fc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:36.730276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfc023-93dd-413d-9c8c-6e46b450ce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:36.730943 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfc023-93dd-413d-9c8c-6e46b450ce39 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:36.731217 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfc023-93dd-413d-9c8c-6e46b450ce39 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:36.731482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfc023-93dd-413d-9c8c-6e46b450ce39 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:36.732597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfc023-93dd-413d-9c8c-6e46b450ce39 None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:36.734158 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfc023-93dd-413d-9c8c-6e46b450ce39 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:36.740275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 141/264] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:36 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:36.747553 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfc023-93dd-413d-9c8c-6e46b450ce39 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:36.766159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f03f0-317e-4004-a855-6afe7305c284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:36.766835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f03f0-317e-4004-a855-6afe7305c284 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:36.767111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f03f0-317e-4004-a855-6afe7305c284 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:36.767379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f03f0-317e-4004-a855-6afe7305c284 None admin] PATH_INFO: `/v3/users/a11b9a6d49c14c5f81a742b87cb3b3d6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:36.768850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f03f0-317e-4004-a855-6afe7305c284 None admin] RBAC: Authorizing `identity:get_user(user_id=a11b9a6d49c14c5f81a742b87cb3b3d6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:36.770313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f03f0-317e-4004-a855-6afe7305c284 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:36.772194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 124/265] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:36 2022] GET /identity/v3/users/a11b9a6d49c14c5f81a742b87cb3b3d6 => generated 283 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:36.781643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f03f0-317e-4004-a855-6afe7305c284 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:36.848917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:36.860657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfc023-93dd-413d-9c8c-6e46b450ce39 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:36.905556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013c1ac-43a4-4e8d-883b-8675048eae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:36.906455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013c1ac-43a4-4e8d-883b-8675048eae66 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:36.906735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013c1ac-43a4-4e8d-883b-8675048eae66 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:36.907009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013c1ac-43a4-4e8d-883b-8675048eae66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:36.907740 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013c1ac-43a4-4e8d-883b-8675048eae66 None admin] RBAC: Adding query filter params (role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a, scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23, user.id=a11b9a6d49c14c5f81a742b87cb3b3d6) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:36.908631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013c1ac-43a4-4e8d-883b-8675048eae66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:36.910301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013c1ac-43a4-4e8d-883b-8675048eae66 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:36.913676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:36.925053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 142/266] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:36 2022] GET /identity/v3/role_assignments?user.id=a11b9a6d49c14c5f81a742b87cb3b3d6&scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23&role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:36.997225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f03f0-317e-4004-a855-6afe7305c284 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:37.064014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983626d7-22df-457d-b654-c69f2a7718de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:37.065306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983626d7-22df-457d-b654-c69f2a7718de None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:37.065680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983626d7-22df-457d-b654-c69f2a7718de None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:37.066045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983626d7-22df-457d-b654-c69f2a7718de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:37.182274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983626d7-22df-457d-b654-c69f2a7718de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:37.183723 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983626d7-22df-457d-b654-c69f2a7718de None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:37.230034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:37.328625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 125/267] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:14:37.334425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013c1ac-43a4-4e8d-883b-8675048eae66 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:37.500880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013c1ac-43a4-4e8d-883b-8675048eae66 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:37.555991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95caec39-dacf-4130-9bd0-27cf3edaee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:37.556633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caec39-dacf-4130-9bd0-27cf3edaee31 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:37.556920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caec39-dacf-4130-9bd0-27cf3edaee31 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:37.557194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caec39-dacf-4130-9bd0-27cf3edaee31 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:37.563071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95caec39-dacf-4130-9bd0-27cf3edaee31 None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:37.564749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95caec39-dacf-4130-9bd0-27cf3edaee31 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:37.566754 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 143/268] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:37 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:37.572326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983626d7-22df-457d-b654-c69f2a7718de None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:37.728871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983626d7-22df-457d-b654-c69f2a7718de None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:37.770037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:37.775034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfb498-f4dd-42c9-8923-a7c2c0b16a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:37.775709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfb498-f4dd-42c9-8923-a7c2c0b16a3c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:37.775987 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfb498-f4dd-42c9-8923-a7c2c0b16a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:37.776348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfb498-f4dd-42c9-8923-a7c2c0b16a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:37.777014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfb498-f4dd-42c9-8923-a7c2c0b16a3c None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23, user.id=a11b9a6d49c14c5f81a742b87cb3b3d6) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:37.778120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfb498-f4dd-42c9-8923-a7c2c0b16a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:37.780018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfb498-f4dd-42c9-8923-a7c2c0b16a3c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:37.781677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aeff15-ff1a-4ca5-af4b-41b8bb09b9a2 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:37.782205 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aeff15-ff1a-4ca5-af4b-41b8bb09b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:37.782724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aeff15-ff1a-4ca5-af4b-41b8bb09b9a2 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:37.784993 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 144/269] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:37.788882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 126/270] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:37 2022] GET /identity/v3/role_assignments?user.id=a11b9a6d49c14c5f81a742b87cb3b3d6&scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23&role.id=6413aac4240a46ba816472c29e305973 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:37.793742 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db959bc3-4546-4598-84f3-ba1d08d6787a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:37.794024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db959bc3-4546-4598-84f3-ba1d08d6787a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:37.794303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db959bc3-4546-4598-84f3-ba1d08d6787a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:37.829615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-db959bc3-4546-4598-84f3-ba1d08d6787a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:37.830300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7590b-e051-4742-9a12-0359c5147b76 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:37.830844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7590b-e051-4742-9a12-0359c5147b76 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:37.831254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-db959bc3-4546-4598-84f3-ba1d08d6787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:37.831356 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7590b-e051-4742-9a12-0359c5147b76 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:37.832837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 127/271] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:37.848978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37004ba1-b987-44ee-a15b-4a23ed6b15f9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:37.849284 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37004ba1-b987-44ee-a15b-4a23ed6b15f9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:37.849514 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37004ba1-b987-44ee-a15b-4a23ed6b15f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:37.886820 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-37004ba1-b987-44ee-a15b-4a23ed6b15f9 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:37.888033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-37004ba1-b987-44ee-a15b-4a23ed6b15f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:37.912767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:37.915538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 145/272] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:37.999616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 128/273] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:14:38.065395 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9d636-4b2f-4334-9585-39163900f780 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:38.065684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9d636-4b2f-4334-9585-39163900f780 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:38.065866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9d636-4b2f-4334-9585-39163900f780 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:38.067219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 146/274] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:38.072405 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28ae66-85a1-4a9c-80e1-cbc67a2d4552 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:38.072692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28ae66-85a1-4a9c-80e1-cbc67a2d4552 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:38.072965 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28ae66-85a1-4a9c-80e1-cbc67a2d4552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:38.092474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0a28ae66-85a1-4a9c-80e1-cbc67a2d4552 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:38.093638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0a28ae66-85a1-4a9c-80e1-cbc67a2d4552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:38.162417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 129/275] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:38.223796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9d636-4b2f-4334-9585-39163900f780 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:38.321801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28ae66-85a1-4a9c-80e1-cbc67a2d4552 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:38.342296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9d636-4b2f-4334-9585-39163900f780 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:38.386764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48271a-dcb3-4487-b9ec-9cd5cada1f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:38.387420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48271a-dcb3-4487-b9ec-9cd5cada1f0e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:38.388586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48271a-dcb3-4487-b9ec-9cd5cada1f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:38.388862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48271a-dcb3-4487-b9ec-9cd5cada1f0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:38.390874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48271a-dcb3-4487-b9ec-9cd5cada1f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:38.392873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48271a-dcb3-4487-b9ec-9cd5cada1f0e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:38.394805 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 147/276] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:38.399955 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48271a-dcb3-4487-b9ec-9cd5cada1f0e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:38.412205 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:38.472678 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28ae66-85a1-4a9c-80e1-cbc67a2d4552 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:38.476365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:38.509831 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2930b1-2fbc-4651-b4d9-14d29e8d47ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:38.510498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2930b1-2fbc-4651-b4d9-14d29e8d47ee None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:38.510780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2930b1-2fbc-4651-b4d9-14d29e8d47ee None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:38.511056 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2930b1-2fbc-4651-b4d9-14d29e8d47ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:38.513930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48271a-dcb3-4487-b9ec-9cd5cada1f0e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:38.522244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2930b1-2fbc-4651-b4d9-14d29e8d47ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-cd2930b1-2fbc-4651-b4d9-14d29e8d47ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:38.527200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:38.528049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 130/277] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:38.531162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2930b1-2fbc-4651-b4d9-14d29e8d47ee None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:38.557054 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86141-b5cb-4746-a2c4-983376fc5355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:38.557663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86141-b5cb-4746-a2c4-983376fc5355 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:38.557939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86141-b5cb-4746-a2c4-983376fc5355 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:38.558206 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86141-b5cb-4746-a2c4-983376fc5355 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:38.558891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f86141-b5cb-4746-a2c4-983376fc5355 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:38.560310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f86141-b5cb-4746-a2c4-983376fc5355 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:38.585406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 148/278] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:14:38 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:14:38.585959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86141-b5cb-4746-a2c4-983376fc5355 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:38.672212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2930b1-2fbc-4651-b4d9-14d29e8d47ee None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:38.692964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:38.714637 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f49f3-ae6b-49a0-a031-dc4cf384c0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:38.715287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f49f3-ae6b-49a0-a031-dc4cf384c0eb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:38.715567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f49f3-ae6b-49a0-a031-dc4cf384c0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:38.715831 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f49f3-ae6b-49a0-a031-dc4cf384c0eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:38.728184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f49f3-ae6b-49a0-a031-dc4cf384c0eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-dc5f49f3-ae6b-49a0-a031-dc4cf384c0eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:38.733265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:38.734300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:38.735787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 131/279] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:38.738097 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86141-b5cb-4746-a2c4-983376fc5355 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:38.740641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f49f3-ae6b-49a0-a031-dc4cf384c0eb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:38.769411 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:38.789022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7db6a-a28b-4792-82ca-38aaf55587da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:38.789645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7db6a-a28b-4792-82ca-38aaf55587da None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:38.789918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7db6a-a28b-4792-82ca-38aaf55587da None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:38.790185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7db6a-a28b-4792-82ca-38aaf55587da None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:38.793497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7db6a-a28b-4792-82ca-38aaf55587da None admin] RBAC: Adding query filter params (name=member) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:38.793497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7db6a-a28b-4792-82ca-38aaf55587da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:38.793497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7db6a-a28b-4792-82ca-38aaf55587da None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:38.804027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 149/280] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:38.811118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7db6a-a28b-4792-82ca-38aaf55587da None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:38.883950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f49f3-ae6b-49a0-a031-dc4cf384c0eb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:38.928081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393b18e-caa7-4260-9cde-8e825c5a3342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:38.928882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393b18e-caa7-4260-9cde-8e825c5a3342 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:38.929255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393b18e-caa7-4260-9cde-8e825c5a3342 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:38.929704 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393b18e-caa7-4260-9cde-8e825c5a3342 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:38.930601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393b18e-caa7-4260-9cde-8e825c5a3342 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:38.930972 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393b18e-caa7-4260-9cde-8e825c5a3342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:38.932572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393b18e-caa7-4260-9cde-8e825c5a3342 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:38.943443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 132/281] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:38.949199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393b18e-caa7-4260-9cde-8e825c5a3342 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:38.959068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7db6a-a28b-4792-82ca-38aaf55587da None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:38.996931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:39.007500 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71408f5-b595-4378-9aa2-27240fc8343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:39.008390 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71408f5-b595-4378-9aa2-27240fc8343c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:39.008929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71408f5-b595-4378-9aa2-27240fc8343c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:39.009207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71408f5-b595-4378-9aa2-27240fc8343c None admin] PATH_INFO: `/v3/users/4e9d6f0adf434ea1ae7242f950ac4876` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:39.029127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71408f5-b595-4378-9aa2-27240fc8343c None admin] RBAC: Authorizing `identity:get_user(user_id=4e9d6f0adf434ea1ae7242f950ac4876)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:39.030629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71408f5-b595-4378-9aa2-27240fc8343c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:39.032335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 150/282] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:38 2022] GET /identity/v3/users/4e9d6f0adf434ea1ae7242f950ac4876 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:39.034166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f55e4-1d25-4d49-b88a-9b684de00343 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:39.034520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f55e4-1d25-4d49-b88a-9b684de00343 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:39.034842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f55e4-1d25-4d49-b88a-9b684de00343 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:39.040089 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 151/283] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:39.042811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f2553-c02f-435a-af11-a735bd3f8e33 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:39.043092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f2553-c02f-435a-af11-a735bd3f8e33 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:39.043362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f2553-c02f-435a-af11-a735bd3f8e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:39.062740 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-006f2553-c02f-435a-af11-a735bd3f8e33 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:39.063924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-006f2553-c02f-435a-af11-a735bd3f8e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:39.084277 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393b18e-caa7-4260-9cde-8e825c5a3342 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:39.109921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:39.130588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff694dc-0db0-4c7c-9cf6-44c2dd027c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:39.131231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff694dc-0db0-4c7c-9cf6-44c2dd027c34 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:39.131509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff694dc-0db0-4c7c-9cf6-44c2dd027c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:39.131782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff694dc-0db0-4c7c-9cf6-44c2dd027c34 None admin] PATH_INFO: `/v3/users/36d35d5f3993417ba6a222bfcd543088` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:39.133696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff694dc-0db0-4c7c-9cf6-44c2dd027c34 None admin] RBAC: Authorizing `identity:get_user(user_id=36d35d5f3993417ba6a222bfcd543088)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:39.135658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff694dc-0db0-4c7c-9cf6-44c2dd027c34 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:39.138358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 133/284] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:38 2022] GET /identity/v3/users/36d35d5f3993417ba6a222bfcd543088 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:39.139583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff694dc-0db0-4c7c-9cf6-44c2dd027c34 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:39.152285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 152/285] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:39.153172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f2553-c02f-435a-af11-a735bd3f8e33 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:39.262393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f2553-c02f-435a-af11-a735bd3f8e33 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:39.279738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff694dc-0db0-4c7c-9cf6-44c2dd027c34 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:39.289935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:39.300912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0bd53-566d-400a-8cff-65844fb572f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:39.301738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0bd53-566d-400a-8cff-65844fb572f1 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:39.302114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0bd53-566d-400a-8cff-65844fb572f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:39.302515 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0bd53-566d-400a-8cff-65844fb572f1 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:39.304439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0bd53-566d-400a-8cff-65844fb572f1 None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:39.306002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0bd53-566d-400a-8cff-65844fb572f1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:39.308926 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 153/286] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:39 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:39.319337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0bd53-566d-400a-8cff-65844fb572f1 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:39.333185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958a9e1-217b-47d4-ac57-f91bd3f0168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:39.333793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958a9e1-217b-47d4-ac57-f91bd3f0168e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:39.334125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958a9e1-217b-47d4-ac57-f91bd3f0168e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:39.334418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958a9e1-217b-47d4-ac57-f91bd3f0168e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:39.335769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958a9e1-217b-47d4-ac57-f91bd3f0168e None admin] RBAC: Adding query filter params (role.id=c6ff6f013f2f41d78fedabbe698ed13e, user.id=4e9d6f0adf434ea1ae7242f950ac4876, scope.system=all) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:39.336133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958a9e1-217b-47d4-ac57-f91bd3f0168e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:39.337650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958a9e1-217b-47d4-ac57-f91bd3f0168e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:39.343884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 134/287] 10.222.0.33 () {56 vars in 1308 bytes} [Mon Sep 12 23:14:39 2022] GET /identity/v3/role_assignments?user.id=4e9d6f0adf434ea1ae7242f950ac4876&scope.system=all&role.id=c6ff6f013f2f41d78fedabbe698ed13e => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:39.415147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:39.523774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0bd53-566d-400a-8cff-65844fb572f1 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:39.556386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958a9e1-217b-47d4-ac57-f91bd3f0168e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:39.571401 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabaf4c-54b4-4fe6-8acf-1d8af3895c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:39.572073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabaf4c-54b4-4fe6-8acf-1d8af3895c6f None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:39.572348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabaf4c-54b4-4fe6-8acf-1d8af3895c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:39.572628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabaf4c-54b4-4fe6-8acf-1d8af3895c6f None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23/users/36d35d5f3993417ba6a222bfcd543088/roles/cca59383436e4294a41556fbdf237853` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:39.574583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabaf4c-54b4-4fe6-8acf-1d8af3895c6f None admin] RBAC: Authorizing `identity:create_grant(project_id=e5f1cb41b1834dee86dc7f0ae7165f23, user_id=36d35d5f3993417ba6a222bfcd543088, role_id=cca59383436e4294a41556fbdf237853)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:39.576023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabaf4c-54b4-4fe6-8acf-1d8af3895c6f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:39.594493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 154/288] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:14:39 2022] PUT /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23/users/36d35d5f3993417ba6a222bfcd543088/roles/cca59383436e4294a41556fbdf237853 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:14:39.791655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958a9e1-217b-47d4-ac57-f91bd3f0168e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:39.842871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93b578-3d54-4f1c-ac5a-3bad74411fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:39.843740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93b578-3d54-4f1c-ac5a-3bad74411fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:39.844177 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93b578-3d54-4f1c-ac5a-3bad74411fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:39.844574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93b578-3d54-4f1c-ac5a-3bad74411fb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:39.862023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93b578-3d54-4f1c-ac5a-3bad74411fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fc93b578-3d54-4f1c-ac5a-3bad74411fb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:39.867810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:39.868843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:39.869817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:39.869817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:39.869817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:39.869817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:39.869817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:39.869817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:39.869817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:39.869817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:39.869817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:39.869817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:39.869817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:39.869817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:39.876320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 135/289] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:39.882948 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabaf4c-54b4-4fe6-8acf-1d8af3895c6f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:39.995178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:39.999132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabaf4c-54b4-4fe6-8acf-1d8af3895c6f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:40.036642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08321e25-1b84-49b6-bd4e-fda1393848a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:40.037481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321e25-1b84-49b6-bd4e-fda1393848a8 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:40.037895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321e25-1b84-49b6-bd4e-fda1393848a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:40.038325 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321e25-1b84-49b6-bd4e-fda1393848a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:40.039143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08321e25-1b84-49b6-bd4e-fda1393848a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:40.039581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08321e25-1b84-49b6-bd4e-fda1393848a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:40.041391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08321e25-1b84-49b6-bd4e-fda1393848a8 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:40.050084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 155/290] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:40.056068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93b578-3d54-4f1c-ac5a-3bad74411fb9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:40.097304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:40.186878 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93b578-3d54-4f1c-ac5a-3bad74411fb9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:40.231191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e31030-b899-4f9d-8a89-977b61c903a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:40.232066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e31030-b899-4f9d-8a89-977b61c903a2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:40.232483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e31030-b899-4f9d-8a89-977b61c903a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:40.232922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e31030-b899-4f9d-8a89-977b61c903a2 None admin] PATH_INFO: `/v3/users/59d17768d0874be69280b70fc761b31a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:40.238299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e31030-b899-4f9d-8a89-977b61c903a2 None admin] RBAC: Authorizing `identity:get_user(user_id=59d17768d0874be69280b70fc761b31a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:40.239937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e31030-b899-4f9d-8a89-977b61c903a2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:40.241982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 136/291] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:40 2022] GET /identity/v3/users/59d17768d0874be69280b70fc761b31a => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:40.247410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08321e25-1b84-49b6-bd4e-fda1393848a8 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:40.380718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08321e25-1b84-49b6-bd4e-fda1393848a8 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:40.428551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb9ffd-a43e-4807-abe1-e84e29666395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:40.429152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb9ffd-a43e-4807-abe1-e84e29666395 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:40.429433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb9ffd-a43e-4807-abe1-e84e29666395 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:40.429699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb9ffd-a43e-4807-abe1-e84e29666395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:40.461146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:40.514453 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb9ffd-a43e-4807-abe1-e84e29666395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:40.515920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb9ffd-a43e-4807-abe1-e84e29666395 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:40.622661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 156/292] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:40.631528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e31030-b899-4f9d-8a89-977b61c903a2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:40.753444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:40.757501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e31030-b899-4f9d-8a89-977b61c903a2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:40.811126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844722a-db39-4863-b6aa-1d23d077b629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:40.811767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844722a-db39-4863-b6aa-1d23d077b629 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:40.812044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844722a-db39-4863-b6aa-1d23d077b629 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:40.812315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844722a-db39-4863-b6aa-1d23d077b629 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:40.813453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844722a-db39-4863-b6aa-1d23d077b629 None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:40.815039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844722a-db39-4863-b6aa-1d23d077b629 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:40.816730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 137/293] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:40 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:40.822778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb9ffd-a43e-4807-abe1-e84e29666395 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:40.895001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:40.940408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb9ffd-a43e-4807-abe1-e84e29666395 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:40.984014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cec34-6af0-4c10-8779-b461e50df630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:40.984624 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cec34-6af0-4c10-8779-b461e50df630 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:40.984947 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cec34-6af0-4c10-8779-b461e50df630 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:40.985224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cec34-6af0-4c10-8779-b461e50df630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:40.985957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cec34-6af0-4c10-8779-b461e50df630 None admin] RBAC: Adding query filter params (role.id=c6ff6f013f2f41d78fedabbe698ed13e, scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23, user.id=59d17768d0874be69280b70fc761b31a) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:40.987011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cec34-6af0-4c10-8779-b461e50df630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:40.988507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cec34-6af0-4c10-8779-b461e50df630 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:40.997358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 157/294] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:40 2022] GET /identity/v3/role_assignments?user.id=59d17768d0874be69280b70fc761b31a&scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23&role.id=c6ff6f013f2f41d78fedabbe698ed13e => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:41.217322 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eea090-d6db-4433-919b-1307f494b686 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:41.218295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eea090-d6db-4433-919b-1307f494b686 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:41.218808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eea090-d6db-4433-919b-1307f494b686 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:41.220384 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 138/295] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:41.226179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf681d21-714e-4318-a5d3-50176e67699f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:41.226749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf681d21-714e-4318-a5d3-50176e67699f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:41.227217 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf681d21-714e-4318-a5d3-50176e67699f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:41.246996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-bf681d21-714e-4318-a5d3-50176e67699f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:41.248553 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bf681d21-714e-4318-a5d3-50176e67699f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:41.340914 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 158/296] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:14:41.578470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed77ac-efac-4813-953a-d936137fedb3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:41.578839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed77ac-efac-4813-953a-d936137fedb3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:41.579013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed77ac-efac-4813-953a-d936137fedb3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:41.580840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 139/297] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:41.587067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b77c2c-b487-4d51-b675-8f02c80c96ad None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:41.587350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b77c2c-b487-4d51-b675-8f02c80c96ad None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:41.587625 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b77c2c-b487-4d51-b675-8f02c80c96ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:41.609959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c9b77c2c-b487-4d51-b675-8f02c80c96ad None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:41.611329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c9b77c2c-b487-4d51-b675-8f02c80c96ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:41.662276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed77ac-efac-4813-953a-d936137fedb3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:41.683426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:41.706479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 159/298] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:41.801848 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed77ac-efac-4813-953a-d936137fedb3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:41.837758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c6d01-84ce-4643-80c0-760153effeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:41.838315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c6d01-84ce-4643-80c0-760153effeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:41.838615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c6d01-84ce-4643-80c0-760153effeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:41.838880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c6d01-84ce-4643-80c0-760153effeb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:41.839962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c6d01-84ce-4643-80c0-760153effeb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:41.841397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c6d01-84ce-4643-80c0-760153effeb2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:41.843083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 140/299] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:41.849028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b77c2c-b487-4d51-b675-8f02c80c96ad None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:41.960136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b77c2c-b487-4d51-b675-8f02c80c96ad None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:41.991616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c6d01-84ce-4643-80c0-760153effeb2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:41.999826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834e163-c158-4275-a2b5-6f6f00e0dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:42.000441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834e163-c158-4275-a2b5-6f6f00e0dfaa None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:42.000717 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834e163-c158-4275-a2b5-6f6f00e0dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:42.000990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834e163-c158-4275-a2b5-6f6f00e0dfaa None admin] PATH_INFO: `/v3/groups` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:42.001645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834e163-c158-4275-a2b5-6f6f00e0dfaa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:42.003156 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834e163-c158-4275-a2b5-6f6f00e0dfaa None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:42.030444 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 160/300] 10.222.0.33 () {60 vars in 1134 bytes} [Mon Sep 12 23:14:41 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:14:42.045884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:42.066177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16c71a-b983-4552-9fc5-d78e3e50670f None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:42.066851 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16c71a-b983-4552-9fc5-d78e3e50670f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:42.067316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16c71a-b983-4552-9fc5-d78e3e50670f None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:42.069182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 161/301] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:14:42.074940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60adc7-aeb1-42be-b1cb-7f30040cf65e None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:42.075564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60adc7-aeb1-42be-b1cb-7f30040cf65e None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:42.076045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60adc7-aeb1-42be-b1cb-7f30040cf65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:42.099151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ef60adc7-aeb1-42be-b1cb-7f30040cf65e None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:42.100797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ef60adc7-aeb1-42be-b1cb-7f30040cf65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:42.133386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c6d01-84ce-4643-80c0-760153effeb2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:42.156457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:42.184151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f931c-b4d2-4267-9375-ee1d3e828a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:42.184798 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f931c-b4d2-4267-9375-ee1d3e828a1b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:42.185093 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f931c-b4d2-4267-9375-ee1d3e828a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:42.185359 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f931c-b4d2-4267-9375-ee1d3e828a1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:42.194037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 162/302] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:42.206265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f931c-b4d2-4267-9375-ee1d3e828a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-cc0f931c-b4d2-4267-9375-ee1d3e828a1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:42.211531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:42.212439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:42.213237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 141/303] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:42.219473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60adc7-aeb1-42be-b1cb-7f30040cf65e None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:42.329083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60adc7-aeb1-42be-b1cb-7f30040cf65e None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:42.366267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37a1a7-dc44-4e19-a452-ed3323ded0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:42.366875 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37a1a7-dc44-4e19-a452-ed3323ded0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:42.367149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37a1a7-dc44-4e19-a452-ed3323ded0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:42.367415 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37a1a7-dc44-4e19-a452-ed3323ded0b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:42.368074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37a1a7-dc44-4e19-a452-ed3323ded0b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:42.368367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37a1a7-dc44-4e19-a452-ed3323ded0b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:42.369733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37a1a7-dc44-4e19-a452-ed3323ded0b0 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:42.379630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 163/304] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:42.387659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f931c-b4d2-4267-9375-ee1d3e828a1b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:42.488033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37a1a7-dc44-4e19-a452-ed3323ded0b0 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:42.493182 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:42.501225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f931c-b4d2-4267-9375-ee1d3e828a1b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:42.532791 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:42.539758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5b797-9ad5-4655-9a75-fa633981cb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:42.540397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5b797-9ad5-4655-9a75-fa633981cb93 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:42.540931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5b797-9ad5-4655-9a75-fa633981cb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:42.541216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5b797-9ad5-4655-9a75-fa633981cb93 None admin] PATH_INFO: `/v3/users/57dd8269a6b34df78dd3acf909296a52` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:42.555528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5b797-9ad5-4655-9a75-fa633981cb93 None admin] RBAC: Authorizing `identity:get_user(user_id=57dd8269a6b34df78dd3acf909296a52)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:42.557026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5b797-9ad5-4655-9a75-fa633981cb93 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:42.558716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 142/305] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:42 2022] GET /identity/v3/users/57dd8269a6b34df78dd3acf909296a52 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:42.558716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1ccc2-a1f6-4559-a55f-af6dc4245601 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:42.558716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1ccc2-a1f6-4559-a55f-af6dc4245601 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:42.558716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1ccc2-a1f6-4559-a55f-af6dc4245601 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:42.558716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 143/306] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:42.566030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1ccc2-a1f6-4559-a55f-af6dc4245601 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:42.606773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37a1a7-dc44-4e19-a452-ed3323ded0b0 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:42.641745 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed89b92-9250-4f46-9343-4f4a0181c37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:42.643413 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed89b92-9250-4f46-9343-4f4a0181c37f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:42.643976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed89b92-9250-4f46-9343-4f4a0181c37f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:42.644254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed89b92-9250-4f46-9343-4f4a0181c37f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:42.654835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed89b92-9250-4f46-9343-4f4a0181c37f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-4ed89b92-9250-4f46-9343-4f4a0181c37f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:42.660458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:42.661352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:42.662119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 164/307] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:42.663727 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722397c5-e60e-48c8-b65d-f6aebc9de592 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:42.663727 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722397c5-e60e-48c8-b65d-f6aebc9de592 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:42.663727 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722397c5-e60e-48c8-b65d-f6aebc9de592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:42.681458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1ccc2-a1f6-4559-a55f-af6dc4245601 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:42.682237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-722397c5-e60e-48c8-b65d-f6aebc9de592 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:42.683467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-722397c5-e60e-48c8-b65d-f6aebc9de592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:42.717478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f684d5-16ce-44b3-93af-2b4b705b812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:42.718082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f684d5-16ce-44b3-93af-2b4b705b812d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:42.718361 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f684d5-16ce-44b3-93af-2b4b705b812d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:42.718723 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f684d5-16ce-44b3-93af-2b4b705b812d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:42.719378 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f684d5-16ce-44b3-93af-2b4b705b812d None admin] RBAC: Adding query filter params (role.id=cca59383436e4294a41556fbdf237853, user.id=57dd8269a6b34df78dd3acf909296a52, scope.system=all) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:42.719685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f684d5-16ce-44b3-93af-2b4b705b812d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:42.721311 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f684d5-16ce-44b3-93af-2b4b705b812d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:42.734452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 144/308] 10.222.0.33 () {56 vars in 1308 bytes} [Mon Sep 12 23:14:42 2022] GET /identity/v3/role_assignments?user.id=57dd8269a6b34df78dd3acf909296a52&scope.system=all&role.id=cca59383436e4294a41556fbdf237853 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:42.734452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f684d5-16ce-44b3-93af-2b4b705b812d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:42.754709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:42.771513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 165/309] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:42.856862 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f684d5-16ce-44b3-93af-2b4b705b812d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:42.898358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a68903-a64c-459c-999e-4b157c2f4fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:42.898920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68903-a64c-459c-999e-4b157c2f4fda None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:42.899192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68903-a64c-459c-999e-4b157c2f4fda None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:42.899461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68903-a64c-459c-999e-4b157c2f4fda None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:42.900186 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a68903-a64c-459c-999e-4b157c2f4fda None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:42.900488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a68903-a64c-459c-999e-4b157c2f4fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:42.901888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a68903-a64c-459c-999e-4b157c2f4fda None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:42.912571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 145/310] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:42.920068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722397c5-e60e-48c8-b65d-f6aebc9de592 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:42.957800 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:43.039516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722397c5-e60e-48c8-b65d-f6aebc9de592 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:43.043065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a68903-a64c-459c-999e-4b157c2f4fda None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:43.086907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc71a0-43f2-4075-874c-3e55d773181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:43.087610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc71a0-43f2-4075-874c-3e55d773181b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:43.087893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc71a0-43f2-4075-874c-3e55d773181b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:43.088164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc71a0-43f2-4075-874c-3e55d773181b None admin] PATH_INFO: `/v3/users/4e9d6f0adf434ea1ae7242f950ac4876` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:43.089308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc71a0-43f2-4075-874c-3e55d773181b None admin] RBAC: Authorizing `identity:get_user(user_id=4e9d6f0adf434ea1ae7242f950ac4876)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:43.090948 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc71a0-43f2-4075-874c-3e55d773181b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:43.094454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 166/311] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:42 2022] GET /identity/v3/users/4e9d6f0adf434ea1ae7242f950ac4876 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:43.099955 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc71a0-43f2-4075-874c-3e55d773181b None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:43.150597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:43.182176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a68903-a64c-459c-999e-4b157c2f4fda None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:43.212505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:43.218097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9c92e-6838-4863-8230-674eeed280ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:43.218678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc71a0-43f2-4075-874c-3e55d773181b None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:43.219489 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9c92e-6838-4863-8230-674eeed280ae None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:43.219965 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9c92e-6838-4863-8230-674eeed280ae None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:43.221012 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9c92e-6838-4863-8230-674eeed280ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:43.231734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9c92e-6838-4863-8230-674eeed280ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-19a9c92e-6838-4863-8230-674eeed280ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:43.238475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:43.239337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:43.240112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:43.240112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:43.240112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:43.240112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:43.240112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:43.240112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:43.240112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:43.240112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:43.240112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:43.240112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:43.240112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:43.240112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:43.242325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 146/312] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:14:43.248613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9c92e-6838-4863-8230-674eeed280ae None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:43.263048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d499e4-e3ed-46e9-ba4e-8f620435b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:43.263708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d499e4-e3ed-46e9-ba4e-8f620435b4d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:43.263985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d499e4-e3ed-46e9-ba4e-8f620435b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:43.264256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d499e4-e3ed-46e9-ba4e-8f620435b4d1 None admin] PATH_INFO: `/v3/system/users/4e9d6f0adf434ea1ae7242f950ac4876/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:43.265656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d499e4-e3ed-46e9-ba4e-8f620435b4d1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4e9d6f0adf434ea1ae7242f950ac4876, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:43.267095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d499e4-e3ed-46e9-ba4e-8f620435b4d1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:43.278282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 167/313] 10.222.0.33 () {58 vars in 1334 bytes} [Mon Sep 12 23:14:43 2022] PUT /identity/v3/system/users/4e9d6f0adf434ea1ae7242f950ac4876/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:14:43.384829 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9c92e-6838-4863-8230-674eeed280ae None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:43.424631 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09cf91-6eac-4114-a59c-54c1b52bb8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:43.425356 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09cf91-6eac-4114-a59c-54c1b52bb8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:43.425434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09cf91-6eac-4114-a59c-54c1b52bb8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:43.425698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09cf91-6eac-4114-a59c-54c1b52bb8b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:43.426400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09cf91-6eac-4114-a59c-54c1b52bb8b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:43.426712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09cf91-6eac-4114-a59c-54c1b52bb8b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:43.428137 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09cf91-6eac-4114-a59c-54c1b52bb8b0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:43.434444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:43.440393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 147/314] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:43.447614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d499e4-e3ed-46e9-ba4e-8f620435b4d1 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:43.558625 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d499e4-e3ed-46e9-ba4e-8f620435b4d1 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:43.594371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cf4b9-2045-4ed9-84b6-f79ec6be6a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:43.595444 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cf4b9-2045-4ed9-84b6-f79ec6be6a68 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:43.595926 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cf4b9-2045-4ed9-84b6-f79ec6be6a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:43.596468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cf4b9-2045-4ed9-84b6-f79ec6be6a68 None admin] PATH_INFO: `/v3/users/36d35d5f3993417ba6a222bfcd543088` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:43.597909 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cf4b9-2045-4ed9-84b6-f79ec6be6a68 None admin] RBAC: Authorizing `identity:get_user(user_id=36d35d5f3993417ba6a222bfcd543088)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:43.599608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cf4b9-2045-4ed9-84b6-f79ec6be6a68 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:43.601716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 168/315] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:43 2022] GET /identity/v3/users/36d35d5f3993417ba6a222bfcd543088 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:43.607556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09cf91-6eac-4114-a59c-54c1b52bb8b0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:43.715939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09cf91-6eac-4114-a59c-54c1b52bb8b0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:43.751708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b2cbe-d55d-4e33-b691-a3a5ce84631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:43.752331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b2cbe-d55d-4e33-b691-a3a5ce84631c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:43.752617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b2cbe-d55d-4e33-b691-a3a5ce84631c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:43.752887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b2cbe-d55d-4e33-b691-a3a5ce84631c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:43.821100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:43.823379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b2cbe-d55d-4e33-b691-a3a5ce84631c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:43.825416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b2cbe-d55d-4e33-b691-a3a5ce84631c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:43.934419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 148/316] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:43.940546 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cf4b9-2045-4ed9-84b6-f79ec6be6a68 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:43.975373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:44.052463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cf4b9-2045-4ed9-84b6-f79ec6be6a68 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:44.088230 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adeb624-2dc2-4722-8d20-e242c411df5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:44.088870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeb624-2dc2-4722-8d20-e242c411df5b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:44.089328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeb624-2dc2-4722-8d20-e242c411df5b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:44.089609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeb624-2dc2-4722-8d20-e242c411df5b None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:44.090763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adeb624-2dc2-4722-8d20-e242c411df5b None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:44.092401 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adeb624-2dc2-4722-8d20-e242c411df5b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:44.094412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 169/317] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:43 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:44.100090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b2cbe-d55d-4e33-b691-a3a5ce84631c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:44.207331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:44.210477 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b2cbe-d55d-4e33-b691-a3a5ce84631c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:44.251275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fb4ae-5321-4a85-8d8b-4f862682adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:44.252077 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fb4ae-5321-4a85-8d8b-4f862682adb4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:44.252457 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fb4ae-5321-4a85-8d8b-4f862682adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:44.252731 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fb4ae-5321-4a85-8d8b-4f862682adb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:44.253485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fb4ae-5321-4a85-8d8b-4f862682adb4 None admin] RBAC: Adding query filter params (role.id=cca59383436e4294a41556fbdf237853, scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23, user.id=36d35d5f3993417ba6a222bfcd543088) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:44.253874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fb4ae-5321-4a85-8d8b-4f862682adb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:44.255428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fb4ae-5321-4a85-8d8b-4f862682adb4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:44.262647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 149/318] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:14:44 2022] GET /identity/v3/role_assignments?user.id=36d35d5f3993417ba6a222bfcd543088&scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23&role.id=cca59383436e4294a41556fbdf237853 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:44.340929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad5aee-5e73-48b4-9dd0-99ed7ee8d079 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:44.341258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad5aee-5e73-48b4-9dd0-99ed7ee8d079 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:44.341465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad5aee-5e73-48b4-9dd0-99ed7ee8d079 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:44.342869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 170/319] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:44.349546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24fde7-c76c-4158-a06e-da0663ee8d09 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:44.349836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24fde7-c76c-4158-a06e-da0663ee8d09 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:44.350113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24fde7-c76c-4158-a06e-da0663ee8d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:44.369584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4c24fde7-c76c-4158-a06e-da0663ee8d09 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:44.370843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4c24fde7-c76c-4158-a06e-da0663ee8d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:44.447552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 150/320] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:44.721493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad5aee-5e73-48b4-9dd0-99ed7ee8d079 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:44.819524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:44.826289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad5aee-5e73-48b4-9dd0-99ed7ee8d079 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:44.859492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c3c8a-f9e2-42e6-b2be-1b7e43cc614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:44.860121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c3c8a-f9e2-42e6-b2be-1b7e43cc614b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:44.860402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c3c8a-f9e2-42e6-b2be-1b7e43cc614b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:44.860676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c3c8a-f9e2-42e6-b2be-1b7e43cc614b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:44.862296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c3c8a-f9e2-42e6-b2be-1b7e43cc614b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:44.863757 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c3c8a-f9e2-42e6-b2be-1b7e43cc614b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:44.865484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 171/321] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:14:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:44.870859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24fde7-c76c-4158-a06e-da0663ee8d09 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:44.970647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:44.978600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24fde7-c76c-4158-a06e-da0663ee8d09 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:45.014221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6421e-e435-447b-9766-d61baaa6c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:45.014858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6421e-e435-447b-9766-d61baaa6c3f8 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:45.015140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6421e-e435-447b-9766-d61baaa6c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:45.015414 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6421e-e435-447b-9766-d61baaa6c3f8 None admin] PATH_INFO: `/v3/groups` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:45.016089 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6421e-e435-447b-9766-d61baaa6c3f8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:45.017661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6421e-e435-447b-9766-d61baaa6c3f8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:45.035254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 151/322] 10.222.0.33 () {60 vars in 1134 bytes} [Mon Sep 12 23:14:44 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:14:45.063434 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf8f7-a543-4a3b-9aaa-00a47d8f4f94 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:45.063958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf8f7-a543-4a3b-9aaa-00a47d8f4f94 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:45.064065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf8f7-a543-4a3b-9aaa-00a47d8f4f94 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:45.066503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 172/323] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:45.072449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d1d9d-0146-4789-9213-da2ae4dbaa98 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:45.072740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d1d9d-0146-4789-9213-da2ae4dbaa98 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:45.073002 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d1d9d-0146-4789-9213-da2ae4dbaa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:45.092521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7c7d1d9d-0146-4789-9213-da2ae4dbaa98 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:45.093866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7c7d1d9d-0146-4789-9213-da2ae4dbaa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:45.171333 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 152/324] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:45.449269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cf8f7-a543-4a3b-9aaa-00a47d8f4f94 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:45.574820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cf8f7-a543-4a3b-9aaa-00a47d8f4f94 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:45.611450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f95dc-2b68-4420-8ac2-0362cf832d45 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:45.612485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f95dc-2b68-4420-8ac2-0362cf832d45 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:45.612954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f95dc-2b68-4420-8ac2-0362cf832d45 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:45.614323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571af36e-54ac-4777-92fd-1279d44887bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:45.614795 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 153/325] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:14:45.615299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571af36e-54ac-4777-92fd-1279d44887bf None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:45.615578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571af36e-54ac-4777-92fd-1279d44887bf None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:45.615866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571af36e-54ac-4777-92fd-1279d44887bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:45.623330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b111b-faaa-4be6-b9a9-f60d5e5082b6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:45.623611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b111b-faaa-4be6-b9a9-f60d5e5082b6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:45.623916 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b111b-faaa-4be6-b9a9-f60d5e5082b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:45.633024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571af36e-54ac-4777-92fd-1279d44887bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-571af36e-54ac-4777-92fd-1279d44887bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:45.638716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:45.639558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:45.640337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:45.640337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:45.640337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:45.640337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:45.640337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:45.640337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:45.640337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:45.640337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:45.640337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:45.640337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:45.640337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:45.640337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:45.643703 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 173/326] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:45.649725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571af36e-54ac-4777-92fd-1279d44887bf None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:45.650929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b94b111b-faaa-4be6-b9a9-f60d5e5082b6 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:45.652221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b94b111b-faaa-4be6-b9a9-f60d5e5082b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:45.683061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:45.762668 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 154/327] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:14:45.790863 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571af36e-54ac-4777-92fd-1279d44887bf None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:45.831640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6984f-b671-47fb-8980-83d6445fb033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:45.832252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6984f-b671-47fb-8980-83d6445fb033 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:45.832533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6984f-b671-47fb-8980-83d6445fb033 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:45.832806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6984f-b671-47fb-8980-83d6445fb033 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:45.833476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6984f-b671-47fb-8980-83d6445fb033 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:45.833777 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6984f-b671-47fb-8980-83d6445fb033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:45.835185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6984f-b671-47fb-8980-83d6445fb033 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:45.847452 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 174/328] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:45.853587 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b111b-faaa-4be6-b9a9-f60d5e5082b6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:45.875262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:45.983966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b111b-faaa-4be6-b9a9-f60d5e5082b6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:46.022013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ec89f-fb8e-4a67-b6e9-49691c8288bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:46.023055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ec89f-fb8e-4a67-b6e9-49691c8288bf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:46.023546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ec89f-fb8e-4a67-b6e9-49691c8288bf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:46.024014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ec89f-fb8e-4a67-b6e9-49691c8288bf None admin] PATH_INFO: `/v3/users/57dd8269a6b34df78dd3acf909296a52` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:46.025344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ec89f-fb8e-4a67-b6e9-49691c8288bf None admin] RBAC: Authorizing `identity:get_user(user_id=57dd8269a6b34df78dd3acf909296a52)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:46.027052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ec89f-fb8e-4a67-b6e9-49691c8288bf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:46.029118 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 155/329] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:45 2022] GET /identity/v3/users/57dd8269a6b34df78dd3acf909296a52 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:46.035687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6984f-b671-47fb-8980-83d6445fb033 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:46.139758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:46.156987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6984f-b671-47fb-8980-83d6445fb033 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:46.196620 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92108d-37b0-46cf-a7e6-a235de221532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:46.197662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92108d-37b0-46cf-a7e6-a235de221532 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:46.198138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92108d-37b0-46cf-a7e6-a235de221532 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:46.198628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92108d-37b0-46cf-a7e6-a235de221532 None admin] PATH_INFO: `/v3/system/users/57dd8269a6b34df78dd3acf909296a52/roles/cca59383436e4294a41556fbdf237853` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:46.200262 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92108d-37b0-46cf-a7e6-a235de221532 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=57dd8269a6b34df78dd3acf909296a52, role_id=cca59383436e4294a41556fbdf237853)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:46.201954 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92108d-37b0-46cf-a7e6-a235de221532 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:46.209547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ec89f-fb8e-4a67-b6e9-49691c8288bf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:46.218728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 175/330] 10.222.0.33 () {58 vars in 1334 bytes} [Mon Sep 12 23:14:46 2022] PUT /identity/v3/system/users/57dd8269a6b34df78dd3acf909296a52/roles/cca59383436e4294a41556fbdf237853 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:14:46.336513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:46.359613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ec89f-fb8e-4a67-b6e9-49691c8288bf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:46.414314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cc0d8-de67-43c9-a50e-c40b3c462904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:46.415365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cc0d8-de67-43c9-a50e-c40b3c462904 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:46.416158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cc0d8-de67-43c9-a50e-c40b3c462904 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:46.416627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cc0d8-de67-43c9-a50e-c40b3c462904 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:46.429619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cc0d8-de67-43c9-a50e-c40b3c462904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-891cc0d8-de67-43c9-a50e-c40b3c462904 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:46.435160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:46.436095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:46.436899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:46.436899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:46.436899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:46.436899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:46.436899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:46.436899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:46.436899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:46.436899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:46.436899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:46.436899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:46.436899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:46.436899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:46.439397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 156/331] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:46.445443 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92108d-37b0-46cf-a7e6-a235de221532 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:46.585733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92108d-37b0-46cf-a7e6-a235de221532 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:46.625957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75acc7c-9e87-44bb-b983-67a11b934bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:46.626579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75acc7c-9e87-44bb-b983-67a11b934bbc None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:46.626921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75acc7c-9e87-44bb-b983-67a11b934bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:46.627174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75acc7c-9e87-44bb-b983-67a11b934bbc None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:46.627816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75acc7c-9e87-44bb-b983-67a11b934bbc None admin] RBAC: Adding query filter params (name=member) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:46.628120 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75acc7c-9e87-44bb-b983-67a11b934bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:46.629506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75acc7c-9e87-44bb-b983-67a11b934bbc None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:46.638656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 176/332] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:46.647489 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cc0d8-de67-43c9-a50e-c40b3c462904 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:46.791292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cc0d8-de67-43c9-a50e-c40b3c462904 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:46.834257 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3406f16-43f8-4308-9703-496757e4461b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:46.835283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3406f16-43f8-4308-9703-496757e4461b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:46.835827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3406f16-43f8-4308-9703-496757e4461b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:46.836315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3406f16-43f8-4308-9703-496757e4461b None admin] PATH_INFO: `/v3/users/4e9d6f0adf434ea1ae7242f950ac4876` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:46.837694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3406f16-43f8-4308-9703-496757e4461b None admin] RBAC: Authorizing `identity:get_user(user_id=4e9d6f0adf434ea1ae7242f950ac4876)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:46.839392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3406f16-43f8-4308-9703-496757e4461b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:46.841176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 157/333] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:46 2022] GET /identity/v3/users/4e9d6f0adf434ea1ae7242f950ac4876 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:46.848805 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75acc7c-9e87-44bb-b983-67a11b934bbc None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:46.872791 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:46.983221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75acc7c-9e87-44bb-b983-67a11b934bbc None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:47.027551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200b5e2-95d9-4077-b328-c6157a757ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:47.028174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200b5e2-95d9-4077-b328-c6157a757ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:47.028456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200b5e2-95d9-4077-b328-c6157a757ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:47.028733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200b5e2-95d9-4077-b328-c6157a757ac1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:47.029469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200b5e2-95d9-4077-b328-c6157a757ac1 None admin] RBAC: Adding query filter params (role.id=c6ff6f013f2f41d78fedabbe698ed13e, user.id=4e9d6f0adf434ea1ae7242f950ac4876, scope.system=all) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:47.029780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200b5e2-95d9-4077-b328-c6157a757ac1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:47.031241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200b5e2-95d9-4077-b328-c6157a757ac1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:47.044781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 177/334] 10.222.0.33 () {56 vars in 1308 bytes} [Mon Sep 12 23:14:46 2022] GET /identity/v3/role_assignments?user.id=4e9d6f0adf434ea1ae7242f950ac4876&scope.system=all&role.id=c6ff6f013f2f41d78fedabbe698ed13e => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:47.873527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e8e3a-cb82-4c6f-9342-f5e70da61d32 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:47.874067 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e8e3a-cb82-4c6f-9342-f5e70da61d32 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:47.874067 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e8e3a-cb82-4c6f-9342-f5e70da61d32 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:47.875730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 158/335] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:47.881478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b970c1c-9b81-4e5e-a10e-acc51f6d4aae None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:47.881892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b970c1c-9b81-4e5e-a10e-acc51f6d4aae None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:47.882078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b970c1c-9b81-4e5e-a10e-acc51f6d4aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:47.907603 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-0b970c1c-9b81-4e5e-a10e-acc51f6d4aae None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:47.909621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0b970c1c-9b81-4e5e-a10e-acc51f6d4aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:47.991460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:47.999346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 178/336] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:48.241969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89930f82-8026-4995-ae42-1fc658fd4c6b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:48.242556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89930f82-8026-4995-ae42-1fc658fd4c6b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:48.242974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89930f82-8026-4995-ae42-1fc658fd4c6b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:48.244467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 159/337] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:48.254025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aefc4-12f8-450c-933b-b71c243b0c26 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:48.254573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aefc4-12f8-450c-933b-b71c243b0c26 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:48.255012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aefc4-12f8-450c-933b-b71c243b0c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:48.279344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c28aefc4-12f8-450c-933b-b71c243b0c26 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:48.280779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c28aefc4-12f8-450c-933b-b71c243b0c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:48.372915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 179/338] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:48.553102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89930f82-8026-4995-ae42-1fc658fd4c6b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:48.566284 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:48.688789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89930f82-8026-4995-ae42-1fc658fd4c6b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:48.731939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ab917-76c3-4e3e-b5c4-62b90b000d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:48.732917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ab917-76c3-4e3e-b5c4-62b90b000d84 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:48.733397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ab917-76c3-4e3e-b5c4-62b90b000d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:48.733970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ab917-76c3-4e3e-b5c4-62b90b000d84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:48.755273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ab917-76c3-4e3e-b5c4-62b90b000d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-643ab917-76c3-4e3e-b5c4-62b90b000d84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:48.760546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:48.761397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:48.762159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:48.762159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:48.762159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:48.762159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:48.762159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:48.762159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:48.762159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:48.762159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:48.762159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:48.762159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:48.762159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:48.762159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:48.764452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 160/339] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:48.771287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aefc4-12f8-450c-933b-b71c243b0c26 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:48.907372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aefc4-12f8-450c-933b-b71c243b0c26 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:48.945956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:48.957123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc14e6-352b-4949-a188-2be1c7895c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:48.957754 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc14e6-352b-4949-a188-2be1c7895c03 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:48.958036 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc14e6-352b-4949-a188-2be1c7895c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:48.958314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc14e6-352b-4949-a188-2be1c7895c03 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:48.959023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc14e6-352b-4949-a188-2be1c7895c03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:48.959328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc14e6-352b-4949-a188-2be1c7895c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:48.960706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc14e6-352b-4949-a188-2be1c7895c03 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:48.974422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 180/340] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:48.980234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ab917-76c3-4e3e-b5c4-62b90b000d84 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:49.003682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31a9b0-677b-44db-a574-bfbbec27a9e3 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:49.003979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31a9b0-677b-44db-a574-bfbbec27a9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:49.004243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31a9b0-677b-44db-a574-bfbbec27a9e3 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:49.005732 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 181/341] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:14:49.007633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31a9b0-677b-44db-a574-bfbbec27a9e3 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:49.117381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:49.174485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ab917-76c3-4e3e-b5c4-62b90b000d84 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:49.195387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31a9b0-677b-44db-a574-bfbbec27a9e3 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:49.232226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eda174-817c-4241-8517-2844c8dad36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:49.232839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eda174-817c-4241-8517-2844c8dad36a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:49.233280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eda174-817c-4241-8517-2844c8dad36a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:49.233692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eda174-817c-4241-8517-2844c8dad36a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:49.240847 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd35c3-2e49-4da7-84d0-54e94f70a3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:49.241494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd35c3-2e49-4da7-84d0-54e94f70a3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:49.241776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd35c3-2e49-4da7-84d0-54e94f70a3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:49.242049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd35c3-2e49-4da7-84d0-54e94f70a3c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:49.262337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd35c3-2e49-4da7-84d0-54e94f70a3c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-cdcd35c3-2e49-4da7-84d0-54e94f70a3c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:49.273286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:49.274183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:49.275083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:49.275083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:49.275083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:49.275083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:49.275083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:49.275083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:49.275083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:49.275083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:49.275083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:49.275083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:49.275083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:49.275083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:49.279165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 182/342] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:14:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:49.280735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095f82d-8185-410d-820e-d09ef98d5b29 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:49.281199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095f82d-8185-410d-820e-d09ef98d5b29 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:49.281645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095f82d-8185-410d-820e-d09ef98d5b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:49.305715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-0095f82d-8185-410d-820e-d09ef98d5b29 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:49.307348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0095f82d-8185-410d-820e-d09ef98d5b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:49.364317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eda174-817c-4241-8517-2844c8dad36a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:49.366155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eda174-817c-4241-8517-2844c8dad36a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:49.383469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:49.436224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 183/343] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:49.437087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095f82d-8185-410d-820e-d09ef98d5b29 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:49.492918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:49.569907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 161/344] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:49.579413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eda174-817c-4241-8517-2844c8dad36a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:49.644793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095f82d-8185-410d-820e-d09ef98d5b29 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:49.719437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beae813-74c3-44be-9b9c-3d7b417e88a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:49.720976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beae813-74c3-44be-9b9c-3d7b417e88a1 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:49.721460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beae813-74c3-44be-9b9c-3d7b417e88a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:49.721945 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beae813-74c3-44be-9b9c-3d7b417e88a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:49.722930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beae813-74c3-44be-9b9c-3d7b417e88a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:49.723454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beae813-74c3-44be-9b9c-3d7b417e88a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:49.725172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beae813-74c3-44be-9b9c-3d7b417e88a1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:49.744212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 184/345] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:14:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:49.752773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beae813-74c3-44be-9b9c-3d7b417e88a1 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:49.774301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eda174-817c-4241-8517-2844c8dad36a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:49.835243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:49.867163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d317ecf-9618-42a2-a97a-72a1570d9343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:49.868255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d317ecf-9618-42a2-a97a-72a1570d9343 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:49.868255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d317ecf-9618-42a2-a97a-72a1570d9343 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:49.868422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d317ecf-9618-42a2-a97a-72a1570d9343 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:49.869671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d317ecf-9618-42a2-a97a-72a1570d9343 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:49.871090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d317ecf-9618-42a2-a97a-72a1570d9343 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:49.873082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 162/346] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:49 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:49.878979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d317ecf-9618-42a2-a97a-72a1570d9343 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:49.914802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beae813-74c3-44be-9b9c-3d7b417e88a1 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:49.936429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:49.979797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975c982-f386-44d5-9c05-f5d9ef8a535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:49.980344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975c982-f386-44d5-9c05-f5d9ef8a535b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:49.980625 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975c982-f386-44d5-9c05-f5d9ef8a535b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:49.980906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975c982-f386-44d5-9c05-f5d9ef8a535b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.027627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d317ecf-9618-42a2-a97a-72a1570d9343 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:50.073989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7baf3-23d5-4497-9134-4072931e9f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:50.075417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7baf3-23d5-4497-9134-4072931e9f98 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.075953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7baf3-23d5-4497-9134-4072931e9f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.076453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7baf3-23d5-4497-9134-4072931e9f98 None admin] PATH_INFO: `/v3/groups/6c60720f172c441c8fe03d29b9baf440` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.083999 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975c982-f386-44d5-9c05-f5d9ef8a535b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:50.086065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975c982-f386-44d5-9c05-f5d9ef8a535b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:50.086934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7baf3-23d5-4497-9134-4072931e9f98 None admin] RBAC: Authorizing `identity:get_group(group_id=6c60720f172c441c8fe03d29b9baf440)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:50.088960 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7baf3-23d5-4497-9134-4072931e9f98 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:50.092347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 163/347] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:14:49 2022] GET /identity/v3/groups/6c60720f172c441c8fe03d29b9baf440 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:50.094007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd0c8f-9027-40bf-b1b7-8153f4610146 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.094626 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd0c8f-9027-40bf-b1b7-8153f4610146 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.095222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd0c8f-9027-40bf-b1b7-8153f4610146 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.097987 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 164/348] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:50.099139 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd0c8f-9027-40bf-b1b7-8153f4610146 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:50.151076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:50.226597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 185/349] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:14:50.226597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975c982-f386-44d5-9c05-f5d9ef8a535b None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:50.249349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd0c8f-9027-40bf-b1b7-8153f4610146 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:50.251512 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:50.293845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1295f-ec25-443c-b30b-9771624c1104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:50.294820 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1295f-ec25-443c-b30b-9771624c1104 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.295309 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1295f-ec25-443c-b30b-9771624c1104 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.295881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1295f-ec25-443c-b30b-9771624c1104 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.311213 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1295f-ec25-443c-b30b-9771624c1104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-95d1295f-ec25-443c-b30b-9771624c1104 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:50.316818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:50.317733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:50.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:50.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:50.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:50.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:50.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:50.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:50.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:50.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:50.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:50.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:50.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:50.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:50.322497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 165/350] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:50.323895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0593a-6452-43f8-acf0-0b5bb24ae411 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.324235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0593a-6452-43f8-acf0-0b5bb24ae411 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.324508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0593a-6452-43f8-acf0-0b5bb24ae411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.345042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0fc0593a-6452-43f8-acf0-0b5bb24ae411 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:50.346273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0fc0593a-6452-43f8-acf0-0b5bb24ae411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:50.362279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975c982-f386-44d5-9c05-f5d9ef8a535b None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:50.409057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bb3a3-eec7-45b3-a8c8-7ba2a6352f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:50.409672 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb3a3-eec7-45b3-a8c8-7ba2a6352f9f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.410252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb3a3-eec7-45b3-a8c8-7ba2a6352f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.410252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb3a3-eec7-45b3-a8c8-7ba2a6352f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.411017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bb3a3-eec7-45b3-a8c8-7ba2a6352f9f None admin] RBAC: Adding query filter params (group.id=6c60720f172c441c8fe03d29b9baf440, role.id=c6ff6f013f2f41d78fedabbe698ed13e, scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:50.411320 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bb3a3-eec7-45b3-a8c8-7ba2a6352f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:50.412770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bb3a3-eec7-45b3-a8c8-7ba2a6352f9f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:50.419084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 186/351] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Sep 12 23:14:50 2022] GET /identity/v3/role_assignments?group.id=6c60720f172c441c8fe03d29b9baf440&scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8&role.id=c6ff6f013f2f41d78fedabbe698ed13e => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:50.420286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3deed-b2df-4d38-9ba9-625eef0b5454 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.420573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3deed-b2df-4d38-9ba9-625eef0b5454 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.420845 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3deed-b2df-4d38-9ba9-625eef0b5454 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.422329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 187/352] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:50.423088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3deed-b2df-4d38-9ba9-625eef0b5454 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:50.432545 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 166/353] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:50.433783 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65cee9-05bc-4fe3-80b5-b8ee0424a164 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.434071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65cee9-05bc-4fe3-80b5-b8ee0424a164 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.434355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65cee9-05bc-4fe3-80b5-b8ee0424a164 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.436174 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 167/354] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:50.436993 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65cee9-05bc-4fe3-80b5-b8ee0424a164 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:50.448405 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:50.561770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:50.563069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3deed-b2df-4d38-9ba9-625eef0b5454 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:50.574361 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65cee9-05bc-4fe3-80b5-b8ee0424a164 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:50.616121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348687ef-abad-4499-96e5-4f9fc5eea1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:50.616742 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348687ef-abad-4499-96e5-4f9fc5eea1ba None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.617021 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348687ef-abad-4499-96e5-4f9fc5eea1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.617291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348687ef-abad-4499-96e5-4f9fc5eea1ba None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.618494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348687ef-abad-4499-96e5-4f9fc5eea1ba None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:50.619958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348687ef-abad-4499-96e5-4f9fc5eea1ba None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:50.620416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0b0c5-6e95-4365-a516-69013fa2c957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:50.621594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 188/355] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:50 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:50.621704 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0b0c5-6e95-4365-a516-69013fa2c957 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.621874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0b0c5-6e95-4365-a516-69013fa2c957 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.622154 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0b0c5-6e95-4365-a516-69013fa2c957 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.622866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0b0c5-6e95-4365-a516-69013fa2c957 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:50.623176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0b0c5-6e95-4365-a516-69013fa2c957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:50.623835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e1a30-98bd-4eb7-9fec-bed9658a3783 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.624118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e1a30-98bd-4eb7-9fec-bed9658a3783 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.624391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e1a30-98bd-4eb7-9fec-bed9658a3783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.624571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0b0c5-6e95-4365-a516-69013fa2c957 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:50.634880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 168/356] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:50.635977 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a1b3-434a-4b0d-a34e-314292bff07c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.636633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a1b3-434a-4b0d-a34e-314292bff07c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.636738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a1b3-434a-4b0d-a34e-314292bff07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.654125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ca0e1a30-98bd-4eb7-9fec-bed9658a3783 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:50.655399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ca0e1a30-98bd-4eb7-9fec-bed9658a3783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:50.661278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bdc6a1b3-434a-4b0d-a34e-314292bff07c None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:50.662914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bdc6a1b3-434a-4b0d-a34e-314292bff07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:50.749473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 189/357] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:50.750417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e1a30-98bd-4eb7-9fec-bed9658a3783 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:50.753115 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 169/358] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:50.754189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6a1b3-434a-4b0d-a34e-314292bff07c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:50.772662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:50.871651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e1a30-98bd-4eb7-9fec-bed9658a3783 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:50.924298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027882b6-f84c-4063-b6de-98b78492da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:50.924989 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027882b6-f84c-4063-b6de-98b78492da05 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.925605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027882b6-f84c-4063-b6de-98b78492da05 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.925883 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027882b6-f84c-4063-b6de-98b78492da05 None admin] PATH_INFO: `/v3/groups/6c60720f172c441c8fe03d29b9baf440` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:50.927391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027882b6-f84c-4063-b6de-98b78492da05 None admin] RBAC: Authorizing `identity:get_group(group_id=6c60720f172c441c8fe03d29b9baf440)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:50.929147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027882b6-f84c-4063-b6de-98b78492da05 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:50.931749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 190/359] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:14:50 2022] GET /identity/v3/groups/6c60720f172c441c8fe03d29b9baf440 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:50.934470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:50.935208 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027882b6-f84c-4063-b6de-98b78492da05 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:50.954066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6a1b3-434a-4b0d-a34e-314292bff07c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:50.991845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3edb-b45c-452b-b615-f06f680b19ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:50.992727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3edb-b45c-452b-b615-f06f680b19ad None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:50.993152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3edb-b45c-452b-b615-f06f680b19ad None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:50.993598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3edb-b45c-452b-b615-f06f680b19ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:51.056286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027882b6-f84c-4063-b6de-98b78492da05 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:51.071236 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:51.087911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3edb-b45c-452b-b615-f06f680b19ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:51.089169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3edb-b45c-452b-b615-f06f680b19ad None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:51.108002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f842be-01f7-4462-b440-93c898645e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:51.109772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f842be-01f7-4462-b440-93c898645e22 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:51.110258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f842be-01f7-4462-b440-93c898645e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:51.111552 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f842be-01f7-4462-b440-93c898645e22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:51.126435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f842be-01f7-4462-b440-93c898645e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-30f842be-01f7-4462-b440-93c898645e22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:51.133752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:51.134651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:51.135433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:51.135433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:51.135433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:51.135433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:51.135433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:51.135433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:51.135433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:51.135433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:51.135433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:51.135433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:51.135433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:51.135433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:51.138071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 191/360] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:14:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:51.139597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f842be-01f7-4462-b440-93c898645e22 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:51.204017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:51.223294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 170/361] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:51.223897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3edb-b45c-452b-b615-f06f680b19ad None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:51.270865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f842be-01f7-4462-b440-93c898645e22 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:51.315725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea92b6-5dbd-4c53-a9c1-bbc5f9aff7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:51.316728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea92b6-5dbd-4c53-a9c1-bbc5f9aff7bd None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:51.316728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea92b6-5dbd-4c53-a9c1-bbc5f9aff7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:51.316920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea92b6-5dbd-4c53-a9c1-bbc5f9aff7bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:51.317594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea92b6-5dbd-4c53-a9c1-bbc5f9aff7bd None admin] RBAC: Adding query filter params (group.id=6c60720f172c441c8fe03d29b9baf440, role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a, scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:51.317902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea92b6-5dbd-4c53-a9c1-bbc5f9aff7bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:51.320406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea92b6-5dbd-4c53-a9c1-bbc5f9aff7bd None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:51.321942 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:51.326868 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 192/362] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Sep 12 23:14:51 2022] GET /identity/v3/role_assignments?group.id=6c60720f172c441c8fe03d29b9baf440&scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8&role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:51.333298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea92b6-5dbd-4c53-a9c1-bbc5f9aff7bd None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:51.361234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3edb-b45c-452b-b615-f06f680b19ad None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:51.419590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb0bb-ea4c-4301-bafe-90dc5ecc1fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:51.420915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb0bb-ea4c-4301-bafe-90dc5ecc1fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:51.421911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb0bb-ea4c-4301-bafe-90dc5ecc1fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:51.422715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb0bb-ea4c-4301-bafe-90dc5ecc1fd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:51.442238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eb0bb-ea4c-4301-bafe-90dc5ecc1fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fe3eb0bb-ea4c-4301-bafe-90dc5ecc1fd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:51.449804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:51.450875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:51.451671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:51.451671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:51.451671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:51.451671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:51.451671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:51.451671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:51.451671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:51.451671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:51.451671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:51.451671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:51.451671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:51.451671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:51.455389 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 171/363] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:14:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:51.456725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb0bb-ea4c-4301-bafe-90dc5ecc1fd7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:51.489094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea92b6-5dbd-4c53-a9c1-bbc5f9aff7bd None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:51.536957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:51.545190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fffa0e-f925-4556-96fd-1710dbf665c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:51.545811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fffa0e-f925-4556-96fd-1710dbf665c2 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:51.546090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fffa0e-f925-4556-96fd-1710dbf665c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:51.546360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fffa0e-f925-4556-96fd-1710dbf665c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:51.547059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fffa0e-f925-4556-96fd-1710dbf665c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:51.547364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fffa0e-f925-4556-96fd-1710dbf665c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:51.549359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fffa0e-f925-4556-96fd-1710dbf665c2 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:51.562873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 193/364] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:14:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:51.564405 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fffa0e-f925-4556-96fd-1710dbf665c2 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:51.631134 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb0bb-ea4c-4301-bafe-90dc5ecc1fd7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:51.645085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:51.682168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c98f07-a3b5-4259-870b-d656abaa2951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:51.683155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c98f07-a3b5-4259-870b-d656abaa2951 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:51.683679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c98f07-a3b5-4259-870b-d656abaa2951 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:51.684130 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c98f07-a3b5-4259-870b-d656abaa2951 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:51.702836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c98f07-a3b5-4259-870b-d656abaa2951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:51.703664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fffa0e-f925-4556-96fd-1710dbf665c2 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-13c98f07-a3b5-4259-870b-d656abaa2951 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:51.709779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:51.710685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:51.711451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:51.711451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:51.711451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:51.711451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:51.711451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:51.711451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:51.711451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:51.711451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:51.711451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:51.711451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:51.711451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:14:51.711451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:51.714067 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 172/365] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:51.715694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c98f07-a3b5-4259-870b-d656abaa2951 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:51.752152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221f632-b6ae-46c7-9c6f-05e758f3a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:51.753801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221f632-b6ae-46c7-9c6f-05e758f3a64c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:51.754149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221f632-b6ae-46c7-9c6f-05e758f3a64c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:51.754549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221f632-b6ae-46c7-9c6f-05e758f3a64c None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:51.755777 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221f632-b6ae-46c7-9c6f-05e758f3a64c None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:51.757629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221f632-b6ae-46c7-9c6f-05e758f3a64c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:51.759527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 194/366] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:51 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:51.760907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221f632-b6ae-46c7-9c6f-05e758f3a64c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:51.857703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c98f07-a3b5-4259-870b-d656abaa2951 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:51.880041 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:51.882987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221f632-b6ae-46c7-9c6f-05e758f3a64c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:51.899717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e95a6-ba37-4cec-b8b9-a2db26497fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:51.900259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e95a6-ba37-4cec-b8b9-a2db26497fcd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:51.900537 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e95a6-ba37-4cec-b8b9-a2db26497fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:51.900811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e95a6-ba37-4cec-b8b9-a2db26497fcd None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:51.901747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e95a6-ba37-4cec-b8b9-a2db26497fcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:51.901747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e95a6-ba37-4cec-b8b9-a2db26497fcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:51.903169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e95a6-ba37-4cec-b8b9-a2db26497fcd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:51.912696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 173/367] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:51.913606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e95a6-ba37-4cec-b8b9-a2db26497fcd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:51.917894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:51.927638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a25813-35a1-4c41-8ee5-6748f6f3a602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:51.929027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a25813-35a1-4c41-8ee5-6748f6f3a602 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:51.929509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a25813-35a1-4c41-8ee5-6748f6f3a602 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:51.930007 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a25813-35a1-4c41-8ee5-6748f6f3a602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:52.016128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a25813-35a1-4c41-8ee5-6748f6f3a602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:52.018575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a25813-35a1-4c41-8ee5-6748f6f3a602 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:52.038773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e95a6-ba37-4cec-b8b9-a2db26497fcd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:52.081421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ff4d2-2094-4407-af89-d57b08de2920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:52.082045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff4d2-2094-4407-af89-d57b08de2920 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:52.082322 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff4d2-2094-4407-af89-d57b08de2920 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:52.082623 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff4d2-2094-4407-af89-d57b08de2920 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:52.083294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ff4d2-2094-4407-af89-d57b08de2920 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:52.083769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ff4d2-2094-4407-af89-d57b08de2920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:52.085173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ff4d2-2094-4407-af89-d57b08de2920 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:52.096937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 174/368] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:52.097908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ff4d2-2094-4407-af89-d57b08de2920 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:52.131858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:52.158835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 195/369] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:52.160396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a25813-35a1-4c41-8ee5-6748f6f3a602 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:52.203845 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:52.230172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ff4d2-2094-4407-af89-d57b08de2920 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:52.275871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718aa87-c9cf-4565-b8bb-d0c442b05141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:52.276919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718aa87-c9cf-4565-b8bb-d0c442b05141 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:52.277202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718aa87-c9cf-4565-b8bb-d0c442b05141 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:52.277476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718aa87-c9cf-4565-b8bb-d0c442b05141 None admin] PATH_INFO: `/v3/groups/6c60720f172c441c8fe03d29b9baf440` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:52.278622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718aa87-c9cf-4565-b8bb-d0c442b05141 None admin] RBAC: Authorizing `identity:get_group(group_id=6c60720f172c441c8fe03d29b9baf440)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:52.280698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718aa87-c9cf-4565-b8bb-d0c442b05141 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:52.284687 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 175/370] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:14:52 2022] GET /identity/v3/groups/6c60720f172c441c8fe03d29b9baf440 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:52.285995 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718aa87-c9cf-4565-b8bb-d0c442b05141 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:52.304863 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a25813-35a1-4c41-8ee5-6748f6f3a602 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:52.349243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ad92a-6241-4102-8de6-67221ea1bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:52.349976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ad92a-6241-4102-8de6-67221ea1bd87 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:52.350256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ad92a-6241-4102-8de6-67221ea1bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:52.350634 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ad92a-6241-4102-8de6-67221ea1bd87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:52.402828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:52.410082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718aa87-c9cf-4565-b8bb-d0c442b05141 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:52.446614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ad92a-6241-4102-8de6-67221ea1bd87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:52.448095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ad92a-6241-4102-8de6-67221ea1bd87 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:52.457722 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7b49-6df3-45d8-8f8d-88516044f137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:52.458371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7b49-6df3-45d8-8f8d-88516044f137 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:52.458686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7b49-6df3-45d8-8f8d-88516044f137 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:52.459335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7b49-6df3-45d8-8f8d-88516044f137 None admin] PATH_INFO: `/v3/users/57dd8269a6b34df78dd3acf909296a52` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:52.461890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df7b49-6df3-45d8-8f8d-88516044f137 None admin] RBAC: Authorizing `identity:get_user(user_id=57dd8269a6b34df78dd3acf909296a52)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:52.463706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df7b49-6df3-45d8-8f8d-88516044f137 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:52.465988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 176/371] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:14:52 2022] GET /identity/v3/users/57dd8269a6b34df78dd3acf909296a52 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:52.466783 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7b49-6df3-45d8-8f8d-88516044f137 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:52.480189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:52.574602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 196/372] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:52.575611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ad92a-6241-4102-8de6-67221ea1bd87 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:52.600437 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7b49-6df3-45d8-8f8d-88516044f137 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:52.638665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b890b-cb9b-4fa8-9939-83f6e01307cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:52.639314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b890b-cb9b-4fa8-9939-83f6e01307cc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:52.639597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b890b-cb9b-4fa8-9939-83f6e01307cc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:52.639871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b890b-cb9b-4fa8-9939-83f6e01307cc None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:52.641015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b890b-cb9b-4fa8-9939-83f6e01307cc None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:52.644143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b890b-cb9b-4fa8-9939-83f6e01307cc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:52.646191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 177/373] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:52 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:52.647008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b890b-cb9b-4fa8-9939-83f6e01307cc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:52.681873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:52.687808 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ad92a-6241-4102-8de6-67221ea1bd87 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:52.720035 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:52.729955 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afdb19-7801-4cdb-b799-2c9b56e7d48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:52.730597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afdb19-7801-4cdb-b799-2c9b56e7d48f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:52.730879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afdb19-7801-4cdb-b799-2c9b56e7d48f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:52.731153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afdb19-7801-4cdb-b799-2c9b56e7d48f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:52.732001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afdb19-7801-4cdb-b799-2c9b56e7d48f None admin] RBAC: Adding query filter params (group.id=6c60720f172c441c8fe03d29b9baf440, role.id=c6ff6f013f2f41d78fedabbe698ed13e, scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:52.732311 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afdb19-7801-4cdb-b799-2c9b56e7d48f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:52.733890 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afdb19-7801-4cdb-b799-2c9b56e7d48f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:52.740197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 197/374] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Sep 12 23:14:52 2022] GET /identity/v3/role_assignments?group.id=6c60720f172c441c8fe03d29b9baf440&scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23&role.id=c6ff6f013f2f41d78fedabbe698ed13e => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:52.741020 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afdb19-7801-4cdb-b799-2c9b56e7d48f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:52.760042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b890b-cb9b-4fa8-9939-83f6e01307cc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:52.810607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bedd4-2dfe-4eac-8169-419793440230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:52.811297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bedd4-2dfe-4eac-8169-419793440230 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:52.811584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bedd4-2dfe-4eac-8169-419793440230 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:52.811859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bedd4-2dfe-4eac-8169-419793440230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:52.812615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bedd4-2dfe-4eac-8169-419793440230 None admin] RBAC: Adding query filter params (role.id=cca59383436e4294a41556fbdf237853, user.id=57dd8269a6b34df78dd3acf909296a52, scope.system=all) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:52.812925 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bedd4-2dfe-4eac-8169-419793440230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:52.816234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bedd4-2dfe-4eac-8169-419793440230 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:52.842828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 178/375] 10.222.0.33 () {56 vars in 1308 bytes} [Mon Sep 12 23:14:52 2022] GET /identity/v3/role_assignments?user.id=57dd8269a6b34df78dd3acf909296a52&scope.system=all&role.id=cca59383436e4294a41556fbdf237853 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:52.843751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bedd4-2dfe-4eac-8169-419793440230 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:52.943262 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afdb19-7801-4cdb-b799-2c9b56e7d48f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:52.983754 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b918845-009f-4d43-9e11-60e6e51be4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:52.984396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b918845-009f-4d43-9e11-60e6e51be4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:52.984678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b918845-009f-4d43-9e11-60e6e51be4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:52.985062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b918845-009f-4d43-9e11-60e6e51be4a4 None admin] PATH_INFO: `/v3/projects/0a803ea5f3c94589b38112108dcb63f7` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:52.986389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b918845-009f-4d43-9e11-60e6e51be4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=0a803ea5f3c94589b38112108dcb63f7)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:52.987883 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b918845-009f-4d43-9e11-60e6e51be4a4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:52.992232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 198/376] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:52 2022] GET /identity/v3/projects/0a803ea5f3c94589b38112108dcb63f7 => generated 344 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:52.996386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:52.997885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b918845-009f-4d43-9e11-60e6e51be4a4 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:53.007058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bedd4-2dfe-4eac-8169-419793440230 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:53.050855 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0649a5-e8f4-460f-95aa-c982d0ea4a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:53.051536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0649a5-e8f4-460f-95aa-c982d0ea4a99 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:53.051821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0649a5-e8f4-460f-95aa-c982d0ea4a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:53.052100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0649a5-e8f4-460f-95aa-c982d0ea4a99 None admin] PATH_INFO: `/v3/groups/6c60720f172c441c8fe03d29b9baf440` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:53.053412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0649a5-e8f4-460f-95aa-c982d0ea4a99 None admin] RBAC: Authorizing `identity:get_group(group_id=6c60720f172c441c8fe03d29b9baf440)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:53.055761 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0649a5-e8f4-460f-95aa-c982d0ea4a99 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:53.057825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 179/377] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:14:52 2022] GET /identity/v3/groups/6c60720f172c441c8fe03d29b9baf440 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:53.063433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0649a5-e8f4-460f-95aa-c982d0ea4a99 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:53.075762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:53.128442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b918845-009f-4d43-9e11-60e6e51be4a4 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:53.169166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad751d3-37ae-499c-8981-c2a95d7a5e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:53.170151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad751d3-37ae-499c-8981-c2a95d7a5e27 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:53.170646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad751d3-37ae-499c-8981-c2a95d7a5e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:53.171103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad751d3-37ae-499c-8981-c2a95d7a5e27 None admin] PATH_INFO: `/v3/groups/c8455fd344b64699b0e3b9f17a1b1975` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:53.179186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad751d3-37ae-499c-8981-c2a95d7a5e27 None admin] RBAC: Authorizing `identity:get_group(group_id=c8455fd344b64699b0e3b9f17a1b1975)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:53.181130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad751d3-37ae-499c-8981-c2a95d7a5e27 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:53.183033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 199/378] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:14:52 2022] GET /identity/v3/groups/c8455fd344b64699b0e3b9f17a1b1975 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:53.185501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0649a5-e8f4-460f-95aa-c982d0ea4a99 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:53.189941 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad751d3-37ae-499c-8981-c2a95d7a5e27 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:53.224432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db940550-f070-415f-bf8d-74abe32a16ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:53.225060 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db940550-f070-415f-bf8d-74abe32a16ab None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:53.225447 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db940550-f070-415f-bf8d-74abe32a16ab None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:53.225727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db940550-f070-415f-bf8d-74abe32a16ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:53.226493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db940550-f070-415f-bf8d-74abe32a16ab None admin] RBAC: Adding query filter params (group.id=6c60720f172c441c8fe03d29b9baf440, role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a, scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:53.226894 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db940550-f070-415f-bf8d-74abe32a16ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:53.228367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db940550-f070-415f-bf8d-74abe32a16ab None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:53.234773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 180/379] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Sep 12 23:14:53 2022] GET /identity/v3/role_assignments?group.id=6c60720f172c441c8fe03d29b9baf440&scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23&role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:53.260632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221384d-d7f1-418b-9ef0-591cdfd55dab None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:53.261224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221384d-d7f1-418b-9ef0-591cdfd55dab None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:53.261331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221384d-d7f1-418b-9ef0-591cdfd55dab None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:53.263196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 181/380] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:53.268860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcf58a-9611-4c27-880b-dea10a518779 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:53.269241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcf58a-9611-4c27-880b-dea10a518779 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:53.269617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcf58a-9611-4c27-880b-dea10a518779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:53.299889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-74dcf58a-9611-4c27-880b-dea10a518779 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:53.301296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-74dcf58a-9611-4c27-880b-dea10a518779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:53.311280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad751d3-37ae-499c-8981-c2a95d7a5e27 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:53.329138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:53.353908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2e92-c22d-4af4-abd2-2113928f41eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:53.354873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2e92-c22d-4af4-abd2-2113928f41eb None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:53.355409 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2e92-c22d-4af4-abd2-2113928f41eb None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:53.359139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:53.359562 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2e92-c22d-4af4-abd2-2113928f41eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:53.361605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd2e92-c22d-4af4-abd2-2113928f41eb None admin] RBAC: Adding query filter params (group.id=c8455fd344b64699b0e3b9f17a1b1975, role.id=6413aac4240a46ba816472c29e305973, scope.project.id=0a803ea5f3c94589b38112108dcb63f7) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:53.362286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd2e92-c22d-4af4-abd2-2113928f41eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:53.364074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd2e92-c22d-4af4-abd2-2113928f41eb None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:53.370717 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 200/381] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Sep 12 23:14:53 2022] GET /identity/v3/role_assignments?group.id=c8455fd344b64699b0e3b9f17a1b1975&scope.project.id=0a803ea5f3c94589b38112108dcb63f7&role.id=6413aac4240a46ba816472c29e305973 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:53.414471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 182/382] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:14:53.788460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2e92-c22d-4af4-abd2-2113928f41eb None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:53.913346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2e92-c22d-4af4-abd2-2113928f41eb None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:53.964064 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e722ad-e3dc-4e37-a325-78494857af9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:53.964728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e722ad-e3dc-4e37-a325-78494857af9d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:53.965000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e722ad-e3dc-4e37-a325-78494857af9d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:53.965275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e722ad-e3dc-4e37-a325-78494857af9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:53.983568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e722ad-e3dc-4e37-a325-78494857af9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-17e722ad-e3dc-4e37-a325-78494857af9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:53.990105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:53.991203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:53.992028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 201/383] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:53.997569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcf58a-9611-4c27-880b-dea10a518779 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:54.092059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faf667-d999-47d2-b9f5-f87924886cfc None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:54.092366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faf667-d999-47d2-b9f5-f87924886cfc None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:54.092555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faf667-d999-47d2-b9f5-f87924886cfc None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:54.093925 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 202/384] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:54.105791 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b13182-da85-43ff-903e-baebb8cf2c7c None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:54.106214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b13182-da85-43ff-903e-baebb8cf2c7c None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:54.106516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b13182-da85-43ff-903e-baebb8cf2c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:54.125448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcf58a-9611-4c27-880b-dea10a518779 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:54.140416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-54b13182-da85-43ff-903e-baebb8cf2c7c None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:54.142430 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-54b13182-da85-43ff-903e-baebb8cf2c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:54.170866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c38013-203f-4ecf-a920-43416d810072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:54.171478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c38013-203f-4ecf-a920-43416d810072 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:54.171752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c38013-203f-4ecf-a920-43416d810072 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:54.172018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c38013-203f-4ecf-a920-43416d810072 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:54.172678 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c38013-203f-4ecf-a920-43416d810072 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:54.172973 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c38013-203f-4ecf-a920-43416d810072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:54.174917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c38013-203f-4ecf-a920-43416d810072 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:54.191914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 183/385] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:54.197506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c38013-203f-4ecf-a920-43416d810072 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:54.224328 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:54.229466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:54.278859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 203/386] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:54.361435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c38013-203f-4ecf-a920-43416d810072 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:54.418111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2b69b-db87-4112-898b-9645940bea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:54.418776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2b69b-db87-4112-898b-9645940bea61 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:54.419052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2b69b-db87-4112-898b-9645940bea61 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:54.419323 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2b69b-db87-4112-898b-9645940bea61 None admin] PATH_INFO: `/v3/groups/6c60720f172c441c8fe03d29b9baf440` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:54.420450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2b69b-db87-4112-898b-9645940bea61 None admin] RBAC: Authorizing `identity:get_group(group_id=6c60720f172c441c8fe03d29b9baf440)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:54.421898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2b69b-db87-4112-898b-9645940bea61 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:54.423634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 184/387] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:14:54 2022] GET /identity/v3/groups/6c60720f172c441c8fe03d29b9baf440 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:54.429397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b13182-da85-43ff-903e-baebb8cf2c7c None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:54.576095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b13182-da85-43ff-903e-baebb8cf2c7c None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:54.617893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff96cd3-6cc8-4678-9c26-8c6f2359e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:54.618927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff96cd3-6cc8-4678-9c26-8c6f2359e3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:54.619409 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff96cd3-6cc8-4678-9c26-8c6f2359e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:54.619893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff96cd3-6cc8-4678-9c26-8c6f2359e3c1 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:54.621250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff96cd3-6cc8-4678-9c26-8c6f2359e3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:54.622947 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff96cd3-6cc8-4678-9c26-8c6f2359e3c1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:54.624826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 204/388] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:54 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:54.631386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2b69b-db87-4112-898b-9645940bea61 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:54.680412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff96cd3-6cc8-4678-9c26-8c6f2359e3c1 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:54.762768 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:54.771449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:54.805336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2b69b-db87-4112-898b-9645940bea61 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:54.839475 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff96cd3-6cc8-4678-9c26-8c6f2359e3c1 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:54.844764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386c1c-98a8-47ec-a0f8-e9845df2fc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:54.845775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386c1c-98a8-47ec-a0f8-e9845df2fc88 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:54.846284 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386c1c-98a8-47ec-a0f8-e9845df2fc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:54.846784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386c1c-98a8-47ec-a0f8-e9845df2fc88 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8/groups/6c60720f172c441c8fe03d29b9baf440/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:54.850150 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f386c1c-98a8-47ec-a0f8-e9845df2fc88 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8, group_id=6c60720f172c441c8fe03d29b9baf440, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:54.851970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f386c1c-98a8-47ec-a0f8-e9845df2fc88 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:54.868583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 185/389] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Sep 12 23:14:54 2022] PUT /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8/groups/6c60720f172c441c8fe03d29b9baf440/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:14:54.882183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4852c-bfd3-4163-aa51-330ab634fdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:54.882970 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4852c-bfd3-4163-aa51-330ab634fdb5 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:54.883250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4852c-bfd3-4163-aa51-330ab634fdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:54.883523 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4852c-bfd3-4163-aa51-330ab634fdb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:54.903810 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4852c-bfd3-4163-aa51-330ab634fdb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-83d4852c-bfd3-4163-aa51-330ab634fdb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:54.909103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:54.910043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:54.910852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 205/390] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:14:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:14:54.918345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386c1c-98a8-47ec-a0f8-e9845df2fc88 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:55.068990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386c1c-98a8-47ec-a0f8-e9845df2fc88 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:55.106561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c957b5-bdd8-4b4f-9442-7f99c67dc744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:55.107551 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c957b5-bdd8-4b4f-9442-7f99c67dc744 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:55.108044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c957b5-bdd8-4b4f-9442-7f99c67dc744 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:55.108540 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c957b5-bdd8-4b4f-9442-7f99c67dc744 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:55.109438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c957b5-bdd8-4b4f-9442-7f99c67dc744 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:55.109952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c957b5-bdd8-4b4f-9442-7f99c67dc744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:55.112381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c957b5-bdd8-4b4f-9442-7f99c67dc744 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:55.126739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 186/391] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:14:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:55.128920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4852c-bfd3-4163-aa51-330ab634fdb5 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:55.256538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4852c-bfd3-4163-aa51-330ab634fdb5 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:55.264032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:55.293406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aa171-0331-484f-a21b-3e8ff95ed0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:55.294044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aa171-0331-484f-a21b-3e8ff95ed0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:55.294327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aa171-0331-484f-a21b-3e8ff95ed0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:55.294633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aa171-0331-484f-a21b-3e8ff95ed0e2 None admin] PATH_INFO: `/v3/groups/6c60720f172c441c8fe03d29b9baf440` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:55.295746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5aa171-0331-484f-a21b-3e8ff95ed0e2 None admin] RBAC: Authorizing `identity:get_group(group_id=6c60720f172c441c8fe03d29b9baf440)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:55.297212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5aa171-0331-484f-a21b-3e8ff95ed0e2 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:55.299490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 206/392] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:14:55 2022] GET /identity/v3/groups/6c60720f172c441c8fe03d29b9baf440 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:55.305559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c957b5-bdd8-4b4f-9442-7f99c67dc744 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:55.312334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:55.461967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c957b5-bdd8-4b4f-9442-7f99c67dc744 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:55.509603 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8d9ca-3229-49b6-bcea-dbb73a128f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:55.510267 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8d9ca-3229-49b6-bcea-dbb73a128f65 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:55.510575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8d9ca-3229-49b6-bcea-dbb73a128f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:55.510840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8d9ca-3229-49b6-bcea-dbb73a128f65 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:55.512005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8d9ca-3229-49b6-bcea-dbb73a128f65 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:55.513472 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8d9ca-3229-49b6-bcea-dbb73a128f65 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:55.515571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 187/393] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:55 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:55.521876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aa171-0331-484f-a21b-3e8ff95ed0e2 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:55.638942 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aa171-0331-484f-a21b-3e8ff95ed0e2 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:55.677919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcec2fd-ea77-45da-ab55-14bf3b5b930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:55.678987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcec2fd-ea77-45da-ab55-14bf3b5b930b None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:55.679460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcec2fd-ea77-45da-ab55-14bf3b5b930b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:55.679942 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcec2fd-ea77-45da-ab55-14bf3b5b930b None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8/groups/6c60720f172c441c8fe03d29b9baf440/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:55.682454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcec2fd-ea77-45da-ab55-14bf3b5b930b None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8, group_id=6c60720f172c441c8fe03d29b9baf440, role_id=ac7eb9c247e94edda4cd6ad66b5e6a9a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:55.684294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcec2fd-ea77-45da-ab55-14bf3b5b930b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:55.706783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 207/394] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Sep 12 23:14:55 2022] PUT /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8/groups/6c60720f172c441c8fe03d29b9baf440/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:14:56.075385 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ef1e1-6c98-40bc-a62c-93fe88fb229e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:56.076103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ef1e1-6c98-40bc-a62c-93fe88fb229e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:56.076594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ef1e1-6c98-40bc-a62c-93fe88fb229e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:56.078430 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 188/395] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:56.084781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdd62b-cdf3-4a8e-863a-2097e72188cf None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:56.085331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdd62b-cdf3-4a8e-863a-2097e72188cf None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:56.085813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdd62b-cdf3-4a8e-863a-2097e72188cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:56.112180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-7cbdd62b-cdf3-4a8e-863a-2097e72188cf None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:56.113773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7cbdd62b-cdf3-4a8e-863a-2097e72188cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:56.153415 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:56.218956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 208/396] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:56.227206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab07381-870a-4da6-b28c-80802d402fd7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:56.227481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab07381-870a-4da6-b28c-80802d402fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:56.227760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab07381-870a-4da6-b28c-80802d402fd7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:56.229224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 189/397] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:56.240785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924df4-b270-4535-9e46-4ab2bbdbb8cc None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:56.241368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924df4-b270-4535-9e46-4ab2bbdbb8cc None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:56.241841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924df4-b270-4535-9e46-4ab2bbdbb8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:56.251961 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86c4a8-48a7-4703-90b4-e875448b18b2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:56.252310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86c4a8-48a7-4703-90b4-e875448b18b2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:56.252592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86c4a8-48a7-4703-90b4-e875448b18b2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:56.254170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 190/398] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:56.259222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ec649-972a-4db9-ac73-ef53cfd4fbb3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:56.259507 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ec649-972a-4db9-ac73-ef53cfd4fbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:56.259785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ec649-972a-4db9-ac73-ef53cfd4fbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:56.267302 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-dc924df4-b270-4535-9e46-4ab2bbdbb8cc None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:56.268452 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-dc924df4-b270-4535-9e46-4ab2bbdbb8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:56.291720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-433ec649-972a-4db9-ac73-ef53cfd4fbb3 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:56.291720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-433ec649-972a-4db9-ac73-ef53cfd4fbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:56.383780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 209/399] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:56.452840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 191/400] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:56.495005 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924df4-b270-4535-9e46-4ab2bbdbb8cc None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:56.628478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:56.635605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924df4-b270-4535-9e46-4ab2bbdbb8cc None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:56.670963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ec649-972a-4db9-ac73-ef53cfd4fbb3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:56.674566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:56.696224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb1fa5-e503-486e-85d6-7c142b565083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:56.696869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb1fa5-e503-486e-85d6-7c142b565083 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:56.697151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb1fa5-e503-486e-85d6-7c142b565083 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:56.697423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb1fa5-e503-486e-85d6-7c142b565083 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:56.718450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb1fa5-e503-486e-85d6-7c142b565083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-3edb1fa5-e503-486e-85d6-7c142b565083 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:56.723929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:56.724771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:56.725549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 210/401] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:56.731898 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb1fa5-e503-486e-85d6-7c142b565083 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:56.844327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb1fa5-e503-486e-85d6-7c142b565083 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:56.848024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ec649-972a-4db9-ac73-ef53cfd4fbb3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:56.891014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb187b0-6498-4319-a8e0-c40ff46c3555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:56.891209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff00e7-041d-4f6c-b5a5-1700f7f73a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:56.891697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff00e7-041d-4f6c-b5a5-1700f7f73a8b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:56.892617 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff00e7-041d-4f6c-b5a5-1700f7f73a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:56.892894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff00e7-041d-4f6c-b5a5-1700f7f73a8b None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:56.893394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb187b0-6498-4319-a8e0-c40ff46c3555 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:56.893572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff00e7-041d-4f6c-b5a5-1700f7f73a8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:56.893869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff00e7-041d-4f6c-b5a5-1700f7f73a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:56.894221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb187b0-6498-4319-a8e0-c40ff46c3555 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:56.894707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb187b0-6498-4319-a8e0-c40ff46c3555 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:56.896473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff00e7-041d-4f6c-b5a5-1700f7f73a8b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:56.905942 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 211/402] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:56.906474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb187b0-6498-4319-a8e0-c40ff46c3555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:56.906894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff00e7-041d-4f6c-b5a5-1700f7f73a8b None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3cb187b0-6498-4319-a8e0-c40ff46c3555 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:56.911919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:56.912780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:56.913535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:56.913535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:56.913535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:56.913535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:56.913535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:56.913535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:56.913535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:56.913535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:56.913535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:56.913535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:56.913535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:14:56.913535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:56.916063 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 192/403] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:14:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:14:56.917023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb187b0-6498-4319-a8e0-c40ff46c3555 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:56.933094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:57.012339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:57.038552 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff00e7-041d-4f6c-b5a5-1700f7f73a8b None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:57.065331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb187b0-6498-4319-a8e0-c40ff46c3555 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:57.077746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552475b-3cc3-4f6d-a342-d579ae16937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:57.078797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552475b-3cc3-4f6d-a342-d579ae16937b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:57.079921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552475b-3cc3-4f6d-a342-d579ae16937b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:57.080583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552475b-3cc3-4f6d-a342-d579ae16937b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:57.092552 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552475b-3cc3-4f6d-a342-d579ae16937b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-9552475b-3cc3-4f6d-a342-d579ae16937b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:57.099407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:57.100250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:57.101009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:57.101009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:57.101009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:57.101009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:57.101009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:57.101009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:57.101009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:57.101009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:57.101009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:57.101009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:57.101009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:57.101009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:57.104378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 212/404] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:14:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:57.105339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552475b-3cc3-4f6d-a342-d579ae16937b None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:57.112835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db5d04-6d27-4b07-8431-05b4cbe2615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:57.113725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db5d04-6d27-4b07-8431-05b4cbe2615e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:57.114191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db5d04-6d27-4b07-8431-05b4cbe2615e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:57.114705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db5d04-6d27-4b07-8431-05b4cbe2615e None admin] PATH_INFO: `/v3/groups/6c60720f172c441c8fe03d29b9baf440` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:57.116019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db5d04-6d27-4b07-8431-05b4cbe2615e None admin] RBAC: Authorizing `identity:get_group(group_id=6c60720f172c441c8fe03d29b9baf440)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:57.117656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db5d04-6d27-4b07-8431-05b4cbe2615e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:57.119463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 193/405] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:14:56 2022] GET /identity/v3/groups/6c60720f172c441c8fe03d29b9baf440 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:57.120403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db5d04-6d27-4b07-8431-05b4cbe2615e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:57.200813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:57.226576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db5d04-6d27-4b07-8431-05b4cbe2615e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:57.229910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552475b-3cc3-4f6d-a342-d579ae16937b None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:57.258487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:57.266498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fc546-6499-4555-baf9-2a79c62b4782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:57.267622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fc546-6499-4555-baf9-2a79c62b4782 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:57.268113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fc546-6499-4555-baf9-2a79c62b4782 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:57.268587 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fc546-6499-4555-baf9-2a79c62b4782 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:57.269439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fc546-6499-4555-baf9-2a79c62b4782 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:57.269553 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebc299-53b9-433e-a41a-3ddce676f59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:57.270061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fc546-6499-4555-baf9-2a79c62b4782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:57.270181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebc299-53b9-433e-a41a-3ddce676f59d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:57.270389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebc299-53b9-433e-a41a-3ddce676f59d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:57.270664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebc299-53b9-433e-a41a-3ddce676f59d None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:57.271340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebc299-53b9-433e-a41a-3ddce676f59d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:57.271646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebc299-53b9-433e-a41a-3ddce676f59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:57.272539 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fc546-6499-4555-baf9-2a79c62b4782 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:57.273004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebc299-53b9-433e-a41a-3ddce676f59d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:57.281784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 213/407] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:57.281952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 194/407] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:14:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:57.287847 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebc299-53b9-433e-a41a-3ddce676f59d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:57.288642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fc546-6499-4555-baf9-2a79c62b4782 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:57.405384 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fc546-6499-4555-baf9-2a79c62b4782 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:57.410846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebc299-53b9-433e-a41a-3ddce676f59d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:57.442357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67960a62-3ba4-4ed5-9ebd-79859d9648ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:57.443346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67960a62-3ba4-4ed5-9ebd-79859d9648ca None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:57.443837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67960a62-3ba4-4ed5-9ebd-79859d9648ca None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:57.444311 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67960a62-3ba4-4ed5-9ebd-79859d9648ca None admin] PATH_INFO: `/v3/groups/c8455fd344b64699b0e3b9f17a1b1975` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:57.445632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67960a62-3ba4-4ed5-9ebd-79859d9648ca None admin] RBAC: Authorizing `identity:get_group(group_id=c8455fd344b64699b0e3b9f17a1b1975)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:57.447310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67960a62-3ba4-4ed5-9ebd-79859d9648ca None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:57.449369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 195/408] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:14:57 2022] GET /identity/v3/groups/c8455fd344b64699b0e3b9f17a1b1975 => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:57.449491 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90521428-7b0f-4b15-9d45-a55986e30773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:57.450072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90521428-7b0f-4b15-9d45-a55986e30773 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:57.450361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90521428-7b0f-4b15-9d45-a55986e30773 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:57.450953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67960a62-3ba4-4ed5-9ebd-79859d9648ca None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:57.455085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90521428-7b0f-4b15-9d45-a55986e30773 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:57.456353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90521428-7b0f-4b15-9d45-a55986e30773 None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:57.457816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90521428-7b0f-4b15-9d45-a55986e30773 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:57.459799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 214/409] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:57 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:57.467413 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90521428-7b0f-4b15-9d45-a55986e30773 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:57.478577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:57.520637 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:57.566885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67960a62-3ba4-4ed5-9ebd-79859d9648ca None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:57.592011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90521428-7b0f-4b15-9d45-a55986e30773 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:57.608649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c8f8e-5475-4f80-b85b-fa439673d981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:57.609686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c8f8e-5475-4f80-b85b-fa439673d981 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:57.609984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c8f8e-5475-4f80-b85b-fa439673d981 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:57.610269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c8f8e-5475-4f80-b85b-fa439673d981 None admin] PATH_INFO: `/v3/groups/6c60720f172c441c8fe03d29b9baf440` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:57.611972 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c8f8e-5475-4f80-b85b-fa439673d981 None admin] RBAC: Authorizing `identity:get_group(group_id=6c60720f172c441c8fe03d29b9baf440)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:57.614016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c8f8e-5475-4f80-b85b-fa439673d981 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:57.616447 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 196/410] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:14:57 2022] GET /identity/v3/groups/6c60720f172c441c8fe03d29b9baf440 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:57.617746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c8f8e-5475-4f80-b85b-fa439673d981 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:57.633458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069c5d2-c525-4856-9c72-3f6f425f9f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:57.634164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069c5d2-c525-4856-9c72-3f6f425f9f43 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:57.634484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069c5d2-c525-4856-9c72-3f6f425f9f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:57.634765 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069c5d2-c525-4856-9c72-3f6f425f9f43 None admin] PATH_INFO: `/v3/projects/0a803ea5f3c94589b38112108dcb63f7` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:57.635896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069c5d2-c525-4856-9c72-3f6f425f9f43 None admin] RBAC: Authorizing `identity:get_project(project_id=0a803ea5f3c94589b38112108dcb63f7)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:57.637334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069c5d2-c525-4856-9c72-3f6f425f9f43 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:57.645608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 215/411] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:57 2022] GET /identity/v3/projects/0a803ea5f3c94589b38112108dcb63f7 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:57.646513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069c5d2-c525-4856-9c72-3f6f425f9f43 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:57.733539 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:57.737121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c8f8e-5475-4f80-b85b-fa439673d981 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:57.766130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069c5d2-c525-4856-9c72-3f6f425f9f43 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:57.767990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:57.781307 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06415abb-5221-4b52-a3f8-dee34fa0d966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:57.782011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06415abb-5221-4b52-a3f8-dee34fa0d966 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:57.782289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06415abb-5221-4b52-a3f8-dee34fa0d966 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:57.782998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06415abb-5221-4b52-a3f8-dee34fa0d966 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23/groups/6c60720f172c441c8fe03d29b9baf440/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:57.786245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06415abb-5221-4b52-a3f8-dee34fa0d966 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5f1cb41b1834dee86dc7f0ae7165f23, group_id=6c60720f172c441c8fe03d29b9baf440, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:57.788120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06415abb-5221-4b52-a3f8-dee34fa0d966 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:57.812883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 197/412] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Sep 12 23:14:57 2022] PUT /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23/groups/6c60720f172c441c8fe03d29b9baf440/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:14:57.822628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06415abb-5221-4b52-a3f8-dee34fa0d966 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:57.823711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96fa87-9ea5-462a-b5b2-abeed8a48f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:57.824672 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96fa87-9ea5-462a-b5b2-abeed8a48f54 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:57.825448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96fa87-9ea5-462a-b5b2-abeed8a48f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:57.825968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96fa87-9ea5-462a-b5b2-abeed8a48f54 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:57.828769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96fa87-9ea5-462a-b5b2-abeed8a48f54 None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:57.831683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96fa87-9ea5-462a-b5b2-abeed8a48f54 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:57.833953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 216/413] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:57 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:57.840383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96fa87-9ea5-462a-b5b2-abeed8a48f54 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:58.000645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96fa87-9ea5-462a-b5b2-abeed8a48f54 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:58.007321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06415abb-5221-4b52-a3f8-dee34fa0d966 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:58.045133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73ade6-4759-4e43-b258-9c52365136ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:58.046120 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73ade6-4759-4e43-b258-9c52365136ea None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:58.046419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73ade6-4759-4e43-b258-9c52365136ea None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:58.046705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73ade6-4759-4e43-b258-9c52365136ea None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23/groups/6c60720f172c441c8fe03d29b9baf440/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:58.049144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73ade6-4759-4e43-b258-9c52365136ea None admin] RBAC: Authorizing `identity:create_grant(project_id=e5f1cb41b1834dee86dc7f0ae7165f23, group_id=6c60720f172c441c8fe03d29b9baf440, role_id=ac7eb9c247e94edda4cd6ad66b5e6a9a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:58.050677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73ade6-4759-4e43-b258-9c52365136ea None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:58.063432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ecd92-7ef4-4e16-8606-fa60d132fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:58.064669 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ecd92-7ef4-4e16-8606-fa60d132fb7e None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:58.064962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ecd92-7ef4-4e16-8606-fa60d132fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:58.065234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ecd92-7ef4-4e16-8606-fa60d132fb7e None admin] PATH_INFO: `/v3/projects/0a803ea5f3c94589b38112108dcb63f7/groups/c8455fd344b64699b0e3b9f17a1b1975/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:58.068300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ecd92-7ef4-4e16-8606-fa60d132fb7e None admin] RBAC: Authorizing `identity:create_grant(project_id=0a803ea5f3c94589b38112108dcb63f7, group_id=c8455fd344b64699b0e3b9f17a1b1975, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:58.069294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 217/414] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Sep 12 23:14:57 2022] PUT /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23/groups/6c60720f172c441c8fe03d29b9baf440/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:14:58.069876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ecd92-7ef4-4e16-8606-fa60d132fb7e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:58.071119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e9136-e7c7-4fe2-957c-6c81eac498c0 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:58.071633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e9136-e7c7-4fe2-957c-6c81eac498c0 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:58.072093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e9136-e7c7-4fe2-957c-6c81eac498c0 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:58.074759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 218/415] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:58.083070 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3922ab-7034-45d3-837f-259882361944 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:58.084174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3922ab-7034-45d3-837f-259882361944 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:58.084655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3922ab-7034-45d3-837f-259882361944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:58.088695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 198/416] 10.222.0.33 () {58 vars in 1442 bytes} [Mon Sep 12 23:14:57 2022] PUT /identity/v3/projects/0a803ea5f3c94589b38112108dcb63f7/groups/c8455fd344b64699b0e3b9f17a1b1975/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:14:58.092977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:58.109384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-2f3922ab-7034-45d3-837f-259882361944 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:58.111122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2f3922ab-7034-45d3-837f-259882361944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:58.201212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f155b-a21f-479f-b57b-b2286e190d50 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:58.201502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f155b-a21f-479f-b57b-b2286e190d50 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:58.201776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f155b-a21f-479f-b57b-b2286e190d50 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:58.203465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 199/417] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:14:58.210339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772d4b2-1adb-4d2e-8ba4-21bdbec16593 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:58.210657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772d4b2-1adb-4d2e-8ba4-21bdbec16593 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:58.210943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772d4b2-1adb-4d2e-8ba4-21bdbec16593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:58.213618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 219/418] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:14:58.251848 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9772d4b2-1adb-4d2e-8ba4-21bdbec16593 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:14:58.253059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9772d4b2-1adb-4d2e-8ba4-21bdbec16593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:14:58.311393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:58.340050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 200/419] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 12 23:14:58.622638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3922ab-7034-45d3-837f-259882361944 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:58.648650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772d4b2-1adb-4d2e-8ba4-21bdbec16593 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:58.770423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3922ab-7034-45d3-837f-259882361944 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:58.809774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4632d-55db-4628-88bf-a1f64136b4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:58.810796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4632d-55db-4628-88bf-a1f64136b4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:58.811299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4632d-55db-4628-88bf-a1f64136b4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:58.811765 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4632d-55db-4628-88bf-a1f64136b4d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:58.814695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:58.825335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4632d-55db-4628-88bf-a1f64136b4d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-8ee4632d-55db-4628-88bf-a1f64136b4d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:58.831502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:58.832374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:58.833143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:58.833143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:58.833143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:58.833143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:58.833143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:58.833143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:58.833143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:58.833143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:58.833143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:58.833143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:58.833143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:14:58.833143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:14:58.835412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 220/420] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:14:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:58.836642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772d4b2-1adb-4d2e-8ba4-21bdbec16593 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:58.844674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4632d-55db-4628-88bf-a1f64136b4d0 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:58.907153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704ac89-c3cd-4803-ad9d-43b706dc1b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:58.908248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704ac89-c3cd-4803-ad9d-43b706dc1b33 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:58.908527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704ac89-c3cd-4803-ad9d-43b706dc1b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:58.908795 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704ac89-c3cd-4803-ad9d-43b706dc1b33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:58.931978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704ac89-c3cd-4803-ad9d-43b706dc1b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f704ac89-c3cd-4803-ad9d-43b706dc1b33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:14:58.936819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:14:58.937708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:14:58.938510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:14:58.938510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:14:58.938510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:14:58.938510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:14:58.938510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:14:58.938510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:14:58.938510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:14:58.938510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:14:58.938510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:14:58.938510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:14:58.938510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:14:58.938510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:14:58.943233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 201/421] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:14:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:14:58.946562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704ac89-c3cd-4803-ad9d-43b706dc1b33 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:59.025061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:59.043303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4632d-55db-4628-88bf-a1f64136b4d0 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:59.113321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9636-5161-46e2-a74b-e802c9eb388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:59.113954 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9636-5161-46e2-a74b-e802c9eb388a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:59.114234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9636-5161-46e2-a74b-e802c9eb388a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:59.114536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9636-5161-46e2-a74b-e802c9eb388a None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:59.115216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe9636-5161-46e2-a74b-e802c9eb388a None admin] RBAC: Adding query filter params (name=member) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:59.115523 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe9636-5161-46e2-a74b-e802c9eb388a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:59.116930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe9636-5161-46e2-a74b-e802c9eb388a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:59.135664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704ac89-c3cd-4803-ad9d-43b706dc1b33 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:59.143251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 221/422] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:14:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:59.149705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9636-5161-46e2-a74b-e802c9eb388a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:59.207634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe9d5a-7e1e-4c1d-ac93-342a321b8d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:59.208159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe9d5a-7e1e-4c1d-ac93-342a321b8d07 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:59.208441 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe9d5a-7e1e-4c1d-ac93-342a321b8d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:59.208715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe9d5a-7e1e-4c1d-ac93-342a321b8d07 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:59.213378 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe9d5a-7e1e-4c1d-ac93-342a321b8d07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:14:59.213698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe9d5a-7e1e-4c1d-ac93-342a321b8d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:59.216110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe9d5a-7e1e-4c1d-ac93-342a321b8d07 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:59.234505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 202/423] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:14:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:14:59.244778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:59.245585 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe9d5a-7e1e-4c1d-ac93-342a321b8d07 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:59.297064 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9636-5161-46e2-a74b-e802c9eb388a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:59.337067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2542ba-7887-49c9-abfa-dd789ea25dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:59.338089 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2542ba-7887-49c9-abfa-dd789ea25dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:59.338757 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2542ba-7887-49c9-abfa-dd789ea25dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:59.339241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2542ba-7887-49c9-abfa-dd789ea25dc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:59.449979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2542ba-7887-49c9-abfa-dd789ea25dc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:59.452594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2542ba-7887-49c9-abfa-dd789ea25dc9 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:59.471560 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:59.475978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe9d5a-7e1e-4c1d-ac93-342a321b8d07 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:59.554795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:59.559089 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cce72a-e903-46c9-85c9-f6adbdb54255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:59.559891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cce72a-e903-46c9-85c9-f6adbdb54255 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:59.560352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cce72a-e903-46c9-85c9-f6adbdb54255 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:59.560782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cce72a-e903-46c9-85c9-f6adbdb54255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:59.654659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 222/424] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:14:59.656913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2542ba-7887-49c9-abfa-dd789ea25dc9 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:59.697505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cce72a-e903-46c9-85c9-f6adbdb54255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:59.699139 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cce72a-e903-46c9-85c9-f6adbdb54255 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:59.809191 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2542ba-7887-49c9-abfa-dd789ea25dc9 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:14:59.874800 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2895c-95e3-43f3-a583-38be2df77521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:14:59.875450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2895c-95e3-43f3-a583-38be2df77521 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:14:59.875727 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2895c-95e3-43f3-a583-38be2df77521 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:14:59.876001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2895c-95e3-43f3-a583-38be2df77521 None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:14:59.878602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2895c-95e3-43f3-a583-38be2df77521 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:14:59.880275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2895c-95e3-43f3-a583-38be2df77521 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:14:59.881920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 223/425] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:59 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:14:59.888053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2895c-95e3-43f3-a583-38be2df77521 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:59.895819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 203/426] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:14:59.896672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:14:59.902488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cce72a-e903-46c9-85c9-f6adbdb54255 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:14:59.939872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:00.092341 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2895c-95e3-43f3-a583-38be2df77521 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:00.100670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cce72a-e903-46c9-85c9-f6adbdb54255 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:00.168052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f3697-2dc7-47ba-97d4-0846681e23a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:00.169027 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ad219-b96e-4ccb-89f3-8520ce130fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:00.169882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ad219-b96e-4ccb-89f3-8520ce130fbd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:00.170731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f3697-2dc7-47ba-97d4-0846681e23a8 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:00.171201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ad219-b96e-4ccb-89f3-8520ce130fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:00.171682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f3697-2dc7-47ba-97d4-0846681e23a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:00.172156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ad219-b96e-4ccb-89f3-8520ce130fbd None admin] PATH_INFO: `/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:00.172612 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f3697-2dc7-47ba-97d4-0846681e23a8 None admin] PATH_INFO: `/v3/groups/6c60720f172c441c8fe03d29b9baf440` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:00.174827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ad219-b96e-4ccb-89f3-8520ce130fbd None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0cc2fa54247bdbe4d082e7cde13f8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:00.175600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f3697-2dc7-47ba-97d4-0846681e23a8 None admin] RBAC: Authorizing `identity:get_group(group_id=6c60720f172c441c8fe03d29b9baf440)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:00.177248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ad219-b96e-4ccb-89f3-8520ce130fbd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:00.178902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f3697-2dc7-47ba-97d4-0846681e23a8 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:00.180743 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 204/427] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:14:59 2022] GET /identity/v3/projects/0dd0cc2fa54247bdbe4d082e7cde13f8 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:00.182780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 224/428] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:14:59 2022] GET /identity/v3/groups/6c60720f172c441c8fe03d29b9baf440 => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:00.191387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ad219-b96e-4ccb-89f3-8520ce130fbd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:00.192610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f3697-2dc7-47ba-97d4-0846681e23a8 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:00.322292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:00.344457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:00.355921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f3697-2dc7-47ba-97d4-0846681e23a8 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:00.370350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ad219-b96e-4ccb-89f3-8520ce130fbd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:00.403015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035904a2-9dcf-4567-a21b-d7dc5f044c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:00.403619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035904a2-9dcf-4567-a21b-d7dc5f044c76 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:00.403893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035904a2-9dcf-4567-a21b-d7dc5f044c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:00.404163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035904a2-9dcf-4567-a21b-d7dc5f044c76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:00.404881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035904a2-9dcf-4567-a21b-d7dc5f044c76 None admin] RBAC: Adding query filter params (group.id=6c60720f172c441c8fe03d29b9baf440, role.id=c6ff6f013f2f41d78fedabbe698ed13e, scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:00.405197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035904a2-9dcf-4567-a21b-d7dc5f044c76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:00.407259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035904a2-9dcf-4567-a21b-d7dc5f044c76 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:00.414099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 225/429] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Sep 12 23:15:00 2022] GET /identity/v3/role_assignments?group.id=6c60720f172c441c8fe03d29b9baf440&scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8&role.id=c6ff6f013f2f41d78fedabbe698ed13e => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:00.418931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58982cf8-5989-4a5d-81a6-4490230f4d79 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:00.418931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58982cf8-5989-4a5d-81a6-4490230f4d79 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:00.418931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58982cf8-5989-4a5d-81a6-4490230f4d79 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:00.418931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 226/430] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:00.421535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13613a1-1096-4b62-8be6-8d547641d97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:00.421535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13613a1-1096-4b62-8be6-8d547641d97a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:00.421535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13613a1-1096-4b62-8be6-8d547641d97a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:00.421535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13613a1-1096-4b62-8be6-8d547641d97a None admin] PATH_INFO: `/v3/groups/6c60720f172c441c8fe03d29b9baf440` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:00.422804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5e6a2-92a9-4c30-b52d-ac20e3f53473 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:00.423193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5e6a2-92a9-4c30-b52d-ac20e3f53473 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:00.423560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5e6a2-92a9-4c30-b52d-ac20e3f53473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:00.427327 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13613a1-1096-4b62-8be6-8d547641d97a None admin] RBAC: Authorizing `identity:get_group(group_id=6c60720f172c441c8fe03d29b9baf440)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:00.428846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13613a1-1096-4b62-8be6-8d547641d97a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:00.430852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 205/431] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:15:00 2022] GET /identity/v3/groups/6c60720f172c441c8fe03d29b9baf440 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:00.437241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13613a1-1096-4b62-8be6-8d547641d97a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:00.465808 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-80c5e6a2-92a9-4c30-b52d-ac20e3f53473 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:00.467110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-80c5e6a2-92a9-4c30-b52d-ac20e3f53473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:00.552101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 227/432] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:15:00.651655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e875216-b94e-4710-bb34-48ad0d775bb2 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:00.652016 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e875216-b94e-4710-bb34-48ad0d775bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:00.652384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e875216-b94e-4710-bb34-48ad0d775bb2 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:00.654870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 228/433] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:00.661017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5236e-ead3-467e-bfbb-2571ec209248 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:00.661403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5236e-ead3-467e-bfbb-2571ec209248 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:00.661790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5236e-ead3-467e-bfbb-2571ec209248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:00.676322 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13613a1-1096-4b62-8be6-8d547641d97a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:00.686816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-5ee5236e-ead3-467e-bfbb-2571ec209248 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:00.688125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5ee5236e-ead3-467e-bfbb-2571ec209248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:00.717528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88da81-493f-4d47-8cbe-4ac1ddef9057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:00.718872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88da81-493f-4d47-8cbe-4ac1ddef9057 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:00.719312 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88da81-493f-4d47-8cbe-4ac1ddef9057 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:00.719808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88da81-493f-4d47-8cbe-4ac1ddef9057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:00.720864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88da81-493f-4d47-8cbe-4ac1ddef9057 None admin] RBAC: Adding query filter params (group.id=6c60720f172c441c8fe03d29b9baf440, role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a, scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:00.721366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88da81-493f-4d47-8cbe-4ac1ddef9057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:00.723105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88da81-493f-4d47-8cbe-4ac1ddef9057 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:00.727306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:00.734671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 206/434] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Sep 12 23:15:00 2022] GET /identity/v3/role_assignments?group.id=6c60720f172c441c8fe03d29b9baf440&scope.project.id=0dd0cc2fa54247bdbe4d082e7cde13f8&role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 611 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:00.737784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c409e0-f0c8-4714-9518-6e40d8b53f08 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:00.738062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c409e0-f0c8-4714-9518-6e40d8b53f08 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:00.738335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c409e0-f0c8-4714-9518-6e40d8b53f08 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:00.739861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 207/435] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:00.747905 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7fe8b-ada5-4763-b7b2-e9fde0c094c0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:00.748202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7fe8b-ada5-4763-b7b2-e9fde0c094c0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:00.748448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7fe8b-ada5-4763-b7b2-e9fde0c094c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:00.769891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-41a7fe8b-ada5-4763-b7b2-e9fde0c094c0 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:00.771154 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-41a7fe8b-ada5-4763-b7b2-e9fde0c094c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:00.795290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 229/436] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:00.850265 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5236e-ead3-467e-bfbb-2571ec209248 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:00.868571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 208/437] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:00.880323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:00.987701 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5236e-ead3-467e-bfbb-2571ec209248 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:01.028471 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391620b0-ff6d-4375-8ea6-39b59265418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:01.029112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391620b0-ff6d-4375-8ea6-39b59265418f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:01.029394 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391620b0-ff6d-4375-8ea6-39b59265418f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:01.029665 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391620b0-ff6d-4375-8ea6-39b59265418f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:01.042762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391620b0-ff6d-4375-8ea6-39b59265418f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-391620b0-ff6d-4375-8ea6-39b59265418f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:01.047632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:01.049359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:01.050511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 230/438] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:01.055092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7fe8b-ada5-4763-b7b2-e9fde0c094c0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:01.087524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391620b0-ff6d-4375-8ea6-39b59265418f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:01.189394 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:01.190202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7fe8b-ada5-4763-b7b2-e9fde0c094c0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:01.219664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391620b0-ff6d-4375-8ea6-39b59265418f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:01.228929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:01.233895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356fc40-77bf-44f8-8e84-08c2f2958590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:01.235263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356fc40-77bf-44f8-8e84-08c2f2958590 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:01.236811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356fc40-77bf-44f8-8e84-08c2f2958590 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:01.237092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356fc40-77bf-44f8-8e84-08c2f2958590 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:01.237819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356fc40-77bf-44f8-8e84-08c2f2958590 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:01.238102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356fc40-77bf-44f8-8e84-08c2f2958590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:01.239515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356fc40-77bf-44f8-8e84-08c2f2958590 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:01.249169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 209/439] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:15:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:01.250056 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356fc40-77bf-44f8-8e84-08c2f2958590 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:01.263607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab189749-0441-4604-a049-dbc2ecacf3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:01.264039 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab189749-0441-4604-a049-dbc2ecacf3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:01.264318 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab189749-0441-4604-a049-dbc2ecacf3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:01.264589 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab189749-0441-4604-a049-dbc2ecacf3f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:01.275759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab189749-0441-4604-a049-dbc2ecacf3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-ab189749-0441-4604-a049-dbc2ecacf3f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:01.280736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:01.281605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:01.283057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 231/440] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:15:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:01.283703 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab189749-0441-4604-a049-dbc2ecacf3f0 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:01.369658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356fc40-77bf-44f8-8e84-08c2f2958590 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:01.400314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab189749-0441-4604-a049-dbc2ecacf3f0 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:01.404251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2a2c4-25fa-4126-bd3d-bfa98413f607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:01.404886 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2a2c4-25fa-4126-bd3d-bfa98413f607 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:01.405167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2a2c4-25fa-4126-bd3d-bfa98413f607 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:01.405442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2a2c4-25fa-4126-bd3d-bfa98413f607 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:01.416716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2a2c4-25fa-4126-bd3d-bfa98413f607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-57f2a2c4-25fa-4126-bd3d-bfa98413f607 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:01.422640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:01.423677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 210/441] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:01.424658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2a2c4-25fa-4126-bd3d-bfa98413f607 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:01.437654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70578b-5270-43a7-b719-0ae1c30dc40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:01.438263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70578b-5270-43a7-b719-0ae1c30dc40f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:01.438616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70578b-5270-43a7-b719-0ae1c30dc40f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:01.438899 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70578b-5270-43a7-b719-0ae1c30dc40f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:01.441643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:01.476563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:01.507249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70578b-5270-43a7-b719-0ae1c30dc40f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:01.508638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70578b-5270-43a7-b719-0ae1c30dc40f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:01.530118 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2a2c4-25fa-4126-bd3d-bfa98413f607 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:01.563192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d25b18-54de-42cb-8f85-342537087746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:01.563954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d25b18-54de-42cb-8f85-342537087746 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:01.564382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d25b18-54de-42cb-8f85-342537087746 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:01.564656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d25b18-54de-42cb-8f85-342537087746 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:01.565314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d25b18-54de-42cb-8f85-342537087746 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:01.565620 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d25b18-54de-42cb-8f85-342537087746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:01.567014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d25b18-54de-42cb-8f85-342537087746 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:01.575359 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 211/442] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:01.576148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d25b18-54de-42cb-8f85-342537087746 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:01.614189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 232/443] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:01.614189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70578b-5270-43a7-b719-0ae1c30dc40f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:01.645041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:01.679893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d25b18-54de-42cb-8f85-342537087746 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:01.693722 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:01.711621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70578b-5270-43a7-b719-0ae1c30dc40f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:01.714808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02fa37-b0f2-4c73-b43c-3a34a62b4a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:01.715408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02fa37-b0f2-4c73-b43c-3a34a62b4a9a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:01.715682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02fa37-b0f2-4c73-b43c-3a34a62b4a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:01.715948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02fa37-b0f2-4c73-b43c-3a34a62b4a9a None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:01.716601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02fa37-b0f2-4c73-b43c-3a34a62b4a9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:01.716899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02fa37-b0f2-4c73-b43c-3a34a62b4a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:01.718269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02fa37-b0f2-4c73-b43c-3a34a62b4a9a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:01.727657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 212/444] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:01.728428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02fa37-b0f2-4c73-b43c-3a34a62b4a9a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:01.746367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa9da9-5429-47a3-9418-e87189772340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:01.747005 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa9da9-5429-47a3-9418-e87189772340 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:01.747287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa9da9-5429-47a3-9418-e87189772340 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:01.747559 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa9da9-5429-47a3-9418-e87189772340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:01.815601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa9da9-5429-47a3-9418-e87189772340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:01.816972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa9da9-5429-47a3-9418-e87189772340 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:01.828216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02fa37-b0f2-4c73-b43c-3a34a62b4a9a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:01.850015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:01.862786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b85e4f-9220-48c7-b594-13386bdc40b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:01.863519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b85e4f-9220-48c7-b594-13386bdc40b2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:01.863806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b85e4f-9220-48c7-b594-13386bdc40b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:01.864079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b85e4f-9220-48c7-b594-13386bdc40b2 None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:01.865208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b85e4f-9220-48c7-b594-13386bdc40b2 None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:01.866679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b85e4f-9220-48c7-b594-13386bdc40b2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:01.868290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 213/445] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:15:01 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:01.869051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b85e4f-9220-48c7-b594-13386bdc40b2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:01.915282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:01.916357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 233/446] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:01.917182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa9da9-5429-47a3-9418-e87189772340 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:01.974016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b85e4f-9220-48c7-b594-13386bdc40b2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:02.006643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2daa0-5d27-4fe1-8d6d-4a0a2c28265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:02.007245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2daa0-5d27-4fe1-8d6d-4a0a2c28265e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:02.007522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2daa0-5d27-4fe1-8d6d-4a0a2c28265e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:02.007792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2daa0-5d27-4fe1-8d6d-4a0a2c28265e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:02.013398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa9da9-5429-47a3-9418-e87189772340 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:02.048529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e96a21-24c7-4cfd-89f9-7bcdd5a4be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:02.049154 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e96a21-24c7-4cfd-89f9-7bcdd5a4be4d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:02.049436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e96a21-24c7-4cfd-89f9-7bcdd5a4be4d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:02.049711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e96a21-24c7-4cfd-89f9-7bcdd5a4be4d None admin] PATH_INFO: `/v3/groups/6c60720f172c441c8fe03d29b9baf440` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:02.050844 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e96a21-24c7-4cfd-89f9-7bcdd5a4be4d None admin] RBAC: Authorizing `identity:get_group(group_id=6c60720f172c441c8fe03d29b9baf440)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:02.052305 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e96a21-24c7-4cfd-89f9-7bcdd5a4be4d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:02.053867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 234/447] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:15:01 2022] GET /identity/v3/groups/6c60720f172c441c8fe03d29b9baf440 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:02.054644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e96a21-24c7-4cfd-89f9-7bcdd5a4be4d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:02.057213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:02.077331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2daa0-5d27-4fe1-8d6d-4a0a2c28265e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:02.078742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2daa0-5d27-4fe1-8d6d-4a0a2c28265e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:02.121888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:02.154162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e96a21-24c7-4cfd-89f9-7bcdd5a4be4d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:02.175835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 214/448] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:02.176654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2daa0-5d27-4fe1-8d6d-4a0a2c28265e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:02.193444 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4eadb-88ac-408a-8907-7fdd08c4be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:02.194074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4eadb-88ac-408a-8907-7fdd08c4be2e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:02.194353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4eadb-88ac-408a-8907-7fdd08c4be2e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:02.194657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4eadb-88ac-408a-8907-7fdd08c4be2e None admin] PATH_INFO: `/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:02.195771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4eadb-88ac-408a-8907-7fdd08c4be2e None admin] RBAC: Authorizing `identity:get_project(project_id=e5f1cb41b1834dee86dc7f0ae7165f23)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:02.197211 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4eadb-88ac-408a-8907-7fdd08c4be2e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:02.198869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 235/449] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:15:02 2022] GET /identity/v3/projects/e5f1cb41b1834dee86dc7f0ae7165f23 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:02.199617 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4eadb-88ac-408a-8907-7fdd08c4be2e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:02.267845 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:02.275252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2daa0-5d27-4fe1-8d6d-4a0a2c28265e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:02.299507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4eadb-88ac-408a-8907-7fdd08c4be2e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:02.308929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463d7ea-7608-4119-baa2-85af3ea4257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:02.309528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463d7ea-7608-4119-baa2-85af3ea4257b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:02.309814 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463d7ea-7608-4119-baa2-85af3ea4257b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:02.310085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463d7ea-7608-4119-baa2-85af3ea4257b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:02.310837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463d7ea-7608-4119-baa2-85af3ea4257b None admin] RBAC: Adding query filter params (group.id=6c60720f172c441c8fe03d29b9baf440, role.id=c6ff6f013f2f41d78fedabbe698ed13e, scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:02.311149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463d7ea-7608-4119-baa2-85af3ea4257b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:02.312623 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463d7ea-7608-4119-baa2-85af3ea4257b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:02.318653 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 215/450] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Sep 12 23:15:02 2022] GET /identity/v3/role_assignments?group.id=6c60720f172c441c8fe03d29b9baf440&scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23&role.id=c6ff6f013f2f41d78fedabbe698ed13e => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:02.319857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463d7ea-7608-4119-baa2-85af3ea4257b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:02.333979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f9609-0082-4186-8cb1-fe48e0615964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:02.334580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f9609-0082-4186-8cb1-fe48e0615964 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:02.334858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f9609-0082-4186-8cb1-fe48e0615964 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:02.335130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f9609-0082-4186-8cb1-fe48e0615964 None admin] PATH_INFO: `/v3/projects/0a803ea5f3c94589b38112108dcb63f7` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:02.336329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f9609-0082-4186-8cb1-fe48e0615964 None admin] RBAC: Authorizing `identity:get_project(project_id=0a803ea5f3c94589b38112108dcb63f7)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:02.337835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f9609-0082-4186-8cb1-fe48e0615964 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:02.339596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 236/451] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:15:02 2022] GET /identity/v3/projects/0a803ea5f3c94589b38112108dcb63f7 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:02.346129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f9609-0082-4186-8cb1-fe48e0615964 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:02.349464 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:02.459638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463d7ea-7608-4119-baa2-85af3ea4257b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:02.460425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f9609-0082-4186-8cb1-fe48e0615964 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:02.499914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5a781-719f-4bbd-b13f-ee58ded580e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:02.500553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a781-719f-4bbd-b13f-ee58ded580e3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:02.500836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a781-719f-4bbd-b13f-ee58ded580e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:02.501161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a781-719f-4bbd-b13f-ee58ded580e3 None admin] PATH_INFO: `/v3/groups/6c60720f172c441c8fe03d29b9baf440` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:02.502326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5a781-719f-4bbd-b13f-ee58ded580e3 None admin] RBAC: Authorizing `identity:get_group(group_id=6c60720f172c441c8fe03d29b9baf440)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:02.503742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5a781-719f-4bbd-b13f-ee58ded580e3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:02.504299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90d914-3082-4272-94e1-d4774546b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:02.504934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90d914-3082-4272-94e1-d4774546b8ee None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:02.505463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90d914-3082-4272-94e1-d4774546b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:02.505562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 216/452] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:15:02 2022] GET /identity/v3/groups/6c60720f172c441c8fe03d29b9baf440 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:02.505632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90d914-3082-4272-94e1-d4774546b8ee None admin] PATH_INFO: `/v3/groups/c8455fd344b64699b0e3b9f17a1b1975` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:02.506621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90d914-3082-4272-94e1-d4774546b8ee None admin] RBAC: Authorizing `identity:get_group(group_id=c8455fd344b64699b0e3b9f17a1b1975)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:02.508040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90d914-3082-4272-94e1-d4774546b8ee None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:02.509608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 237/453] 10.222.0.33 () {56 vars in 1180 bytes} [Mon Sep 12 23:15:02 2022] GET /identity/v3/groups/c8455fd344b64699b0e3b9f17a1b1975 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:02.512348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5a781-719f-4bbd-b13f-ee58ded580e3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:02.515359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90d914-3082-4272-94e1-d4774546b8ee None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:02.524764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:02.607297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:02.632779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5a781-719f-4bbd-b13f-ee58ded580e3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:02.639324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90d914-3082-4272-94e1-d4774546b8ee None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:02.673111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f281c7f-4a81-4b37-9415-00fedc537c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:02.673719 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281c7f-4a81-4b37-9415-00fedc537c75 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:02.673996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281c7f-4a81-4b37-9415-00fedc537c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:02.674271 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281c7f-4a81-4b37-9415-00fedc537c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:02.675038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281c7f-4a81-4b37-9415-00fedc537c75 None admin] RBAC: Adding query filter params (group.id=6c60720f172c441c8fe03d29b9baf440, role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a, scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:02.675348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281c7f-4a81-4b37-9415-00fedc537c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:02.676798 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281c7f-4a81-4b37-9415-00fedc537c75 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:02.682790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0cc77-2893-4b42-8622-a8c2979cc63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:02.683096 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 217/454] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Sep 12 23:15:02 2022] GET /identity/v3/role_assignments?group.id=6c60720f172c441c8fe03d29b9baf440&scope.project.id=e5f1cb41b1834dee86dc7f0ae7165f23&role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:02.687208 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0cc77-2893-4b42-8622-a8c2979cc63e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:02.687497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0cc77-2893-4b42-8622-a8c2979cc63e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:02.687770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0cc77-2893-4b42-8622-a8c2979cc63e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:02.689072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0cc77-2893-4b42-8622-a8c2979cc63e None admin] RBAC: Adding query filter params (group.id=c8455fd344b64699b0e3b9f17a1b1975, role.id=6413aac4240a46ba816472c29e305973, scope.project.id=0a803ea5f3c94589b38112108dcb63f7) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:02.689386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0cc77-2893-4b42-8622-a8c2979cc63e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:02.690937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0cc77-2893-4b42-8622-a8c2979cc63e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:02.697978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 238/455] 10.222.0.33 () {56 vars in 1376 bytes} [Mon Sep 12 23:15:02 2022] GET /identity/v3/role_assignments?group.id=c8455fd344b64699b0e3b9f17a1b1975&scope.project.id=0a803ea5f3c94589b38112108dcb63f7&role.id=6413aac4240a46ba816472c29e305973 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:05.534211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4db16-a691-40d9-9ec6-94f1b420b5e0 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:05.534736 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4db16-a691-40d9-9ec6-94f1b420b5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:05.534808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4db16-a691-40d9-9ec6-94f1b420b5e0 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:05.536379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 218/456] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:05.541952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d49e15-d954-4527-a9db-f29e2c9ebd19 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:05.542369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d49e15-d954-4527-a9db-f29e2c9ebd19 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:05.542555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d49e15-d954-4527-a9db-f29e2c9ebd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:05.570961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-70d49e15-d954-4527-a9db-f29e2c9ebd19 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:05.572209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-70d49e15-d954-4527-a9db-f29e2c9ebd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:05.660457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:05.670779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 239/457] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:05.805860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab6fc2-9143-4c92-9e0d-08944afb4ef2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:05.806183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab6fc2-9143-4c92-9e0d-08944afb4ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:05.806421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab6fc2-9143-4c92-9e0d-08944afb4ef2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:05.807971 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 219/458] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:05.813464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bd84f-89fa-4bf7-8e07-36c4a0d7f5f7 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:05.813853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bd84f-89fa-4bf7-8e07-36c4a0d7f5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:05.814342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bd84f-89fa-4bf7-8e07-36c4a0d7f5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:05.844190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-4c6bd84f-89fa-4bf7-8e07-36c4a0d7f5f7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:05.845700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4c6bd84f-89fa-4bf7-8e07-36c4a0d7f5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:05.941598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 240/459] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:05.986881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab6fc2-9143-4c92-9e0d-08944afb4ef2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:06.011387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b959db9-e9aa-4ac5-af3a-517c18840785 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:06.011692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b959db9-e9aa-4ac5-af3a-517c18840785 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:06.011928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b959db9-e9aa-4ac5-af3a-517c18840785 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:06.013501 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 241/460] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:06.019528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75ebef-dc79-4b6a-a9b3-cb2a817b4eb8 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:06.019953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75ebef-dc79-4b6a-a9b3-cb2a817b4eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:06.020225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75ebef-dc79-4b6a-a9b3-cb2a817b4eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:06.044282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-0a75ebef-dc79-4b6a-a9b3-cb2a817b4eb8 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:06.045450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0a75ebef-dc79-4b6a-a9b3-cb2a817b4eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:06.152393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 242/461] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:15:06.152996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab6fc2-9143-4c92-9e0d-08944afb4ef2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:06.153581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbe4d-031e-405b-bb17-6e61517c1340 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:06.153936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbe4d-031e-405b-bb17-6e61517c1340 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:06.154207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbe4d-031e-405b-bb17-6e61517c1340 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:06.155462 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 243/462] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:06.161646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63fba-1921-41b6-bb93-98ccc7182b33 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:06.161919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63fba-1921-41b6-bb93-98ccc7182b33 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:06.162186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63fba-1921-41b6-bb93-98ccc7182b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:06.181379 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-78f63fba-1921-41b6-bb93-98ccc7182b33 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:06.182589 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-78f63fba-1921-41b6-bb93-98ccc7182b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:06.194469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb01b1-c4b3-4680-896e-cdce006a25b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:06.195444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb01b1-c4b3-4680-896e-cdce006a25b6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:06.196000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb01b1-c4b3-4680-896e-cdce006a25b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:06.196284 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb01b1-c4b3-4680-896e-cdce006a25b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:06.215676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:06.216611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb01b1-c4b3-4680-896e-cdce006a25b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:06.218140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb01b1-c4b3-4680-896e-cdce006a25b6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a0bb01b1-c4b3-4680-896e-cdce006a25b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:06.237282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:06.238241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:06.239105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:06.239105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:06.239105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:06.243324 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 220/463] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:06.244278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb01b1-c4b3-4680-896e-cdce006a25b6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:06.281936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:06.296802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 244/464] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:06.297869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f63fba-1921-41b6-bb93-98ccc7182b33 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:06.401762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f63fba-1921-41b6-bb93-98ccc7182b33 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:06.411544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb01b1-c4b3-4680-896e-cdce006a25b6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:06.437565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8115b-3746-4d49-9016-028c5a80fff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:06.438302 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8115b-3746-4d49-9016-028c5a80fff4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:06.439201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8115b-3746-4d49-9016-028c5a80fff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:06.439571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8115b-3746-4d49-9016-028c5a80fff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:06.450422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8115b-3746-4d49-9016-028c5a80fff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:06.451905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8115b-3746-4d49-9016-028c5a80fff4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-71c8115b-3746-4d49-9016-028c5a80fff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:06.467670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:06.468558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:06.469369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:06.469369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:06.469369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:06.469369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 245/465] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:06.475591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8115b-3746-4d49-9016-028c5a80fff4 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:06.484036 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dc8cf-67ca-4802-b846-e6db31dd4d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:06.484981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dc8cf-67ca-4802-b846-e6db31dd4d79 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:06.486138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dc8cf-67ca-4802-b846-e6db31dd4d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:06.486744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dc8cf-67ca-4802-b846-e6db31dd4d79 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:06.487591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1dc8cf-67ca-4802-b846-e6db31dd4d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:06.488115 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1dc8cf-67ca-4802-b846-e6db31dd4d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:06.489702 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1dc8cf-67ca-4802-b846-e6db31dd4d79 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:06.525613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 221/466] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:06.530956 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dc8cf-67ca-4802-b846-e6db31dd4d79 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:06.570843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:06.597685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:06.610682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8115b-3746-4d49-9016-028c5a80fff4 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:06.648216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dc8cf-67ca-4802-b846-e6db31dd4d79 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:06.653570 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27556fe-1a21-40f2-9f58-eda8b148ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:06.654188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27556fe-1a21-40f2-9f58-eda8b148ae6e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:06.654497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27556fe-1a21-40f2-9f58-eda8b148ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:06.654781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27556fe-1a21-40f2-9f58-eda8b148ae6e None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:06.655424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27556fe-1a21-40f2-9f58-eda8b148ae6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:06.656278 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27556fe-1a21-40f2-9f58-eda8b148ae6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:06.658966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27556fe-1a21-40f2-9f58-eda8b148ae6e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:06.678769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 246/467] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:06.678769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27556fe-1a21-40f2-9f58-eda8b148ae6e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:06.684859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856cf9b-e2f7-4d88-a136-bb2708f815fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:06.685469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856cf9b-e2f7-4d88-a136-bb2708f815fe None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:06.685744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856cf9b-e2f7-4d88-a136-bb2708f815fe None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:06.686013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856cf9b-e2f7-4d88-a136-bb2708f815fe None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:06.686701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856cf9b-e2f7-4d88-a136-bb2708f815fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:06.688147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856cf9b-e2f7-4d88-a136-bb2708f815fe None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:06.711488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 222/468] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:15:06 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:15:06.712325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856cf9b-e2f7-4d88-a136-bb2708f815fe None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:06.814630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27556fe-1a21-40f2-9f58-eda8b148ae6e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:06.816853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:06.856651 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856cf9b-e2f7-4d88-a136-bb2708f815fe None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:06.858337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286aa1e-81bb-4bc5-a753-321ee922a11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:06.859283 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286aa1e-81bb-4bc5-a753-321ee922a11a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:06.859746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286aa1e-81bb-4bc5-a753-321ee922a11a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:06.860231 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286aa1e-81bb-4bc5-a753-321ee922a11a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:06.872783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286aa1e-81bb-4bc5-a753-321ee922a11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:06.873971 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:06.875007 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286aa1e-81bb-4bc5-a753-321ee922a11a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-d286aa1e-81bb-4bc5-a753-321ee922a11a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:06.893423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:06.894437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:06.895273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:06.895273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:06.895273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:06.897352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 247/469] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:06.898536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286aa1e-81bb-4bc5-a753-321ee922a11a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:06.899883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42147-265e-4c3f-9456-294d858411ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:06.900611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42147-265e-4c3f-9456-294d858411ab None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:06.901036 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42147-265e-4c3f-9456-294d858411ab None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:06.906429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42147-265e-4c3f-9456-294d858411ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:06.915508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a42147-265e-4c3f-9456-294d858411ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:06.917260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a42147-265e-4c3f-9456-294d858411ab None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-50a42147-265e-4c3f-9456-294d858411ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:06.932670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:06.933590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:06.934493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:06.934493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:06.934493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:06.934493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 223/470] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:06.934927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42147-265e-4c3f-9456-294d858411ab None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:07.043938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286aa1e-81bb-4bc5-a753-321ee922a11a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:07.051362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42147-265e-4c3f-9456-294d858411ab None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:07.081997 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177935e-2c6a-475c-aab8-ed7ef25b3b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:07.083027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177935e-2c6a-475c-aab8-ed7ef25b3b4c None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:07.083458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177935e-2c6a-475c-aab8-ed7ef25b3b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:07.083906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177935e-2c6a-475c-aab8-ed7ef25b3b4c None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:07.084722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177935e-2c6a-475c-aab8-ed7ef25b3b4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:07.086395 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177935e-2c6a-475c-aab8-ed7ef25b3b4c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:07.087654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7f0a-6474-4e80-899c-0697c8eb1117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:07.088279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7f0a-6474-4e80-899c-0697c8eb1117 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:07.088556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7f0a-6474-4e80-899c-0697c8eb1117 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:07.088828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7f0a-6474-4e80-899c-0697c8eb1117 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:07.089489 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7f0a-6474-4e80-899c-0697c8eb1117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:07.089791 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7f0a-6474-4e80-899c-0697c8eb1117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:07.091273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7f0a-6474-4e80-899c-0697c8eb1117 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:07.108556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 224/471] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:07.114522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7f0a-6474-4e80-899c-0697c8eb1117 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:07.118622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 248/472] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:15:06 2022] POST /identity/v3/users => generated 246 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:15:07.119824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177935e-2c6a-475c-aab8-ed7ef25b3b4c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:07.148515 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:07.161568 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:07.266880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177935e-2c6a-475c-aab8-ed7ef25b3b4c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:07.294229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7f0a-6474-4e80-899c-0697c8eb1117 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:07.308958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036a469-7821-4413-b089-c1d6e8ef9b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:07.309978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036a469-7821-4413-b089-c1d6e8ef9b8a None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:07.310491 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036a469-7821-4413-b089-c1d6e8ef9b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:07.311007 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036a469-7821-4413-b089-c1d6e8ef9b8a None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:07.311851 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036a469-7821-4413-b089-c1d6e8ef9b8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:07.313530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036a469-7821-4413-b089-c1d6e8ef9b8a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:07.335879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfecf46-9b37-407f-848f-8ab48a06c73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:07.335879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfecf46-9b37-407f-848f-8ab48a06c73c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:07.336190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfecf46-9b37-407f-848f-8ab48a06c73c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:07.336395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfecf46-9b37-407f-848f-8ab48a06c73c None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:07.337043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfecf46-9b37-407f-848f-8ab48a06c73c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:07.337364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfecf46-9b37-407f-848f-8ab48a06c73c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:07.338763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfecf46-9b37-407f-848f-8ab48a06c73c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:07.344460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 249/473] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:15:07 2022] POST /identity/v3/users => generated 249 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:15:07.344460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5553-37c8-4821-83ae-170a983f5b78 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:07.344460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5553-37c8-4821-83ae-170a983f5b78 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:07.344460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5553-37c8-4821-83ae-170a983f5b78 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:07.344460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 250/474] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:07.350583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561e2f-62eb-4654-8998-badd9758c4f9 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:07.350881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561e2f-62eb-4654-8998-badd9758c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:07.351127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561e2f-62eb-4654-8998-badd9758c4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:07.356331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 225/475] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:07.363114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfecf46-9b37-407f-848f-8ab48a06c73c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:07.388783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-71561e2f-62eb-4654-8998-badd9758c4f9 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:07.389750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-71561e2f-62eb-4654-8998-badd9758c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:07.473648 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 251/476] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:15:07.474408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:07.477345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:07.503022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfecf46-9b37-407f-848f-8ab48a06c73c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:07.542776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a028fd-3553-4ae6-aff9-4eb453b81262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:07.543746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a028fd-3553-4ae6-aff9-4eb453b81262 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:07.544302 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a028fd-3553-4ae6-aff9-4eb453b81262 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:07.544774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a028fd-3553-4ae6-aff9-4eb453b81262 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:07.545661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a028fd-3553-4ae6-aff9-4eb453b81262 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:07.547166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a028fd-3553-4ae6-aff9-4eb453b81262 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:07.571236 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 226/477] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:15:07 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:15:07.778928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561e2f-62eb-4654-8998-badd9758c4f9 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:07.891572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561e2f-62eb-4654-8998-badd9758c4f9 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:07.927598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef0ff6-16d3-4930-98ed-20cd2d5a152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:07.928217 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef0ff6-16d3-4930-98ed-20cd2d5a152e None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:07.928492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef0ff6-16d3-4930-98ed-20cd2d5a152e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:07.928765 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef0ff6-16d3-4930-98ed-20cd2d5a152e None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:07.929429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef0ff6-16d3-4930-98ed-20cd2d5a152e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:07.930827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef0ff6-16d3-4930-98ed-20cd2d5a152e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:07.940449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.sql.core [None req-19ef0ff6-16d3-4930-98ed-20cd2d5a152e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 12 23:15:07.940449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 12 23:15:07.940449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [parameters: {'id': '120ce43beaa949ecb25b771bd729dee9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 12 23:15:07.940449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81387) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-19ef0ff6-16d3-4930-98ed-20cd2d5a152e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application conn.query(q) Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application result.read() Sep 12 23:15:07.957590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return ref.to_dict() Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 23:15:07.958527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application next(self.gen) Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application yield resource Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application next(self.gen) Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self.session.rollback() Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self.force_reraise() Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise self.value Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application session.commit() Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 12 23:15:07.959516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._prepare_impl() Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self.session.flush() Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._flush(objects) Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application compat.raise_( Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application flush_context.execute() Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rec.execute(self) Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 12 23:15:07.960983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 23:15:07.961834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application conn.query(q) Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application result.read() Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 23:15:07.963250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [parameters: {'id': '120ce43beaa949ecb25b771bd729dee9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:07.965456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 12 23:15:07.967543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:07.972022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 252/478] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Sep 12 23:15:07 2022] POST /identity/v3/roles => generated 144 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:07.972164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a028fd-3553-4ae6-aff9-4eb453b81262 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:08.087988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a028fd-3553-4ae6-aff9-4eb453b81262 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:08.135096 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81fd98-be28-4b47-83e2-37848dadaa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:08.135805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81fd98-be28-4b47-83e2-37848dadaa5a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:08.136095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81fd98-be28-4b47-83e2-37848dadaa5a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:08.136373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81fd98-be28-4b47-83e2-37848dadaa5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:08.139297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:08.153579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81fd98-be28-4b47-83e2-37848dadaa5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-da81fd98-be28-4b47-83e2-37848dadaa5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:08.159045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:08.159903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:08.160685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 227/479] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:15:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:08.167597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef0ff6-16d3-4930-98ed-20cd2d5a152e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:08.235101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:08.283352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef0ff6-16d3-4930-98ed-20cd2d5a152e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:08.326311 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8a0ed-cd0f-48ed-8b87-79b0705c5729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:08.327370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8a0ed-cd0f-48ed-8b87-79b0705c5729 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:08.327841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8a0ed-cd0f-48ed-8b87-79b0705c5729 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:08.328304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8a0ed-cd0f-48ed-8b87-79b0705c5729 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:08.330464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8a0ed-cd0f-48ed-8b87-79b0705c5729 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:08.331001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8a0ed-cd0f-48ed-8b87-79b0705c5729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:08.332704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8a0ed-cd0f-48ed-8b87-79b0705c5729 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:08.345690 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 253/480] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:09.323261 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31a95b-a5a4-453f-b23b-f65651e255e6 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:09.323811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31a95b-a5a4-453f-b23b-f65651e255e6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:09.323811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31a95b-a5a4-453f-b23b-f65651e255e6 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:09.325525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 228/481] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:09.331259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b61aa-50d4-4723-bacd-a744cad68247 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:09.331662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b61aa-50d4-4723-bacd-a744cad68247 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:09.331829 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b61aa-50d4-4723-bacd-a744cad68247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:09.359365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-695b61aa-50d4-4723-bacd-a744cad68247 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:09.360685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-695b61aa-50d4-4723-bacd-a744cad68247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:09.464977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 254/482] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:09.873253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30269ed-344c-4e71-bbf1-cf0c7b7de445 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:09.873913 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30269ed-344c-4e71-bbf1-cf0c7b7de445 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:09.874432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30269ed-344c-4e71-bbf1-cf0c7b7de445 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:09.876078 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 229/483] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:09.881432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161313bc-c1aa-4ac2-ad88-cf6b89ea2d14 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:09.881963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161313bc-c1aa-4ac2-ad88-cf6b89ea2d14 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:09.882484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161313bc-c1aa-4ac2-ad88-cf6b89ea2d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:09.911414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-161313bc-c1aa-4ac2-ad88-cf6b89ea2d14 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:09.912610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-161313bc-c1aa-4ac2-ad88-cf6b89ea2d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:09.934405 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30269ed-344c-4e71-bbf1-cf0c7b7de445 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:09.984279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:10.010779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 255/484] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:10.088524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30269ed-344c-4e71-bbf1-cf0c7b7de445 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:10.134291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db9650-4704-4fb3-bab5-d1b17b4146bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:10.134861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db9650-4704-4fb3-bab5-d1b17b4146bc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:10.135136 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db9650-4704-4fb3-bab5-d1b17b4146bc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:10.135404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db9650-4704-4fb3-bab5-d1b17b4146bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:10.150966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db9650-4704-4fb3-bab5-d1b17b4146bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-05db9650-4704-4fb3-bab5-d1b17b4146bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:10.155762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:10.156643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:10.158218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 230/485] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:10.163204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161313bc-c1aa-4ac2-ad88-cf6b89ea2d14 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:10.307491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db9650-4704-4fb3-bab5-d1b17b4146bc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:10.313651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161313bc-c1aa-4ac2-ad88-cf6b89ea2d14 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:10.350333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ef063-e9a1-4371-a2c9-c6cbb2bbda5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:10.351107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ef063-e9a1-4371-a2c9-c6cbb2bbda5c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:10.351289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ef063-e9a1-4371-a2c9-c6cbb2bbda5c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:10.351523 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ef063-e9a1-4371-a2c9-c6cbb2bbda5c None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:10.352134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ef063-e9a1-4371-a2c9-c6cbb2bbda5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:10.352433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ef063-e9a1-4371-a2c9-c6cbb2bbda5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:10.353809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ef063-e9a1-4371-a2c9-c6cbb2bbda5c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:10.363563 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 256/486] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:10.369286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ef063-e9a1-4371-a2c9-c6cbb2bbda5c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:10.401045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:10.424854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:10.462086 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db9650-4704-4fb3-bab5-d1b17b4146bc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:10.487754 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ef063-e9a1-4371-a2c9-c6cbb2bbda5c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:10.499941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e4d31-dcd5-429e-9c75-72bb3af006d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:10.500574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e4d31-dcd5-429e-9c75-72bb3af006d8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:10.500991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e4d31-dcd5-429e-9c75-72bb3af006d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:10.501270 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e4d31-dcd5-429e-9c75-72bb3af006d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:10.511937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e4d31-dcd5-429e-9c75-72bb3af006d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-de0e4d31-dcd5-429e-9c75-72bb3af006d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:10.517969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:10.519024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:10.519824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 231/487] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:10.520644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ba2b-1152-484b-8394-a277b23bda72 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:10.520953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ba2b-1152-484b-8394-a277b23bda72 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:10.521200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ba2b-1152-484b-8394-a277b23bda72 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:10.522575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 232/488] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:10.527673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd2e90-6ff8-4e3c-81f4-51a121679fc7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:10.527957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd2e90-6ff8-4e3c-81f4-51a121679fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:10.528232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd2e90-6ff8-4e3c-81f4-51a121679fc7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:10.530403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 233/489] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:10.530403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd2e90-6ff8-4e3c-81f4-51a121679fc7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:10.536446 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11b0e0-9115-4732-a52d-f22ed0ffcce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:10.537085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11b0e0-9115-4732-a52d-f22ed0ffcce7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:10.537366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11b0e0-9115-4732-a52d-f22ed0ffcce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:10.537639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11b0e0-9115-4732-a52d-f22ed0ffcce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:10.552210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11b0e0-9115-4732-a52d-f22ed0ffcce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:10.554169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11b0e0-9115-4732-a52d-f22ed0ffcce7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-de11b0e0-9115-4732-a52d-f22ed0ffcce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:10.572558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:10.573467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:10.574319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:10.574319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:10.574319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:10.578910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 257/490] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:10.580307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146367-e326-4760-96ab-0a80ef9d84f7 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:10.580587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146367-e326-4760-96ab-0a80ef9d84f7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:10.580857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146367-e326-4760-96ab-0a80ef9d84f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:10.599873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-d4146367-e326-4760-96ab-0a80ef9d84f7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:10.600952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d4146367-e326-4760-96ab-0a80ef9d84f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:10.640139 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd2e90-6ff8-4e3c-81f4-51a121679fc7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:10.657592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:10.678335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560c618-c4a7-451e-b20b-1b01c85482b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:10.686837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 258/491] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:10.686979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560c618-c4a7-451e-b20b-1b01c85482b5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:10.686979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560c618-c4a7-451e-b20b-1b01c85482b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:10.686979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560c618-c4a7-451e-b20b-1b01c85482b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:10.686979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560c618-c4a7-451e-b20b-1b01c85482b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:10.687279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7947b-9148-4a2f-94fb-af70b177ad87 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:10.687362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560c618-c4a7-451e-b20b-1b01c85482b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:10.687440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7947b-9148-4a2f-94fb-af70b177ad87 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:10.687440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7947b-9148-4a2f-94fb-af70b177ad87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:10.687589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560c618-c4a7-451e-b20b-1b01c85482b5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:10.696046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 234/492] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:10.696828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560c618-c4a7-451e-b20b-1b01c85482b5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:10.705135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-48f7947b-9148-4a2f-94fb-af70b177ad87 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:10.706331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-48f7947b-9148-4a2f-94fb-af70b177ad87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:10.729350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:10.786550 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 259/493] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:10.787466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7947b-9148-4a2f-94fb-af70b177ad87 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:10.886013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560c618-c4a7-451e-b20b-1b01c85482b5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:10.898566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7947b-9148-4a2f-94fb-af70b177ad87 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:10.951050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268604b-3cb8-4a87-b614-7059e9cfda5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:10.951659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268604b-3cb8-4a87-b614-7059e9cfda5c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:10.951935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268604b-3cb8-4a87-b614-7059e9cfda5c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:10.952204 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268604b-3cb8-4a87-b614-7059e9cfda5c None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:10.952846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268604b-3cb8-4a87-b614-7059e9cfda5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:10.953144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268604b-3cb8-4a87-b614-7059e9cfda5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:10.954729 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268604b-3cb8-4a87-b614-7059e9cfda5c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:10.968045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c16ed-29ea-4062-b7bc-4fa4b1a78343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:10.968736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c16ed-29ea-4062-b7bc-4fa4b1a78343 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:10.969012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c16ed-29ea-4062-b7bc-4fa4b1a78343 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:10.969343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c16ed-29ea-4062-b7bc-4fa4b1a78343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:10.980650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 235/494] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:10.985889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268604b-3cb8-4a87-b614-7059e9cfda5c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:10.987866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c16ed-29ea-4062-b7bc-4fa4b1a78343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:10.989328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c16ed-29ea-4062-b7bc-4fa4b1a78343 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-886c16ed-29ea-4062-b7bc-4fa4b1a78343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:11.008807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:11.009953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:11.012149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:11.012149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:11.012149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:11.012149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 260/495] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:11.012149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c16ed-29ea-4062-b7bc-4fa4b1a78343 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:11.023940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:11.043703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:11.112989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268604b-3cb8-4a87-b614-7059e9cfda5c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:11.132004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c16ed-29ea-4062-b7bc-4fa4b1a78343 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:11.150961 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd21b5-3c5b-42b8-b4e4-b5f5c64ef409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:11.151498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd21b5-3c5b-42b8-b4e4-b5f5c64ef409 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:11.151774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd21b5-3c5b-42b8-b4e4-b5f5c64ef409 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:11.152041 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd21b5-3c5b-42b8-b4e4-b5f5c64ef409 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:11.163974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd21b5-3c5b-42b8-b4e4-b5f5c64ef409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:11.166491 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118c855-5721-4878-bab9-69f399a1c0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:11.167119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118c855-5721-4878-bab9-69f399a1c0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:11.167398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118c855-5721-4878-bab9-69f399a1c0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:11.167670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118c855-5721-4878-bab9-69f399a1c0c3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-babd21b5-3c5b-42b8-b4e4-b5f5c64ef409 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:11.169388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:11.170246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:11.171148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 236/496] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:11.171797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd21b5-3c5b-42b8-b4e4-b5f5c64ef409 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:11.180285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118c855-5721-4878-bab9-69f399a1c0c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:11.181789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118c855-5721-4878-bab9-69f399a1c0c3 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-c118c855-5721-4878-bab9-69f399a1c0c3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:11.197429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:11.198711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:11.199629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:11.199629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:11.199629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:11.199629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:11.199629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:11.199629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:11.199629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:11.199629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:11.199629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 12 23:15:11.199629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:11.202865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 261/497] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:11.204303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118c855-5721-4878-bab9-69f399a1c0c3 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:11.274602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:11.291494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:11.297032 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd21b5-3c5b-42b8-b4e4-b5f5c64ef409 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:11.312316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118c855-5721-4878-bab9-69f399a1c0c3 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:11.334682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63005861-5082-4402-bc75-8680a922547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:11.335316 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63005861-5082-4402-bc75-8680a922547c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:11.335600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63005861-5082-4402-bc75-8680a922547c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:11.335897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63005861-5082-4402-bc75-8680a922547c None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:11.336527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63005861-5082-4402-bc75-8680a922547c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:11.336830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63005861-5082-4402-bc75-8680a922547c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:11.338194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63005861-5082-4402-bc75-8680a922547c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:11.347264 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb7b4a-aa11-4339-8fa7-15174f2ca701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:11.347893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb7b4a-aa11-4339-8fa7-15174f2ca701 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:11.348172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb7b4a-aa11-4339-8fa7-15174f2ca701 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:11.348445 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb7b4a-aa11-4339-8fa7-15174f2ca701 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:11.351297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 237/498] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:11.352079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63005861-5082-4402-bc75-8680a922547c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:11.358668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb7b4a-aa11-4339-8fa7-15174f2ca701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-8adb7b4a-aa11-4339-8fa7-15174f2ca701 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:11.364065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:11.365115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 262/499] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:11.371111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb7b4a-aa11-4339-8fa7-15174f2ca701 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:11.456541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63005861-5082-4402-bc75-8680a922547c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:11.466373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb7b4a-aa11-4339-8fa7-15174f2ca701 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:11.489779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12655f4-b667-4972-9009-fbaaa44d9a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:11.490526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12655f4-b667-4972-9009-fbaaa44d9a7e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:11.490809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12655f4-b667-4972-9009-fbaaa44d9a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:11.491080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12655f4-b667-4972-9009-fbaaa44d9a7e None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:11.491744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12655f4-b667-4972-9009-fbaaa44d9a7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:11.492052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12655f4-b667-4972-9009-fbaaa44d9a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:11.492397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:11.493433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12655f4-b667-4972-9009-fbaaa44d9a7e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:11.500295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe601ad6-95da-4cd7-9c7c-90db04390182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:11.501425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe601ad6-95da-4cd7-9c7c-90db04390182 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:11.501696 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe601ad6-95da-4cd7-9c7c-90db04390182 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:11.502107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe601ad6-95da-4cd7-9c7c-90db04390182 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:11.502219 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 238/500] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:11.502866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe601ad6-95da-4cd7-9c7c-90db04390182 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:11.503246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe601ad6-95da-4cd7-9c7c-90db04390182 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:11.503341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8d8ac-2e06-4437-b909-079aec3f23ca None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:11.503626 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8d8ac-2e06-4437-b909-079aec3f23ca None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:11.503901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8d8ac-2e06-4437-b909-079aec3f23ca None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:11.504686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe601ad6-95da-4cd7-9c7c-90db04390182 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:11.505247 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 239/501] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:11.507244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8d8ac-2e06-4437-b909-079aec3f23ca None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:11.532605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:11.546003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 263/502] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Sep 12 23:15:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:11.546900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe601ad6-95da-4cd7-9c7c-90db04390182 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:11.629037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8d8ac-2e06-4437-b909-079aec3f23ca None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:11.655088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe601ad6-95da-4cd7-9c7c-90db04390182 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:11.664478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad572d79-60ad-49df-b42f-5c7787dd7dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:11.665224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad572d79-60ad-49df-b42f-5c7787dd7dfe None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:11.665591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad572d79-60ad-49df-b42f-5c7787dd7dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:11.666206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad572d79-60ad-49df-b42f-5c7787dd7dfe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:11.677178 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad572d79-60ad-49df-b42f-5c7787dd7dfe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:11.679055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad572d79-60ad-49df-b42f-5c7787dd7dfe None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:11.690724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3031fa-9a4a-4077-a06b-ac28ef7d8dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:11.691340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3031fa-9a4a-4077-a06b-ac28ef7d8dea None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:11.691618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3031fa-9a4a-4077-a06b-ac28ef7d8dea None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:11.691898 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3031fa-9a4a-4077-a06b-ac28ef7d8dea None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:11.692569 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3031fa-9a4a-4077-a06b-ac28ef7d8dea None admin] RBAC: Adding query filter params (name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:11.692878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3031fa-9a4a-4077-a06b-ac28ef7d8dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ad572d79-60ad-49df-b42f-5c7787dd7dfe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:11.693192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:11.694010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:11.694918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:11.694918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:11.694918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:11.694918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:11.694918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:11.694918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:11.694918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:11.694918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:11.694918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:15:11.694918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:11.695431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3031fa-9a4a-4077-a06b-ac28ef7d8dea None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:11.695498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 240/503] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Sep 12 23:15:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:11.696186 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad572d79-60ad-49df-b42f-5c7787dd7dfe None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:11.703361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 264/504] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:11.705216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eb365-a0a8-44e9-bfe1-0994e3b3ceab None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:11.705571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eb365-a0a8-44e9-bfe1-0994e3b3ceab None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:11.705772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eb365-a0a8-44e9-bfe1-0994e3b3ceab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:11.724138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-df1eb365-a0a8-44e9-bfe1-0994e3b3ceab None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:11.725435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-df1eb365-a0a8-44e9-bfe1-0994e3b3ceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:11.782602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:11.786430 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:11.806447 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad572d79-60ad-49df-b42f-5c7787dd7dfe None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:11.814676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 265/505] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:11.815741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eb365-a0a8-44e9-bfe1-0994e3b3ceab None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:11.851829 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec7c9e-0e77-4e77-a792-b7b6ab525aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:11.852460 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec7c9e-0e77-4e77-a792-b7b6ab525aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:11.852735 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec7c9e-0e77-4e77-a792-b7b6ab525aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:11.853003 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec7c9e-0e77-4e77-a792-b7b6ab525aa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:11.865465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec7c9e-0e77-4e77-a792-b7b6ab525aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:11.867016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec7c9e-0e77-4e77-a792-b7b6ab525aa1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-deec7c9e-0e77-4e77-a792-b7b6ab525aa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:11.884776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:11.885718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:11.886571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:11.886571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:11.886571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:11.886571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 241/506] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:11.886780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec7c9e-0e77-4e77-a792-b7b6ab525aa1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:11.931962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eb365-a0a8-44e9-bfe1-0994e3b3ceab None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:11.966955 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef64e6-9044-43ab-8615-11a60d5219ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:11.967558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef64e6-9044-43ab-8615-11a60d5219ce None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:11.967832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef64e6-9044-43ab-8615-11a60d5219ce None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:11.968101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef64e6-9044-43ab-8615-11a60d5219ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:11.995166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec7c9e-0e77-4e77-a792-b7b6ab525aa1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:12.019799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:12.027147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:12.033004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cf264-7c10-4816-8d36-cfb66fe0ca56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:12.033617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cf264-7c10-4816-8d36-cfb66fe0ca56 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:12.034266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cf264-7c10-4816-8d36-cfb66fe0ca56 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:12.034570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cf264-7c10-4816-8d36-cfb66fe0ca56 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:12.035297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cf264-7c10-4816-8d36-cfb66fe0ca56 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:12.035600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cf264-7c10-4816-8d36-cfb66fe0ca56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:12.037190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cf264-7c10-4816-8d36-cfb66fe0ca56 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:12.044907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef64e6-9044-43ab-8615-11a60d5219ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:12.046572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef64e6-9044-43ab-8615-11a60d5219ce None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:12.074123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 242/507] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Sep 12 23:15:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:12.074988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cf264-7c10-4816-8d36-cfb66fe0ca56 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:12.153360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 266/508] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:12.154227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef64e6-9044-43ab-8615-11a60d5219ce None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:12.174712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cf264-7c10-4816-8d36-cfb66fe0ca56 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:12.209200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4e4d-3666-4e6c-abd9-f7aa4b0cc0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:12.209828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4e4d-3666-4e6c-abd9-f7aa4b0cc0bf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:12.210113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4e4d-3666-4e6c-abd9-f7aa4b0cc0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:12.210409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4e4d-3666-4e6c-abd9-f7aa4b0cc0bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:12.220425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4e4d-3666-4e6c-abd9-f7aa4b0cc0bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:12.221894 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4e4d-3666-4e6c-abd9-f7aa4b0cc0bf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:12.232749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-202a4e4d-3666-4e6c-abd9-f7aa4b0cc0bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:12.237075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:12.237933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:12.238818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:12.238818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:12.238818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:12.238818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 243/509] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:12.239049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4e4d-3666-4e6c-abd9-f7aa4b0cc0bf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:12.260540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef64e6-9044-43ab-8615-11a60d5219ce None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:12.282032 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:12.295180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cbc95-9ae5-44d7-b8e2-075effa9dc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:12.295783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cbc95-9ae5-44d7-b8e2-075effa9dc0d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:12.296060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cbc95-9ae5-44d7-b8e2-075effa9dc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:12.296332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cbc95-9ae5-44d7-b8e2-075effa9dc0d None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:12.296968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cbc95-9ae5-44d7-b8e2-075effa9dc0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:12.297268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cbc95-9ae5-44d7-b8e2-075effa9dc0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:12.298830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cbc95-9ae5-44d7-b8e2-075effa9dc0d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:12.309729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 267/510] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:12.310559 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cbc95-9ae5-44d7-b8e2-075effa9dc0d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:12.342260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4e4d-3666-4e6c-abd9-f7aa4b0cc0bf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:12.375342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40546f87-8e8a-4020-8c86-b7e442d15575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:12.376969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40546f87-8e8a-4020-8c86-b7e442d15575 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:12.377447 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40546f87-8e8a-4020-8c86-b7e442d15575 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:12.377891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40546f87-8e8a-4020-8c86-b7e442d15575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:12.412836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cbc95-9ae5-44d7-b8e2-075effa9dc0d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:12.446034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ba5b0-c378-4e1e-8ebe-546449cd53ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:12.446196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40546f87-8e8a-4020-8c86-b7e442d15575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:12.446685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ba5b0-c378-4e1e-8ebe-546449cd53ba None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:12.446966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ba5b0-c378-4e1e-8ebe-546449cd53ba None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:12.447235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ba5b0-c378-4e1e-8ebe-546449cd53ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:12.447574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40546f87-8e8a-4020-8c86-b7e442d15575 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:12.454179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:12.458519 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ba5b0-c378-4e1e-8ebe-546449cd53ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:12.460336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ba5b0-c378-4e1e-8ebe-546449cd53ba None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-c73ba5b0-c378-4e1e-8ebe-546449cd53ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:12.475048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:12.476157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:12.477051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:12.477051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:12.477051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:12.477051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 268/511] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:12.477258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ba5b0-c378-4e1e-8ebe-546449cd53ba None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:12.498841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:12.557190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 244/512] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:12.557940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40546f87-8e8a-4020-8c86-b7e442d15575 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:12.581915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ba5b0-c378-4e1e-8ebe-546449cd53ba None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:12.615224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933e727-81df-4243-9877-080aecbe716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:12.615850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933e727-81df-4243-9877-080aecbe716c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:12.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933e727-81df-4243-9877-080aecbe716c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:12.616406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933e727-81df-4243-9877-080aecbe716c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:12.627491 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933e727-81df-4243-9877-080aecbe716c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:12.628921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933e727-81df-4243-9877-080aecbe716c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-c933e727-81df-4243-9877-080aecbe716c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:12.643351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:12.644316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:12.645153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:12.645153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:12.645153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:12.645153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 269/513] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:12.645361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933e727-81df-4243-9877-080aecbe716c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:12.661440 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40546f87-8e8a-4020-8c86-b7e442d15575 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:12.688209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:12.695757 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf863f-b029-47c1-86ec-23c247ae9b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:12.696366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf863f-b029-47c1-86ec-23c247ae9b63 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:12.696643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf863f-b029-47c1-86ec-23c247ae9b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:12.696912 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf863f-b029-47c1-86ec-23c247ae9b63 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:12.697550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf863f-b029-47c1-86ec-23c247ae9b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:12.697852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf863f-b029-47c1-86ec-23c247ae9b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:12.699259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf863f-b029-47c1-86ec-23c247ae9b63 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:12.710388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 245/514] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:12.711191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf863f-b029-47c1-86ec-23c247ae9b63 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:12.713748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:12.747722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933e727-81df-4243-9877-080aecbe716c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:12.780527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5634d-58c9-47ef-91c7-a557bc6d7f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:12.781144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5634d-58c9-47ef-91c7-a557bc6d7f9e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:12.781417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5634d-58c9-47ef-91c7-a557bc6d7f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:12.781693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5634d-58c9-47ef-91c7-a557bc6d7f9e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:12.789107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5634d-58c9-47ef-91c7-a557bc6d7f9e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:12.790566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5634d-58c9-47ef-91c7-a557bc6d7f9e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-5ca5634d-58c9-47ef-91c7-a557bc6d7f9e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:12.802743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:12.803644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:12.804699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:12.804699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:12.804699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:12.804699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:12.804699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:12.804699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:12.804699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:12.804699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:12.804699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 23:15:12.804699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:12.804699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 270/515] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:12.805679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5634d-58c9-47ef-91c7-a557bc6d7f9e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:12.815625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf863f-b029-47c1-86ec-23c247ae9b63 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:12.848232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63413155-f0e3-4348-8ea4-0499d29c767e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:12.848831 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63413155-f0e3-4348-8ea4-0499d29c767e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:12.849111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63413155-f0e3-4348-8ea4-0499d29c767e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:12.849379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63413155-f0e3-4348-8ea4-0499d29c767e None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:12.850008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63413155-f0e3-4348-8ea4-0499d29c767e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:12.850311 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63413155-f0e3-4348-8ea4-0499d29c767e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:12.851701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63413155-f0e3-4348-8ea4-0499d29c767e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:12.863435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 246/516] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:12.864209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63413155-f0e3-4348-8ea4-0499d29c767e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:12.906123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5634d-58c9-47ef-91c7-a557bc6d7f9e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:12.907871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:12.926343 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:12.941110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9216d-0ec3-4444-8233-c68fb6adf0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:12.941736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9216d-0ec3-4444-8233-c68fb6adf0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:12.942016 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9216d-0ec3-4444-8233-c68fb6adf0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:12.942287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9216d-0ec3-4444-8233-c68fb6adf0b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:12.952738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9216d-0ec3-4444-8233-c68fb6adf0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:12.954297 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9216d-0ec3-4444-8233-c68fb6adf0b7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:12.964688 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63413155-f0e3-4348-8ea4-0499d29c767e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-38f9216d-0ec3-4444-8233-c68fb6adf0b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:12.968431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:12.969303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:12.970897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:12.970897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:12.970897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:12.970897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 271/517] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:12.970897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9216d-0ec3-4444-8233-c68fb6adf0b7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:12.999897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd47122-5861-4be6-b8a5-475e8f7965a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:13.000500 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd47122-5861-4be6-b8a5-475e8f7965a3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:13.000954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd47122-5861-4be6-b8a5-475e8f7965a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:13.001142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd47122-5861-4be6-b8a5-475e8f7965a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:13.001775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd47122-5861-4be6-b8a5-475e8f7965a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:13.002073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd47122-5861-4be6-b8a5-475e8f7965a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:13.003483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd47122-5861-4be6-b8a5-475e8f7965a3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:13.014999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 247/518] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:13.015698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd47122-5861-4be6-b8a5-475e8f7965a3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:13.078426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9216d-0ec3-4444-8233-c68fb6adf0b7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:13.111789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66054d-6b35-4341-8b87-1ca5412ecde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:13.112440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66054d-6b35-4341-8b87-1ca5412ecde1 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:13.112718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66054d-6b35-4341-8b87-1ca5412ecde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:13.112991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66054d-6b35-4341-8b87-1ca5412ecde1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:13.116848 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd47122-5861-4be6-b8a5-475e8f7965a3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:13.120288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66054d-6b35-4341-8b87-1ca5412ecde1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:13.121722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66054d-6b35-4341-8b87-1ca5412ecde1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-dd66054d-6b35-4341-8b87-1ca5412ecde1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:13.133238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:13.134309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:13.135203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:13.135203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:13.135203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:13.135203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:13.135203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:13.135203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:13.135203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:13.135203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:13.135203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:15:13.135203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:13.135203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 272/519] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:13.135750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66054d-6b35-4341-8b87-1ca5412ecde1 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:13.141721 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:13.150801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:13.154218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a25b83-1b3b-4ecb-be29-3e326b90e655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:13.154857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a25b83-1b3b-4ecb-be29-3e326b90e655 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:13.155137 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a25b83-1b3b-4ecb-be29-3e326b90e655 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:13.155412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a25b83-1b3b-4ecb-be29-3e326b90e655 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:13.156147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a25b83-1b3b-4ecb-be29-3e326b90e655 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:13.156444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a25b83-1b3b-4ecb-be29-3e326b90e655 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:13.158632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a25b83-1b3b-4ecb-be29-3e326b90e655 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:13.176429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 248/520] 10.222.0.33 () {56 vars in 1139 bytes} [Mon Sep 12 23:15:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:13.177415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a25b83-1b3b-4ecb-be29-3e326b90e655 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:13.237655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66054d-6b35-4341-8b87-1ca5412ecde1 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:13.270935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c05d1-9ffe-4482-905d-88c592de8077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:13.271531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c05d1-9ffe-4482-905d-88c592de8077 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:13.271815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c05d1-9ffe-4482-905d-88c592de8077 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:13.272086 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c05d1-9ffe-4482-905d-88c592de8077 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:13.272718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c05d1-9ffe-4482-905d-88c592de8077 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:13.274151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c05d1-9ffe-4482-905d-88c592de8077 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:13.276324 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a25b83-1b3b-4ecb-be29-3e326b90e655 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:13.295089 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 273/521] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:15:13 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:15:13.295901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c05d1-9ffe-4482-905d-88c592de8077 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:13.316210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddcabe-be56-4608-b83f-7bd61b63f2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:13.316842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddcabe-be56-4608-b83f-7bd61b63f2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:13.317120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddcabe-be56-4608-b83f-7bd61b63f2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:13.317390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddcabe-be56-4608-b83f-7bd61b63f2f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:13.318041 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddcabe-be56-4608-b83f-7bd61b63f2f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:13.318348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddcabe-be56-4608-b83f-7bd61b63f2f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:13.319803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddcabe-be56-4608-b83f-7bd61b63f2f6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:13.333129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 249/522] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:13.333908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddcabe-be56-4608-b83f-7bd61b63f2f6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:13.388209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:13.390184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:13.427531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c05d1-9ffe-4482-905d-88c592de8077 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:13.453661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddcabe-be56-4608-b83f-7bd61b63f2f6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:13.465310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0b869-3cbc-479b-8f95-819d9669dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:13.466349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0b869-3cbc-479b-8f95-819d9669dd04 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:13.466662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0b869-3cbc-479b-8f95-819d9669dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:13.466931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0b869-3cbc-479b-8f95-819d9669dd04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:13.474207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0b869-3cbc-479b-8f95-819d9669dd04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:13.475699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0b869-3cbc-479b-8f95-819d9669dd04 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-bfe0b869-3cbc-479b-8f95-819d9669dd04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:13.488294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:13.489146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:13.489995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:13.489995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:13.489995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:13.489995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:13.489995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:13.489995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:13.489995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:13.489995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:13.489995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 274/523] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:13.490679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0b869-3cbc-479b-8f95-819d9669dd04 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:13.503640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e45e07-f048-48fb-bf1a-b46e06650140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:13.504245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e45e07-f048-48fb-bf1a-b46e06650140 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:13.504725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e45e07-f048-48fb-bf1a-b46e06650140 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:13.504830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e45e07-f048-48fb-bf1a-b46e06650140 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:13.505613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e45e07-f048-48fb-bf1a-b46e06650140 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:13.505860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e45e07-f048-48fb-bf1a-b46e06650140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:13.507322 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e45e07-f048-48fb-bf1a-b46e06650140 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:13.527932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 250/524] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Sep 12 23:15:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:13.528776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e45e07-f048-48fb-bf1a-b46e06650140 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:13.604110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0b869-3cbc-479b-8f95-819d9669dd04 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:13.633530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:13.640238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d586621-c48c-4bb1-b4b9-38c22c35617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:13.640851 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d586621-c48c-4bb1-b4b9-38c22c35617a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:13.641128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d586621-c48c-4bb1-b4b9-38c22c35617a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:13.641451 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d586621-c48c-4bb1-b4b9-38c22c35617a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:13.641738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:13.646679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e45e07-f048-48fb-bf1a-b46e06650140 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:13.691421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb66bd-65e5-48b5-aeb0-002cfd9d1d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:13.692054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb66bd-65e5-48b5-aeb0-002cfd9d1d7b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:13.692336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb66bd-65e5-48b5-aeb0-002cfd9d1d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:13.692600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb66bd-65e5-48b5-aeb0-002cfd9d1d7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:13.699405 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb66bd-65e5-48b5-aeb0-002cfd9d1d7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:13.700854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb66bd-65e5-48b5-aeb0-002cfd9d1d7b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2cdb66bd-65e5-48b5-aeb0-002cfd9d1d7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:13.712927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:13.713825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:13.715189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:13.715189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:13.715189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:13.715189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:13.715189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:13.715189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:13.715189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:13.715189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:13.715595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d586621-c48c-4bb1-b4b9-38c22c35617a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:13.715667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 251/525] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:13.715667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb66bd-65e5-48b5-aeb0-002cfd9d1d7b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:13.719837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d586621-c48c-4bb1-b4b9-38c22c35617a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:13.823843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb66bd-65e5-48b5-aeb0-002cfd9d1d7b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:13.831361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 275/526] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:13.832348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d586621-c48c-4bb1-b4b9-38c22c35617a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:13.859478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0c7a4-80b6-479f-bcdb-25bcdde7f5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:13.860053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0c7a4-80b6-479f-bcdb-25bcdde7f5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:13.860499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0c7a4-80b6-479f-bcdb-25bcdde7f5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:13.860802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0c7a4-80b6-479f-bcdb-25bcdde7f5b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:13.861542 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0c7a4-80b6-479f-bcdb-25bcdde7f5b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:13.861844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0c7a4-80b6-479f-bcdb-25bcdde7f5b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:13.863315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0c7a4-80b6-479f-bcdb-25bcdde7f5b2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:13.866812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:13.883205 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 252/527] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:13.884050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0c7a4-80b6-479f-bcdb-25bcdde7f5b2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:13.906651 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:13.948315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d586621-c48c-4bb1-b4b9-38c22c35617a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:13.987169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf1aca-518e-47ff-bbfe-b18cee2e191f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:13.987781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf1aca-518e-47ff-bbfe-b18cee2e191f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:13.988061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf1aca-518e-47ff-bbfe-b18cee2e191f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:13.988324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf1aca-518e-47ff-bbfe-b18cee2e191f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:13.994368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0c7a4-80b6-479f-bcdb-25bcdde7f5b2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:14.031171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d65fc4-0d22-478d-bbfc-437995d12b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:14.031792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d65fc4-0d22-478d-bbfc-437995d12b5c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:14.032574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d65fc4-0d22-478d-bbfc-437995d12b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:14.032848 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d65fc4-0d22-478d-bbfc-437995d12b5c None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:14.033776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d65fc4-0d22-478d-bbfc-437995d12b5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:14.034061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d65fc4-0d22-478d-bbfc-437995d12b5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:14.035557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d65fc4-0d22-478d-bbfc-437995d12b5c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:14.053947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 253/528] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:14.053947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d65fc4-0d22-478d-bbfc-437995d12b5c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:14.068037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf1aca-518e-47ff-bbfe-b18cee2e191f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:14.069500 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf1aca-518e-47ff-bbfe-b18cee2e191f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:14.101839 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:14.137600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:14.162580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d65fc4-0d22-478d-bbfc-437995d12b5c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:14.177699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 276/529] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:14.178911 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf1aca-518e-47ff-bbfe-b18cee2e191f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:14.202851 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b4f6f-f58e-4f47-960f-025f76d70157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:14.203479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b4f6f-f58e-4f47-960f-025f76d70157 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:14.204323 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b4f6f-f58e-4f47-960f-025f76d70157 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:14.204763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b4f6f-f58e-4f47-960f-025f76d70157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:14.217060 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b4f6f-f58e-4f47-960f-025f76d70157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:14.218669 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b4f6f-f58e-4f47-960f-025f76d70157 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-543b4f6f-f58e-4f47-960f-025f76d70157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:14.236449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:14.237412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:14.238243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:14.238243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:14.238243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:14.239088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 254/530] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:14.240522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b4f6f-f58e-4f47-960f-025f76d70157 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:14.293195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf1aca-518e-47ff-bbfe-b18cee2e191f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:14.331716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:14.338961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1e06d-a213-4781-b2bb-aec78ae7cc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:14.339669 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1e06d-a213-4781-b2bb-aec78ae7cc47 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:14.339838 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1e06d-a213-4781-b2bb-aec78ae7cc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:14.340111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1e06d-a213-4781-b2bb-aec78ae7cc47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:14.340958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1e06d-a213-4781-b2bb-aec78ae7cc47 None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=46f96bbb14c04691ac403271de293224) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:14.341129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1e06d-a213-4781-b2bb-aec78ae7cc47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:14.342577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1e06d-a213-4781-b2bb-aec78ae7cc47 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:14.347911 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 277/531] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:14 2022] GET /identity/v3/role_assignments?user.id=46f96bbb14c04691ac403271de293224&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:14.350708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b4f6f-f58e-4f47-960f-025f76d70157 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:14.355435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1e06d-a213-4781-b2bb-aec78ae7cc47 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:14.392505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:14.400418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae241ebf-81b7-479e-8975-c7a78ee6199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:14.401098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae241ebf-81b7-479e-8975-c7a78ee6199d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:14.401324 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae241ebf-81b7-479e-8975-c7a78ee6199d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:14.401959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae241ebf-81b7-479e-8975-c7a78ee6199d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:14.402751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae241ebf-81b7-479e-8975-c7a78ee6199d None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=67b0698294e94845ae0dbdfb87059755) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:14.403112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae241ebf-81b7-479e-8975-c7a78ee6199d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:14.404580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae241ebf-81b7-479e-8975-c7a78ee6199d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:14.412119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 255/532] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:14 2022] GET /identity/v3/role_assignments?user.id=67b0698294e94845ae0dbdfb87059755&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:14.413059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae241ebf-81b7-479e-8975-c7a78ee6199d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:14.503637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1e06d-a213-4781-b2bb-aec78ae7cc47 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:14.541984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae241ebf-81b7-479e-8975-c7a78ee6199d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:14.542533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feac14a-23cd-4170-9068-3b8c1b0f7876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:14.543198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac14a-23cd-4170-9068-3b8c1b0f7876 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:14.543481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac14a-23cd-4170-9068-3b8c1b0f7876 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:14.543755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac14a-23cd-4170-9068-3b8c1b0f7876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:14.556146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feac14a-23cd-4170-9068-3b8c1b0f7876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:14.557645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feac14a-23cd-4170-9068-3b8c1b0f7876 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-1feac14a-23cd-4170-9068-3b8c1b0f7876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:14.574640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:14.575614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:14.576483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:14.576483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:14.576483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:14.576483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 278/533] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:14.582966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feac14a-23cd-4170-9068-3b8c1b0f7876 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:14.590632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aa014-4392-4bff-8626-dbf3364b449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:14.591545 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aa014-4392-4bff-8626-dbf3364b449f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:14.591973 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aa014-4392-4bff-8626-dbf3364b449f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:14.592389 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aa014-4392-4bff-8626-dbf3364b449f None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:14.593215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aa014-4392-4bff-8626-dbf3364b449f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:14.593825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aa014-4392-4bff-8626-dbf3364b449f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:14.596397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aa014-4392-4bff-8626-dbf3364b449f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:14.611939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 256/534] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:14.617732 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aa014-4392-4bff-8626-dbf3364b449f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:14.639316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:14.689988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:14.705913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feac14a-23cd-4170-9068-3b8c1b0f7876 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:14.741591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aa014-4392-4bff-8626-dbf3364b449f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:14.742292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384304a-f486-4333-bfc3-2047f14b9596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:14.743037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384304a-f486-4333-bfc3-2047f14b9596 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:14.743439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384304a-f486-4333-bfc3-2047f14b9596 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:14.743807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384304a-f486-4333-bfc3-2047f14b9596 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:14.744560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384304a-f486-4333-bfc3-2047f14b9596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:14.746607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384304a-f486-4333-bfc3-2047f14b9596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:14.747306 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384304a-f486-4333-bfc3-2047f14b9596 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:14.760618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 279/535] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:14.765921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384304a-f486-4333-bfc3-2047f14b9596 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:14.784608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ecd48-4bb4-47ae-bfe0-7fb7e75a173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:14.785534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ecd48-4bb4-47ae-bfe0-7fb7e75a173f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:14.786080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ecd48-4bb4-47ae-bfe0-7fb7e75a173f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:14.786572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ecd48-4bb4-47ae-bfe0-7fb7e75a173f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:14.794445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ecd48-4bb4-47ae-bfe0-7fb7e75a173f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:14.796084 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ecd48-4bb4-47ae-bfe0-7fb7e75a173f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-736ecd48-4bb4-47ae-bfe0-7fb7e75a173f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:14.808534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:14.809393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:14.810191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:14.810191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:14.810191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:14.810191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:14.810191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:14.810191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:14.810191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:14.810191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:14.812328 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 257/536] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:14.821581 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ecd48-4bb4-47ae-bfe0-7fb7e75a173f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:14.883317 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384304a-f486-4333-bfc3-2047f14b9596 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:14.888940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:14.941782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8edf58-7cff-4bc4-a399-2569fd337a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:14.943565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8edf58-7cff-4bc4-a399-2569fd337a04 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:14.945523 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8edf58-7cff-4bc4-a399-2569fd337a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:14.946964 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8edf58-7cff-4bc4-a399-2569fd337a04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:14.964959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8edf58-7cff-4bc4-a399-2569fd337a04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:14.966777 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8edf58-7cff-4bc4-a399-2569fd337a04 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-be8edf58-7cff-4bc4-a399-2569fd337a04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:14.989125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:14.990002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:14.990880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:14.990880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:14.990880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:14.990880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:14.990880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:14.990880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:14.990880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:14.990880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:14.990880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 280/537] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:14.999334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8edf58-7cff-4bc4-a399-2569fd337a04 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:15.001861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ecd48-4bb4-47ae-bfe0-7fb7e75a173f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:15.018627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:15.046910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ce79c-5b9c-44fd-9db1-0fb29dcf39c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:15.048513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ce79c-5b9c-44fd-9db1-0fb29dcf39c3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:15.049375 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ce79c-5b9c-44fd-9db1-0fb29dcf39c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:15.050944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ce79c-5b9c-44fd-9db1-0fb29dcf39c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:15.051970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ce79c-5b9c-44fd-9db1-0fb29dcf39c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:15.053702 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ce79c-5b9c-44fd-9db1-0fb29dcf39c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:15.055952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ce79c-5b9c-44fd-9db1-0fb29dcf39c3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:15.083763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 258/538] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:15.084915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ce79c-5b9c-44fd-9db1-0fb29dcf39c3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:15.181139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8edf58-7cff-4bc4-a399-2569fd337a04 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:15.244029 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e1f54-ddbc-4857-b773-938341e3f2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:15.244951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e1f54-ddbc-4857-b773-938341e3f2df None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:15.245547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e1f54-ddbc-4857-b773-938341e3f2df None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:15.245987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e1f54-ddbc-4857-b773-938341e3f2df None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:15.247123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e1f54-ddbc-4857-b773-938341e3f2df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:15.247650 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e1f54-ddbc-4857-b773-938341e3f2df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:15.249459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e1f54-ddbc-4857-b773-938341e3f2df None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:15.272800 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 281/539] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:15.278826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e1f54-ddbc-4857-b773-938341e3f2df None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:15.284963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ce79c-5b9c-44fd-9db1-0fb29dcf39c3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:15.312949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:15.367517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44156ba6-f6e6-4ab2-85cd-0d105e522a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:15.367725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44156ba6-f6e6-4ab2-85cd-0d105e522a19 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:15.368017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44156ba6-f6e6-4ab2-85cd-0d105e522a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:15.368303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44156ba6-f6e6-4ab2-85cd-0d105e522a19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:15.369050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44156ba6-f6e6-4ab2-85cd-0d105e522a19 None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=b1d4b0f322c741c5b69b922071aab3d6) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:15.369364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44156ba6-f6e6-4ab2-85cd-0d105e522a19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:15.370852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44156ba6-f6e6-4ab2-85cd-0d105e522a19 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:15.392174 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 259/540] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:15 2022] GET /identity/v3/role_assignments?user.id=b1d4b0f322c741c5b69b922071aab3d6&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:15.414659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e1f54-ddbc-4857-b773-938341e3f2df None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:15.455557 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152edbaf-33bd-418d-9a2c-9c49d77bd224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:15.456579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152edbaf-33bd-418d-9a2c-9c49d77bd224 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:15.457069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152edbaf-33bd-418d-9a2c-9c49d77bd224 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:15.457527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152edbaf-33bd-418d-9a2c-9c49d77bd224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:15.458535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152edbaf-33bd-418d-9a2c-9c49d77bd224 None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=4f5d6fe6235447acb395030fb0f0555d) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:15.459080 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152edbaf-33bd-418d-9a2c-9c49d77bd224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:15.460708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152edbaf-33bd-418d-9a2c-9c49d77bd224 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:15.467603 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 282/541] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:15 2022] GET /identity/v3/role_assignments?user.id=4f5d6fe6235447acb395030fb0f0555d&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:15.608198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d1b17-4793-48cb-8cab-7cb1596076c8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:15.608709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d1b17-4793-48cb-8cab-7cb1596076c8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:15.608709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d1b17-4793-48cb-8cab-7cb1596076c8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:15.610953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 260/542] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:15.616928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650a0c9-76cb-40ef-bc2f-1459b18affcf None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:15.617431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650a0c9-76cb-40ef-bc2f-1459b18affcf None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:15.617531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650a0c9-76cb-40ef-bc2f-1459b18affcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:15.648476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c650a0c9-76cb-40ef-bc2f-1459b18affcf None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:15.649724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c650a0c9-76cb-40ef-bc2f-1459b18affcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:15.736956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 283/543] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:16.006140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d1b17-4793-48cb-8cab-7cb1596076c8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:16.056476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:16.137742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d1b17-4793-48cb-8cab-7cb1596076c8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:16.185904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821bbcc-10bb-4b2a-bd25-11d9c02e8fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:16.186565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821bbcc-10bb-4b2a-bd25-11d9c02e8fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:16.186847 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821bbcc-10bb-4b2a-bd25-11d9c02e8fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:16.187119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821bbcc-10bb-4b2a-bd25-11d9c02e8fb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:16.206758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821bbcc-10bb-4b2a-bd25-11d9c02e8fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1821bbcc-10bb-4b2a-bd25-11d9c02e8fb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:16.212021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:16.212854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:16.213605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:16.213605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:16.213605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:16.213605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:16.213605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:16.213605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:16.213605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:16.213605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:16.213605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:16.213605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:16.213605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:16.213605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:16.217643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 261/544] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:16.219124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650a0c9-76cb-40ef-bc2f-1459b18affcf None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:16.255215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:16.352004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650a0c9-76cb-40ef-bc2f-1459b18affcf None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:16.400286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3c718-162e-4224-8d46-7fce02cb84e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:16.400897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3c718-162e-4224-8d46-7fce02cb84e8 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:16.401176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3c718-162e-4224-8d46-7fce02cb84e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:16.401450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3c718-162e-4224-8d46-7fce02cb84e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:16.402117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3c718-162e-4224-8d46-7fce02cb84e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:16.402445 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3c718-162e-4224-8d46-7fce02cb84e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:16.403897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3c718-162e-4224-8d46-7fce02cb84e8 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:16.412606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 284/545] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:16.418119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821bbcc-10bb-4b2a-bd25-11d9c02e8fb7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:16.567212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:16.574675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821bbcc-10bb-4b2a-bd25-11d9c02e8fb7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:16.622119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a29d0c-76b6-46f7-a0c8-2890b04b0f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:16.622781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a29d0c-76b6-46f7-a0c8-2890b04b0f9f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:16.623003 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a29d0c-76b6-46f7-a0c8-2890b04b0f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:16.623233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a29d0c-76b6-46f7-a0c8-2890b04b0f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:16.634934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a29d0c-76b6-46f7-a0c8-2890b04b0f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:16.636471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a29d0c-76b6-46f7-a0c8-2890b04b0f9f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-50a29d0c-76b6-46f7-a0c8-2890b04b0f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:16.651737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:16.652659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:16.653469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:16.653469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:16.653469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:16.653469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 262/546] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:16.659294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3c718-162e-4224-8d46-7fce02cb84e8 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:16.772442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:16.805599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3c718-162e-4224-8d46-7fce02cb84e8 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:16.851536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56756a6-4b84-49ec-898d-f8f32c220f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:16.852146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56756a6-4b84-49ec-898d-f8f32c220f02 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:16.852479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56756a6-4b84-49ec-898d-f8f32c220f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:16.852760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56756a6-4b84-49ec-898d-f8f32c220f02 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:16.853404 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56756a6-4b84-49ec-898d-f8f32c220f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:16.853708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56756a6-4b84-49ec-898d-f8f32c220f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:16.855100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56756a6-4b84-49ec-898d-f8f32c220f02 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:16.877318 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 285/547] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:16.882331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a29d0c-76b6-46f7-a0c8-2890b04b0f9f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:17.045131 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a29d0c-76b6-46f7-a0c8-2890b04b0f9f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:17.089832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b7fb9-4069-4c5f-8934-5d3599bdb887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:17.090500 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b7fb9-4069-4c5f-8934-5d3599bdb887 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:17.090785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b7fb9-4069-4c5f-8934-5d3599bdb887 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:17.091058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b7fb9-4069-4c5f-8934-5d3599bdb887 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:17.104687 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b7fb9-4069-4c5f-8934-5d3599bdb887 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:17.106139 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b7fb9-4069-4c5f-8934-5d3599bdb887 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-096b7fb9-4069-4c5f-8934-5d3599bdb887 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:17.121764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:17.123184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:17.124244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:17.124244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:17.124244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:17.124244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:17.124244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:17.124244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:17.124244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:17.124244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:17.124244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:15:17.124244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:17.126489 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 263/548] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:17.131548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56756a6-4b84-49ec-898d-f8f32c220f02 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:17.287066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56756a6-4b84-49ec-898d-f8f32c220f02 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:17.287950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f2ab-d82d-4ccf-8ee0-55460b30fb9a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:17.288235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f2ab-d82d-4ccf-8ee0-55460b30fb9a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:17.288509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f2ab-d82d-4ccf-8ee0-55460b30fb9a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:17.289827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 264/549] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:17.295236 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620f953-3409-4076-9eae-6f9059478381 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:17.295529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620f953-3409-4076-9eae-6f9059478381 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:17.295805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620f953-3409-4076-9eae-6f9059478381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:17.316111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e620f953-3409-4076-9eae-6f9059478381 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:17.317333 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e620f953-3409-4076-9eae-6f9059478381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:17.320377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:17.327008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6830a2-8c1a-4589-b7be-cced8859aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:17.327623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6830a2-8c1a-4589-b7be-cced8859aa21 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:17.327900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6830a2-8c1a-4589-b7be-cced8859aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:17.328173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6830a2-8c1a-4589-b7be-cced8859aa21 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:17.328951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6830a2-8c1a-4589-b7be-cced8859aa21 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:17.329256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6830a2-8c1a-4589-b7be-cced8859aa21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:17.330703 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6830a2-8c1a-4589-b7be-cced8859aa21 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:17.348325 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:17.351856 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 286/550] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Sep 12 23:15:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:17.353847 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c160b4-5ccd-4e6e-9d82-8746c1e6d267 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:17.354229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c160b4-5ccd-4e6e-9d82-8746c1e6d267 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:17.354671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c160b4-5ccd-4e6e-9d82-8746c1e6d267 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:17.356216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 287/551] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:17.357042 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c160b4-5ccd-4e6e-9d82-8746c1e6d267 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:17.410422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 265/552] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:17.410422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842cec3-9f09-4c88-b17c-1edd2090e01a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:17.410422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842cec3-9f09-4c88-b17c-1edd2090e01a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:17.410712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842cec3-9f09-4c88-b17c-1edd2090e01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:17.443052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d842cec3-9f09-4c88-b17c-1edd2090e01a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:17.444265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d842cec3-9f09-4c88-b17c-1edd2090e01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:17.495778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c160b4-5ccd-4e6e-9d82-8746c1e6d267 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:17.568624 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558c805-3efb-40e9-ad1e-31c6fb1a3b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:17.569241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558c805-3efb-40e9-ad1e-31c6fb1a3b8c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:17.569525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558c805-3efb-40e9-ad1e-31c6fb1a3b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:17.569807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558c805-3efb-40e9-ad1e-31c6fb1a3b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:17.572275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 266/553] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:17.664886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:17.668322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558c805-3efb-40e9-ad1e-31c6fb1a3b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:17.670194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558c805-3efb-40e9-ad1e-31c6fb1a3b8c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:17.723538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842cec3-9f09-4c88-b17c-1edd2090e01a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:17.794859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 288/554] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:17.800591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558c805-3efb-40e9-ad1e-31c6fb1a3b8c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:17.888570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:17.905106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:17.909994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558c805-3efb-40e9-ad1e-31c6fb1a3b8c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:17.931609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842cec3-9f09-4c88-b17c-1edd2090e01a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:17.971512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995d5ef-580d-4c15-a4a4-cf00ff34f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:17.972145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995d5ef-580d-4c15-a4a4-cf00ff34f8ea None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:17.972418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995d5ef-580d-4c15-a4a4-cf00ff34f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:17.972687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995d5ef-580d-4c15-a4a4-cf00ff34f8ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:17.973610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64964-c8bc-48c3-ae6f-933d359c486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:17.974258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64964-c8bc-48c3-ae6f-933d359c486a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:17.974834 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64964-c8bc-48c3-ae6f-933d359c486a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:17.975110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64964-c8bc-48c3-ae6f-933d359c486a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:17.983613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995d5ef-580d-4c15-a4a4-cf00ff34f8ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:17.986272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995d5ef-580d-4c15-a4a4-cf00ff34f8ea None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:17.989247 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae64964-c8bc-48c3-ae6f-933d359c486a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1ae64964-c8bc-48c3-ae6f-933d359c486a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:17.994662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:17.995550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:17.996362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:17.996362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:17.996362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:17.996362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:17.996362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:17.996362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:17.996362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:17.996362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:17.996362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:17.996362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:17.996362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:17.996362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:18.001710 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 267/555] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:18.002330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64964-c8bc-48c3-ae6f-933d359c486a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-8995d5ef-580d-4c15-a4a4-cf00ff34f8ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:18.003879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:18.004782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:18.005627 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:18.005627 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:18.005627 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:18.005627 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 289/556] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:18.007070 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995d5ef-580d-4c15-a4a4-cf00ff34f8ea None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:18.130109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995d5ef-580d-4c15-a4a4-cf00ff34f8ea None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:18.145043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64964-c8bc-48c3-ae6f-933d359c486a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:18.175304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb890822-db20-4bd7-acd9-284d20a99e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:18.175915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890822-db20-4bd7-acd9-284d20a99e5b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.176195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890822-db20-4bd7-acd9-284d20a99e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.176465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890822-db20-4bd7-acd9-284d20a99e5b None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.176599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:18.177134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb890822-db20-4bd7-acd9-284d20a99e5b None admin] RBAC: Adding query filter params (name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:18.177435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb890822-db20-4bd7-acd9-284d20a99e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:18.178835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb890822-db20-4bd7-acd9-284d20a99e5b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:18.183038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eb538-0ac3-4a49-8a0d-ff1f9193e283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:18.183939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eb538-0ac3-4a49-8a0d-ff1f9193e283 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.184416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eb538-0ac3-4a49-8a0d-ff1f9193e283 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.184687 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eb538-0ac3-4a49-8a0d-ff1f9193e283 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.187414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 290/557] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:18.191666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb890822-db20-4bd7-acd9-284d20a99e5b None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:18.196828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6eb538-0ac3-4a49-8a0d-ff1f9193e283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2c6eb538-0ac3-4a49-8a0d-ff1f9193e283 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:18.201596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:18.204607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 268/558] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:18.205424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d03415-ffda-4a4e-9093-0c936066fdc1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.206160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d03415-ffda-4a4e-9093-0c936066fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.206160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d03415-ffda-4a4e-9093-0c936066fdc1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.207786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 269/559] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:18.208267 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d03415-ffda-4a4e-9093-0c936066fdc1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:18.213756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:18.304333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb890822-db20-4bd7-acd9-284d20a99e5b None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:18.319389 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d03415-ffda-4a4e-9093-0c936066fdc1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:18.340904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476683ef-3249-41f3-909e-995e6cf3f21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:18.341515 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476683ef-3249-41f3-909e-995e6cf3f21f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.341798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476683ef-3249-41f3-909e-995e6cf3f21f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.342077 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476683ef-3249-41f3-909e-995e6cf3f21f None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.342766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476683ef-3249-41f3-909e-995e6cf3f21f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:18.343072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476683ef-3249-41f3-909e-995e6cf3f21f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:18.344678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476683ef-3249-41f3-909e-995e6cf3f21f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:18.356596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 291/560] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:18.357293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52747b50-a0b1-482b-9cee-9c9405f394b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:18.357775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b856-eadd-46cf-8b86-57920ba7a023 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.358059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b856-eadd-46cf-8b86-57920ba7a023 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.358332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b856-eadd-46cf-8b86-57920ba7a023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.358942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52747b50-a0b1-482b-9cee-9c9405f394b5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.359415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52747b50-a0b1-482b-9cee-9c9405f394b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.359929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52747b50-a0b1-482b-9cee-9c9405f394b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.371902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52747b50-a0b1-482b-9cee-9c9405f394b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:18.373689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52747b50-a0b1-482b-9cee-9c9405f394b5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:18.377300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e337b856-eadd-46cf-8b86-57920ba7a023 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:18.378542 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e337b856-eadd-46cf-8b86-57920ba7a023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-52747b50-a0b1-482b-9cee-9c9405f394b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:18.397081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:18.398218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:18.399751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:18.399751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:18.399751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:18.399751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 270/561] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:18.399751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52747b50-a0b1-482b-9cee-9c9405f394b5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:18.445509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:18.457859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 292/562] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:18.458724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337b856-eadd-46cf-8b86-57920ba7a023 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:18.462132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:18.513599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52747b50-a0b1-482b-9cee-9c9405f394b5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:18.549580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d7dec-0be0-4e56-b6c4-aa632f3c3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:18.550194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d7dec-0be0-4e56-b6c4-aa632f3c3f04 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.550506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d7dec-0be0-4e56-b6c4-aa632f3c3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.550783 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d7dec-0be0-4e56-b6c4-aa632f3c3f04 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.551449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d7dec-0be0-4e56-b6c4-aa632f3c3f04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:18.551759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d7dec-0be0-4e56-b6c4-aa632f3c3f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:18.553138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d7dec-0be0-4e56-b6c4-aa632f3c3f04 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:18.560948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 271/563] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:18.561727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d7dec-0be0-4e56-b6c4-aa632f3c3f04 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:18.575582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337b856-eadd-46cf-8b86-57920ba7a023 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:18.618256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbd252-deca-49f3-8982-ba638f445284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:18.619298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbd252-deca-49f3-8982-ba638f445284 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.619834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbd252-deca-49f3-8982-ba638f445284 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.620286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbd252-deca-49f3-8982-ba638f445284 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.627714 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbd252-deca-49f3-8982-ba638f445284 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:18.629132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbd252-deca-49f3-8982-ba638f445284 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-27cbd252-deca-49f3-8982-ba638f445284 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:18.641003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:18.642635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:18.643531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:18.643531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:18.643531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:18.643531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:18.643531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:18.643531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:18.643531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:18.643531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:18.643531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 293/564] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:18.644001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03c1e1-a929-443c-8a24-592b7c4bc7c9 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.644889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03c1e1-a929-443c-8a24-592b7c4bc7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.644889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03c1e1-a929-443c-8a24-592b7c4bc7c9 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.650149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 294/565] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:18.650149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03c1e1-a929-443c-8a24-592b7c4bc7c9 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:18.677684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d7dec-0be0-4e56-b6c4-aa632f3c3f04 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:18.680030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:18.713911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd962806-a4a5-4791-a72a-7512acbe37e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:18.714467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd962806-a4a5-4791-a72a-7512acbe37e9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.714760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd962806-a4a5-4791-a72a-7512acbe37e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.715020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd962806-a4a5-4791-a72a-7512acbe37e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.715665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd962806-a4a5-4791-a72a-7512acbe37e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:18.715974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd962806-a4a5-4791-a72a-7512acbe37e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:18.717355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd962806-a4a5-4791-a72a-7512acbe37e9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:18.719923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:18.732592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 272/566] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:18.734154 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd962806-a4a5-4791-a72a-7512acbe37e9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:18.760938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03c1e1-a929-443c-8a24-592b7c4bc7c9 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:18.795970 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593eb817-9734-4517-af46-b89027c1fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:18.796598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eb817-9734-4517-af46-b89027c1fd8d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.796878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eb817-9734-4517-af46-b89027c1fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.797155 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eb817-9734-4517-af46-b89027c1fd8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.807124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593eb817-9734-4517-af46-b89027c1fd8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:18.808560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593eb817-9734-4517-af46-b89027c1fd8d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-593eb817-9734-4517-af46-b89027c1fd8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:18.822873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:18.823975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:18.824865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:18.824865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:18.824865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:18.824865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 295/567] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:18.825237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404f33e-367f-43d9-925f-31ce8a0eeba5 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.825720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404f33e-367f-43d9-925f-31ce8a0eeba5 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.826001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404f33e-367f-43d9-925f-31ce8a0eeba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.836792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd962806-a4a5-4791-a72a-7512acbe37e9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:18.844270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e404f33e-367f-43d9-925f-31ce8a0eeba5 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:18.846235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e404f33e-367f-43d9-925f-31ce8a0eeba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:18.871634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aef83d-0f86-4e60-b755-963bce381791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:18.872249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aef83d-0f86-4e60-b755-963bce381791 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:18.872525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aef83d-0f86-4e60-b755-963bce381791 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:18.872799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aef83d-0f86-4e60-b755-963bce381791 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:18.873486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aef83d-0f86-4e60-b755-963bce381791 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:18.873793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aef83d-0f86-4e60-b755-963bce381791 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:18.875266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aef83d-0f86-4e60-b755-963bce381791 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:18.886585 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 273/568] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:18.887369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aef83d-0f86-4e60-b755-963bce381791 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:18.912392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:18.916834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 296/569] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:18.917672 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404f33e-367f-43d9-925f-31ce8a0eeba5 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:18.964128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:19.003354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aef83d-0f86-4e60-b755-963bce381791 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:19.022767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404f33e-367f-43d9-925f-31ce8a0eeba5 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:19.040051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b4ef5-69a1-43e1-b341-b51e1b867394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:19.040691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b4ef5-69a1-43e1-b341-b51e1b867394 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:19.041223 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b4ef5-69a1-43e1-b341-b51e1b867394 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:19.041501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b4ef5-69a1-43e1-b341-b51e1b867394 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:19.051923 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b4ef5-69a1-43e1-b341-b51e1b867394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-841b4ef5-69a1-43e1-b341-b51e1b867394 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:19.057179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:19.058088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:19.058936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 274/570] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:19.059660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b4ef5-69a1-43e1-b341-b51e1b867394 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:19.060915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d648889-75f1-448c-87fa-6413b5256b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:19.061545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648889-75f1-448c-87fa-6413b5256b45 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:19.061822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648889-75f1-448c-87fa-6413b5256b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:19.062090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648889-75f1-448c-87fa-6413b5256b45 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:19.070349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d648889-75f1-448c-87fa-6413b5256b45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:19.071841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d648889-75f1-448c-87fa-6413b5256b45 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-4d648889-75f1-448c-87fa-6413b5256b45 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:19.084699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:19.085633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:19.091538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:19.091538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:19.091538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:19.091538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:19.091538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:19.091538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:19.091538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:19.091538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:19.091538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 12 23:15:19.091538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:19.091538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 297/571] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:19.091538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d648889-75f1-448c-87fa-6413b5256b45 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:19.155740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:19.172502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b4ef5-69a1-43e1-b341-b51e1b867394 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:19.201592 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d648889-75f1-448c-87fa-6413b5256b45 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:19.206863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdf4a4-ee57-4a21-b5be-6792952b9118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:19.207475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdf4a4-ee57-4a21-b5be-6792952b9118 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:19.207756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdf4a4-ee57-4a21-b5be-6792952b9118 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:19.208029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdf4a4-ee57-4a21-b5be-6792952b9118 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:19.208677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdf4a4-ee57-4a21-b5be-6792952b9118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:19.208809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:19.208979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdf4a4-ee57-4a21-b5be-6792952b9118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:19.210532 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdf4a4-ee57-4a21-b5be-6792952b9118 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:19.223250 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 275/572] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:19.226873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdf4a4-ee57-4a21-b5be-6792952b9118 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:19.238115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9108ead-15f6-46a7-b384-f3d54e26b665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:19.238751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9108ead-15f6-46a7-b384-f3d54e26b665 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:19.239024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9108ead-15f6-46a7-b384-f3d54e26b665 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:19.239291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9108ead-15f6-46a7-b384-f3d54e26b665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:19.240007 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9108ead-15f6-46a7-b384-f3d54e26b665 None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=53214ffdc5d04c14b3b3ac868862480b) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:19.240306 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9108ead-15f6-46a7-b384-f3d54e26b665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:19.241741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9108ead-15f6-46a7-b384-f3d54e26b665 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:19.247078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 298/573] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:19 2022] GET /identity/v3/role_assignments?user.id=53214ffdc5d04c14b3b3ac868862480b&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:19.247834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9108ead-15f6-46a7-b384-f3d54e26b665 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:19.338947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdf4a4-ee57-4a21-b5be-6792952b9118 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:19.368673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9108ead-15f6-46a7-b384-f3d54e26b665 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:19.384971 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd90732-452e-4dd1-9d07-40ac50c8648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:19.385604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd90732-452e-4dd1-9d07-40ac50c8648b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:19.385882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd90732-452e-4dd1-9d07-40ac50c8648b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:19.386266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd90732-452e-4dd1-9d07-40ac50c8648b None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:19.386982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd90732-452e-4dd1-9d07-40ac50c8648b None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:19.387291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd90732-452e-4dd1-9d07-40ac50c8648b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:19.388699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd90732-452e-4dd1-9d07-40ac50c8648b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:19.399185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 276/574] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:19.399885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd90732-452e-4dd1-9d07-40ac50c8648b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:19.409629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:19.418599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24554ec1-4ac1-429f-be12-8e82e4527737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:19.419227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554ec1-4ac1-429f-be12-8e82e4527737 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:19.419580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554ec1-4ac1-429f-be12-8e82e4527737 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:19.419790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554ec1-4ac1-429f-be12-8e82e4527737 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:19.420517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24554ec1-4ac1-429f-be12-8e82e4527737 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:19.420827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24554ec1-4ac1-429f-be12-8e82e4527737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:19.422818 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24554ec1-4ac1-429f-be12-8e82e4527737 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:19.441959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 299/575] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Sep 12 23:15:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:19.442862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24554ec1-4ac1-429f-be12-8e82e4527737 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:19.472307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:19.522403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd90732-452e-4dd1-9d07-40ac50c8648b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:19.550370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24554ec1-4ac1-429f-be12-8e82e4527737 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:19.562214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00436695-efcf-490a-bcd3-2fe66796bf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:19.562912 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00436695-efcf-490a-bcd3-2fe66796bf4c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:19.563292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00436695-efcf-490a-bcd3-2fe66796bf4c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:19.563571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00436695-efcf-490a-bcd3-2fe66796bf4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:19.574536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00436695-efcf-490a-bcd3-2fe66796bf4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-00436695-efcf-490a-bcd3-2fe66796bf4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:19.580591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:19.581505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:19.582335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 277/576] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:19.583038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00436695-efcf-490a-bcd3-2fe66796bf4c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:19.593340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f89e4-4ad6-4979-bbba-9bb4d5fcb333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:19.593971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f89e4-4ad6-4979-bbba-9bb4d5fcb333 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:19.594354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f89e4-4ad6-4979-bbba-9bb4d5fcb333 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:19.594866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f89e4-4ad6-4979-bbba-9bb4d5fcb333 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:19.602201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f89e4-4ad6-4979-bbba-9bb4d5fcb333 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:19.603669 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f89e4-4ad6-4979-bbba-9bb4d5fcb333 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-a64f89e4-4ad6-4979-bbba-9bb4d5fcb333 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:19.616130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:19.617066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:19.618004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:19.618004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:19.618004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:19.618004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:19.618004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:19.618004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:19.618004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:19.618004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:19.618004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:15:19.618004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:19.618004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 300/577] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Sep 12 23:15:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:19.618004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f89e4-4ad6-4979-bbba-9bb4d5fcb333 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:19.664641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:19.706604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00436695-efcf-490a-bcd3-2fe66796bf4c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:19.720728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:19.733022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f89e4-4ad6-4979-bbba-9bb4d5fcb333 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:19.746307 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5b6c3-02a2-4384-996d-d437e03356a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:19.747484 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5b6c3-02a2-4384-996d-d437e03356a1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:19.747914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5b6c3-02a2-4384-996d-d437e03356a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:19.748180 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5b6c3-02a2-4384-996d-d437e03356a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:19.760005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5b6c3-02a2-4384-996d-d437e03356a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:19.761468 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5b6c3-02a2-4384-996d-d437e03356a1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:19.768772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543ae79-fc28-4043-a7ba-89b59dc08b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:19.769397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543ae79-fc28-4043-a7ba-89b59dc08b83 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:19.769721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543ae79-fc28-4043-a7ba-89b59dc08b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:19.770038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543ae79-fc28-4043-a7ba-89b59dc08b83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a3f5b6c3-02a2-4384-996d-d437e03356a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:19.776340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:19.777248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:19.778095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:19.778095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:19.778095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:19.779943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 278/578] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:19.780726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5b6c3-02a2-4384-996d-d437e03356a1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:19.785985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543ae79-fc28-4043-a7ba-89b59dc08b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:19.787675 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543ae79-fc28-4043-a7ba-89b59dc08b83 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-d543ae79-fc28-4043-a7ba-89b59dc08b83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:19.803815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:19.804766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:19.805628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:19.805628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:19.805628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:19.809756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 301/579] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:19.810333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543ae79-fc28-4043-a7ba-89b59dc08b83 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:19.895278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5b6c3-02a2-4384-996d-d437e03356a1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:19.912781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:19.917631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543ae79-fc28-4043-a7ba-89b59dc08b83 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:19.931158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c30111-d826-4e9a-a207-a24d67759be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:19.931763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c30111-d826-4e9a-a207-a24d67759be8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:19.932037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c30111-d826-4e9a-a207-a24d67759be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:19.932308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c30111-d826-4e9a-a207-a24d67759be8 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:19.932968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c30111-d826-4e9a-a207-a24d67759be8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:19.933265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c30111-d826-4e9a-a207-a24d67759be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:19.934761 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c30111-d826-4e9a-a207-a24d67759be8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:19.948618 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 279/580] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:19.948618 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c30111-d826-4e9a-a207-a24d67759be8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:19.958692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d5b6-5781-4103-ba33-3fe8e361da80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:19.959409 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d5b6-5781-4103-ba33-3fe8e361da80 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:19.959751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d5b6-5781-4103-ba33-3fe8e361da80 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:19.960124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d5b6-5781-4103-ba33-3fe8e361da80 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:19.960834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d5b6-5781-4103-ba33-3fe8e361da80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:19.961140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d5b6-5781-4103-ba33-3fe8e361da80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:19.962618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d5b6-5781-4103-ba33-3fe8e361da80 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:19.973665 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:19.988447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 302/581] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Sep 12 23:15:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:19.988447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d5b6-5781-4103-ba33-3fe8e361da80 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:20.056629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c30111-d826-4e9a-a207-a24d67759be8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:20.092502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a8cd0-bc48-4aa9-8eb9-9f1905bde2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:20.093113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a8cd0-bc48-4aa9-8eb9-9f1905bde2ce None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:20.093390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a8cd0-bc48-4aa9-8eb9-9f1905bde2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:20.093664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a8cd0-bc48-4aa9-8eb9-9f1905bde2ce None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:20.094996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a8cd0-bc48-4aa9-8eb9-9f1905bde2ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:20.095309 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a8cd0-bc48-4aa9-8eb9-9f1905bde2ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:20.096764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a8cd0-bc48-4aa9-8eb9-9f1905bde2ce None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:20.101220 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d5b6-5781-4103-ba33-3fe8e361da80 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:20.110566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 280/582] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:20.111251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a8cd0-bc48-4aa9-8eb9-9f1905bde2ce None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:20.145106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1686c72-5d79-4bd6-bb88-e6676110f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:20.146070 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1686c72-5d79-4bd6-bb88-e6676110f60e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:20.146512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1686c72-5d79-4bd6-bb88-e6676110f60e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:20.146928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1686c72-5d79-4bd6-bb88-e6676110f60e None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:20.147726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1686c72-5d79-4bd6-bb88-e6676110f60e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:20.148167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1686c72-5d79-4bd6-bb88-e6676110f60e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:20.150832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1686c72-5d79-4bd6-bb88-e6676110f60e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:20.158216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:20.166498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 303/583] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:20.167772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1686c72-5d79-4bd6-bb88-e6676110f60e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:20.217716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a8cd0-bc48-4aa9-8eb9-9f1905bde2ce None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:20.236778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:20.253617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f623e-569f-4c40-8e5f-f406c91c4500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:20.254249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f623e-569f-4c40-8e5f-f406c91c4500 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:20.254611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f623e-569f-4c40-8e5f-f406c91c4500 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:20.254882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f623e-569f-4c40-8e5f-f406c91c4500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:20.264958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f623e-569f-4c40-8e5f-f406c91c4500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:20.267082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f623e-569f-4c40-8e5f-f406c91c4500 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3d9f623e-569f-4c40-8e5f-f406c91c4500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:20.281911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:20.282867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:20.283770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:20.283770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:20.283770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:20.283949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1686c72-5d79-4bd6-bb88-e6676110f60e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:20.284030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 281/584] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:20.284590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f623e-569f-4c40-8e5f-f406c91c4500 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:20.323787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5e2e9-8824-4b53-a90c-9eee89b0ce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:20.324338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5e2e9-8824-4b53-a90c-9eee89b0ce2a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:20.324617 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5e2e9-8824-4b53-a90c-9eee89b0ce2a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:20.324885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5e2e9-8824-4b53-a90c-9eee89b0ce2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:20.336229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5e2e9-8824-4b53-a90c-9eee89b0ce2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:20.337676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5e2e9-8824-4b53-a90c-9eee89b0ce2a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-23f5e2e9-8824-4b53-a90c-9eee89b0ce2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:20.352460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:20.353429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:20.354314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:20.354314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:20.354314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:20.354314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 304/585] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:20.354564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5e2e9-8824-4b53-a90c-9eee89b0ce2a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:20.393024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:20.403305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f623e-569f-4c40-8e5f-f406c91c4500 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:20.438417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f803a-8540-4007-9905-4c707de1d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:20.439048 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f803a-8540-4007-9905-4c707de1d04a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:20.439330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f803a-8540-4007-9905-4c707de1d04a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:20.439590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f803a-8540-4007-9905-4c707de1d04a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:20.447298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f803a-8540-4007-9905-4c707de1d04a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:20.448763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f803a-8540-4007-9905-4c707de1d04a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ea4f803a-8540-4007-9905-4c707de1d04a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:20.460937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:20.461910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:20.462873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:20.462873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:20.462873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:20.462873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:20.462873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:20.462873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:20.462873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:20.462873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:20.462873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:15:20.462873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:20.462873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 282/586] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:20.462873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f803a-8540-4007-9905-4c707de1d04a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:20.486539 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5e2e9-8824-4b53-a90c-9eee89b0ce2a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:20.498754 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:20.528854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45205565-f276-4574-b898-3c884b71d9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:20.529482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45205565-f276-4574-b898-3c884b71d9bb None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:20.529761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45205565-f276-4574-b898-3c884b71d9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:20.530039 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45205565-f276-4574-b898-3c884b71d9bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:20.537784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45205565-f276-4574-b898-3c884b71d9bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:20.539395 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45205565-f276-4574-b898-3c884b71d9bb None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-45205565-f276-4574-b898-3c884b71d9bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:20.551481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:20.552578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:20.553478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:20.553478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:20.553478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:20.553478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:20.553478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:20.553478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:20.553478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:20.553478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:20.553478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 305/587] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:20.553967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45205565-f276-4574-b898-3c884b71d9bb None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:20.577893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f803a-8540-4007-9905-4c707de1d04a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:20.612735 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9517b90-266d-4cb0-ab47-c822344b0289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:20.613337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9517b90-266d-4cb0-ab47-c822344b0289 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:20.613613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9517b90-266d-4cb0-ab47-c822344b0289 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:20.613881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9517b90-266d-4cb0-ab47-c822344b0289 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:20.614668 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9517b90-266d-4cb0-ab47-c822344b0289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:20.614966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9517b90-266d-4cb0-ab47-c822344b0289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:20.616348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9517b90-266d-4cb0-ab47-c822344b0289 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:20.635615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 283/588] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:20.635615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9517b90-266d-4cb0-ab47-c822344b0289 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:20.647426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:20.668685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45205565-f276-4574-b898-3c884b71d9bb None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:20.704622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f42c80-101a-4a63-a0b2-54e1bd47cdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:20.705514 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f42c80-101a-4a63-a0b2-54e1bd47cdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:20.705795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f42c80-101a-4a63-a0b2-54e1bd47cdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:20.706065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f42c80-101a-4a63-a0b2-54e1bd47cdd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:20.706732 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f42c80-101a-4a63-a0b2-54e1bd47cdd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:20.707031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f42c80-101a-4a63-a0b2-54e1bd47cdd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:20.708382 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f42c80-101a-4a63-a0b2-54e1bd47cdd7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:20.720915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 306/589] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:20.721708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f42c80-101a-4a63-a0b2-54e1bd47cdd7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:20.745358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9517b90-266d-4cb0-ab47-c822344b0289 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:20.755362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:20.781088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76797ccd-327e-43c2-ae94-70aae779b43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:20.782155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797ccd-327e-43c2-ae94-70aae779b43d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:20.782155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797ccd-327e-43c2-ae94-70aae779b43d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:20.782325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797ccd-327e-43c2-ae94-70aae779b43d None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:20.783105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76797ccd-327e-43c2-ae94-70aae779b43d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:20.783413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76797ccd-327e-43c2-ae94-70aae779b43d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:20.784840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76797ccd-327e-43c2-ae94-70aae779b43d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:20.805502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 284/590] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Sep 12 23:15:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:20.807201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76797ccd-327e-43c2-ae94-70aae779b43d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:20.834516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f42c80-101a-4a63-a0b2-54e1bd47cdd7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:20.870370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002457ef-592a-4e6e-82c7-917184ebccc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:20.871000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002457ef-592a-4e6e-82c7-917184ebccc5 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:20.871279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002457ef-592a-4e6e-82c7-917184ebccc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:20.871551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002457ef-592a-4e6e-82c7-917184ebccc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:20.872234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002457ef-592a-4e6e-82c7-917184ebccc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:20.872540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002457ef-592a-4e6e-82c7-917184ebccc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:20.873974 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002457ef-592a-4e6e-82c7-917184ebccc5 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:20.885012 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:20.891615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 307/591] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:20.891615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002457ef-592a-4e6e-82c7-917184ebccc5 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:20.926120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76797ccd-327e-43c2-ae94-70aae779b43d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:20.962221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adcac5-6291-43e0-9897-0e71858fef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:20.962887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adcac5-6291-43e0-9897-0e71858fef95 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:20.963160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adcac5-6291-43e0-9897-0e71858fef95 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:20.963511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adcac5-6291-43e0-9897-0e71858fef95 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:20.970821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adcac5-6291-43e0-9897-0e71858fef95 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:20.972264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adcac5-6291-43e0-9897-0e71858fef95 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-53adcac5-6291-43e0-9897-0e71858fef95 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:20.985786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:20.987170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:20.988304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:20.988304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:20.988304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:20.988304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:20.988304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:20.988304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:20.988304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:20.988304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:20.988304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 23:15:20.988304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:20.992044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 285/592] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:20.992617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adcac5-6291-43e0-9897-0e71858fef95 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:20.993498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:21.005046 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002457ef-592a-4e6e-82c7-917184ebccc5 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:21.045353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35b301-dd68-44c0-b355-ef4f3678b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:21.046354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35b301-dd68-44c0-b355-ef4f3678b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:21.046908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35b301-dd68-44c0-b355-ef4f3678b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:21.047272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35b301-dd68-44c0-b355-ef4f3678b3a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:21.055087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35b301-dd68-44c0-b355-ef4f3678b3a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:21.056794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35b301-dd68-44c0-b355-ef4f3678b3a4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-8b35b301-dd68-44c0-b355-ef4f3678b3a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:21.069106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:21.070028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:21.075583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:21.075583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:21.075583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:21.075583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:21.075583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:21.075583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:21.075583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:21.075583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:21.075583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 308/593] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:21.075583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35b301-dd68-44c0-b355-ef4f3678b3a4 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:21.104409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adcac5-6291-43e0-9897-0e71858fef95 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:21.134110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:21.142051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1df978-28dc-41af-83ea-41df5e2ac4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:21.142722 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1df978-28dc-41af-83ea-41df5e2ac4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:21.143169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1df978-28dc-41af-83ea-41df5e2ac4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:21.143452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1df978-28dc-41af-83ea-41df5e2ac4e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:21.154900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1df978-28dc-41af-83ea-41df5e2ac4e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:21.156371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1df978-28dc-41af-83ea-41df5e2ac4e1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-7d1df978-28dc-41af-83ea-41df5e2ac4e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:21.172038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:21.173066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:21.173970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:21.173970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:21.173970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:21.173970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 286/594] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:21.173970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1df978-28dc-41af-83ea-41df5e2ac4e1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:21.189073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35b301-dd68-44c0-b355-ef4f3678b3a4 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:21.224063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0e104-f9f4-4233-ba70-0ef6a97b4a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:21.224718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0e104-f9f4-4233-ba70-0ef6a97b4a78 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:21.224998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0e104-f9f4-4233-ba70-0ef6a97b4a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:21.225274 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0e104-f9f4-4233-ba70-0ef6a97b4a78 None admin] PATH_INFO: `/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/46f96bbb14c04691ac403271de293224/roles/bb220d22e80a428d8855c3d5767fbc03` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:21.245095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0e104-f9f4-4233-ba70-0ef6a97b4a78 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd655924cf9a4736ba38740ade63ec52, user_id=46f96bbb14c04691ac403271de293224, role_id=bb220d22e80a428d8855c3d5767fbc03)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:21.246998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0e104-f9f4-4233-ba70-0ef6a97b4a78 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:21.258283 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:21.274479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 309/595] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:15:21 2022] PUT /identity/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/46f96bbb14c04691ac403271de293224/roles/bb220d22e80a428d8855c3d5767fbc03 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:15:21.275513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0e104-f9f4-4233-ba70-0ef6a97b4a78 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:21.288650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1df978-28dc-41af-83ea-41df5e2ac4e1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:21.331051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09bc00-8100-4e27-ba9b-7da4e2b690bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:21.331742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09bc00-8100-4e27-ba9b-7da4e2b690bd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:21.332023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09bc00-8100-4e27-ba9b-7da4e2b690bd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:21.332326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09bc00-8100-4e27-ba9b-7da4e2b690bd None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:21.333123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09bc00-8100-4e27-ba9b-7da4e2b690bd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:21.333472 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09bc00-8100-4e27-ba9b-7da4e2b690bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:21.335126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09bc00-8100-4e27-ba9b-7da4e2b690bd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:21.359082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 287/596] 10.222.0.33 () {56 vars in 1139 bytes} [Mon Sep 12 23:15:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:21.359870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09bc00-8100-4e27-ba9b-7da4e2b690bd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:21.423233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:21.435536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0e104-f9f4-4233-ba70-0ef6a97b4a78 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:21.480329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a3f20-6bf0-4883-9932-c99b773c79b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:21.481222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a3f20-6bf0-4883-9932-c99b773c79b3 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:21.481506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a3f20-6bf0-4883-9932-c99b773c79b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:21.481777 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a3f20-6bf0-4883-9932-c99b773c79b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:21.482542 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a3f20-6bf0-4883-9932-c99b773c79b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:21.482849 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a3f20-6bf0-4883-9932-c99b773c79b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:21.484361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a3f20-6bf0-4883-9932-c99b773c79b3 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:21.491463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09bc00-8100-4e27-ba9b-7da4e2b690bd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:21.502442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 310/597] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:21.502442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a3f20-6bf0-4883-9932-c99b773c79b3 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:21.529185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac134f7f-3f72-499b-85a7-26ee01e5e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:21.529806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134f7f-3f72-499b-85a7-26ee01e5e4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:21.530094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134f7f-3f72-499b-85a7-26ee01e5e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:21.530370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134f7f-3f72-499b-85a7-26ee01e5e4b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:21.531050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac134f7f-3f72-499b-85a7-26ee01e5e4b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:21.531355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac134f7f-3f72-499b-85a7-26ee01e5e4b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:21.533433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac134f7f-3f72-499b-85a7-26ee01e5e4b8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:21.545494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 288/598] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:21.547021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a795c-aecc-4a61-9248-2ab67fedad4f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:21.547611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a795c-aecc-4a61-9248-2ab67fedad4f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:21.548647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a795c-aecc-4a61-9248-2ab67fedad4f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:21.550366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 289/599] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:21.551252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a795c-aecc-4a61-9248-2ab67fedad4f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:21.574996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:21.622181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a3f20-6bf0-4883-9932-c99b773c79b3 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:21.658462 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd1527-0877-4cce-8e75-381a7f428120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:21.659105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd1527-0877-4cce-8e75-381a7f428120 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:21.659382 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd1527-0877-4cce-8e75-381a7f428120 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:21.659652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd1527-0877-4cce-8e75-381a7f428120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:21.663575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:21.668416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a795c-aecc-4a61-9248-2ab67fedad4f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:21.671369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd1527-0877-4cce-8e75-381a7f428120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:21.672910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd1527-0877-4cce-8e75-381a7f428120 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-86fd1527-0877-4cce-8e75-381a7f428120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:21.688049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:21.689008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:21.689877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:21.689877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:21.689877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:21.689877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 311/600] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:21.690109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd1527-0877-4cce-8e75-381a7f428120 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:21.708400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52772487-afb6-476f-a795-438ae54a8cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:21.709471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52772487-afb6-476f-a795-438ae54a8cdc None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:21.710061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52772487-afb6-476f-a795-438ae54a8cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:21.710530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52772487-afb6-476f-a795-438ae54a8cdc None admin] PATH_INFO: `/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/67b0698294e94845ae0dbdfb87059755/roles/bb220d22e80a428d8855c3d5767fbc03` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:21.726716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52772487-afb6-476f-a795-438ae54a8cdc None admin] RBAC: Authorizing `identity:create_grant(project_id=fd655924cf9a4736ba38740ade63ec52, user_id=67b0698294e94845ae0dbdfb87059755, role_id=bb220d22e80a428d8855c3d5767fbc03)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:21.728494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52772487-afb6-476f-a795-438ae54a8cdc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:21.742846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 290/601] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:15:21 2022] PUT /identity/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/67b0698294e94845ae0dbdfb87059755/roles/bb220d22e80a428d8855c3d5767fbc03 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:15:21.744259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdcf63-967f-4485-9ae8-2b64b4ac73cb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:21.744551 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdcf63-967f-4485-9ae8-2b64b4ac73cb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:21.744826 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdcf63-967f-4485-9ae8-2b64b4ac73cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:21.764260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e4cdcf63-967f-4485-9ae8-2b64b4ac73cb None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:21.765545 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e4cdcf63-967f-4485-9ae8-2b64b4ac73cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:21.820180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd1527-0877-4cce-8e75-381a7f428120 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:21.838814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:21.852788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 291/602] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:21.854261 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdcf63-967f-4485-9ae8-2b64b4ac73cb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:21.900275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0539d69-0048-400a-aac7-2e6a37c24892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:21.900853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0539d69-0048-400a-aac7-2e6a37c24892 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:21.901135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0539d69-0048-400a-aac7-2e6a37c24892 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:21.901412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0539d69-0048-400a-aac7-2e6a37c24892 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:21.919628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0539d69-0048-400a-aac7-2e6a37c24892 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:21.921149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0539d69-0048-400a-aac7-2e6a37c24892 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-c0539d69-0048-400a-aac7-2e6a37c24892 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:21.945017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:21.946142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:21.947281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:21.947281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:21.947281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:21.947281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:21.947281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:21.947281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:21.947281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:21.947281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:21.947281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 312/603] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:21.955695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0539d69-0048-400a-aac7-2e6a37c24892 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:21.965091 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:21.995470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdcf63-967f-4485-9ae8-2b64b4ac73cb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:22.047028 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1a3d-c621-4d16-bcc6-b5aabf50a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:22.048006 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1a3d-c621-4d16-bcc6-b5aabf50a75a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:22.048451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1a3d-c621-4d16-bcc6-b5aabf50a75a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:22.049152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1a3d-c621-4d16-bcc6-b5aabf50a75a None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:22.050668 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de1a3d-c621-4d16-bcc6-b5aabf50a75a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:22.051059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de1a3d-c621-4d16-bcc6-b5aabf50a75a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:22.056395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de1a3d-c621-4d16-bcc6-b5aabf50a75a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:22.073337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 292/604] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:22.080054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1a3d-c621-4d16-bcc6-b5aabf50a75a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:22.090316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0539d69-0048-400a-aac7-2e6a37c24892 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:22.171187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900e92b-2686-4022-8b31-239d48b8962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:22.171739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900e92b-2686-4022-8b31-239d48b8962a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:22.172018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900e92b-2686-4022-8b31-239d48b8962a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:22.172346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900e92b-2686-4022-8b31-239d48b8962a None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:22.173062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900e92b-2686-4022-8b31-239d48b8962a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:22.173364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900e92b-2686-4022-8b31-239d48b8962a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:22.178424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900e92b-2686-4022-8b31-239d48b8962a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:22.201946 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 313/605] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:22.207501 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900e92b-2686-4022-8b31-239d48b8962a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:22.237238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1a3d-c621-4d16-bcc6-b5aabf50a75a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:22.252011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:22.286863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67a66d-e637-4029-8f59-b20f65ab2a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:22.288433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67a66d-e637-4029-8f59-b20f65ab2a92 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:22.288859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67a66d-e637-4029-8f59-b20f65ab2a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:22.289282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67a66d-e637-4029-8f59-b20f65ab2a92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:22.299411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67a66d-e637-4029-8f59-b20f65ab2a92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:22.301576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67a66d-e637-4029-8f59-b20f65ab2a92 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:22.305233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-de67a66d-e637-4029-8f59-b20f65ab2a92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:22.318454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:22.319536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:22.320617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:22.320617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:22.320617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:22.320617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:22.320617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:22.320617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:22.320617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:22.320617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:22.323430 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 293/606] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:22.324342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67a66d-e637-4029-8f59-b20f65ab2a92 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:22.336908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900e92b-2686-4022-8b31-239d48b8962a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:22.391684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494f60b-2646-4b95-95b0-d63300013cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:22.392857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494f60b-2646-4b95-95b0-d63300013cf6 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:22.393281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494f60b-2646-4b95-95b0-d63300013cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:22.394023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494f60b-2646-4b95-95b0-d63300013cf6 None admin] PATH_INFO: `/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/4f5d6fe6235447acb395030fb0f0555d/roles/bb220d22e80a428d8855c3d5767fbc03` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:22.413055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494f60b-2646-4b95-95b0-d63300013cf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd655924cf9a4736ba38740ade63ec52, user_id=4f5d6fe6235447acb395030fb0f0555d, role_id=bb220d22e80a428d8855c3d5767fbc03)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:22.415257 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494f60b-2646-4b95-95b0-d63300013cf6 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:22.435202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 314/607] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:15:22 2022] PUT /identity/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/4f5d6fe6235447acb395030fb0f0555d/roles/bb220d22e80a428d8855c3d5767fbc03 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:15:22.436352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494f60b-2646-4b95-95b0-d63300013cf6 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:22.460123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67a66d-e637-4029-8f59-b20f65ab2a92 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:22.546739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0ce50-a508-42b1-bba8-54de2d6be70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:22.548294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0ce50-a508-42b1-bba8-54de2d6be70d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:22.550177 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0ce50-a508-42b1-bba8-54de2d6be70d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:22.552054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0ce50-a508-42b1-bba8-54de2d6be70d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:22.558908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:22.573184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0ce50-a508-42b1-bba8-54de2d6be70d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1cf0ce50-a508-42b1-bba8-54de2d6be70d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:22.579575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:22.580508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:22.581409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 294/608] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:22.586619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0ce50-a508-42b1-bba8-54de2d6be70d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:22.587173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494f60b-2646-4b95-95b0-d63300013cf6 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:22.654970 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61e724-34f0-4914-8370-bef36b0117cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:22.655763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61e724-34f0-4914-8370-bef36b0117cc None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:22.656105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61e724-34f0-4914-8370-bef36b0117cc None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:22.656386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61e724-34f0-4914-8370-bef36b0117cc None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:22.657228 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61e724-34f0-4914-8370-bef36b0117cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:22.657544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61e724-34f0-4914-8370-bef36b0117cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:22.659040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61e724-34f0-4914-8370-bef36b0117cc None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:22.672635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 315/609] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:22.687419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61e724-34f0-4914-8370-bef36b0117cc None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:22.723665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:22.785877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0ce50-a508-42b1-bba8-54de2d6be70d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:22.853223 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8691a25-20a4-4a30-a769-8cb7eb3879c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:22.853852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8691a25-20a4-4a30-a769-8cb7eb3879c6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:22.854098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8691a25-20a4-4a30-a769-8cb7eb3879c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:22.854373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8691a25-20a4-4a30-a769-8cb7eb3879c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:22.855067 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8691a25-20a4-4a30-a769-8cb7eb3879c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:22.855373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8691a25-20a4-4a30-a769-8cb7eb3879c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:22.856756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8691a25-20a4-4a30-a769-8cb7eb3879c6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:22.860327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61e724-34f0-4914-8370-bef36b0117cc None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:22.874627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 295/610] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:22.881023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8691a25-20a4-4a30-a769-8cb7eb3879c6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:22.929799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071abba3-105c-44a8-8538-e4073d534449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:22.930492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071abba3-105c-44a8-8538-e4073d534449 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:22.930772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071abba3-105c-44a8-8538-e4073d534449 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:22.931047 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071abba3-105c-44a8-8538-e4073d534449 None admin] PATH_INFO: `/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/b1d4b0f322c741c5b69b922071aab3d6/roles/bb220d22e80a428d8855c3d5767fbc03` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:22.956315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:22.961328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071abba3-105c-44a8-8538-e4073d534449 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd655924cf9a4736ba38740ade63ec52, user_id=b1d4b0f322c741c5b69b922071aab3d6, role_id=bb220d22e80a428d8855c3d5767fbc03)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:22.962878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071abba3-105c-44a8-8538-e4073d534449 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:22.988075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 316/611] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:15:22 2022] PUT /identity/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/b1d4b0f322c741c5b69b922071aab3d6/roles/bb220d22e80a428d8855c3d5767fbc03 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:15:23.032690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8691a25-20a4-4a30-a769-8cb7eb3879c6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:23.069417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:23.091215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dd286-ac9a-4160-b198-88c488b31a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:23.091943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dd286-ac9a-4160-b198-88c488b31a80 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:23.092230 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dd286-ac9a-4160-b198-88c488b31a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:23.092505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dd286-ac9a-4160-b198-88c488b31a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:23.108976 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dd286-ac9a-4160-b198-88c488b31a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:23.111470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dd286-ac9a-4160-b198-88c488b31a80 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-258dd286-ac9a-4160-b198-88c488b31a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:23.132194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:23.133190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:23.134071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:23.134071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:23.134071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:23.134071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 296/612] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:23.139289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071abba3-105c-44a8-8538-e4073d534449 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:23.252755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071abba3-105c-44a8-8538-e4073d534449 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:23.289260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303765b3-b8ff-4e41-8a63-6b6046474413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:23.289878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303765b3-b8ff-4e41-8a63-6b6046474413 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:23.290159 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303765b3-b8ff-4e41-8a63-6b6046474413 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:23.290467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303765b3-b8ff-4e41-8a63-6b6046474413 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:23.291386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303765b3-b8ff-4e41-8a63-6b6046474413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:23.291689 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303765b3-b8ff-4e41-8a63-6b6046474413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:23.293137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303765b3-b8ff-4e41-8a63-6b6046474413 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:23.307362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 317/613] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:23.314260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dd286-ac9a-4160-b198-88c488b31a80 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:23.467515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dd286-ac9a-4160-b198-88c488b31a80 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:23.521249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6187d1-f751-4316-b015-b20934ed9216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:23.521866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6187d1-f751-4316-b015-b20934ed9216 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:23.522151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6187d1-f751-4316-b015-b20934ed9216 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:23.522440 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6187d1-f751-4316-b015-b20934ed9216 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:23.539762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6187d1-f751-4316-b015-b20934ed9216 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:23.541524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6187d1-f751-4316-b015-b20934ed9216 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-db6187d1-f751-4316-b015-b20934ed9216 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:23.560286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:23.561276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:23.562184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:23.562184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:23.562184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:23.562184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:23.562184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:23.562184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:23.562184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:23.562184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:23.562184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:15:23.562184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:23.562184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 297/614] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:23.567976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303765b3-b8ff-4e41-8a63-6b6046474413 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:23.648955 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:23.699823 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14925091-bf45-4b09-9bc8-9b0aad4c7750 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:23.700161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14925091-bf45-4b09-9bc8-9b0aad4c7750 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:23.700367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14925091-bf45-4b09-9bc8-9b0aad4c7750 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:23.701939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 298/615] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:23.706687 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ff56c-9b57-443f-a6cf-db8f8f542ad8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:23.706965 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ff56c-9b57-443f-a6cf-db8f8f542ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:23.707234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ff56c-9b57-443f-a6cf-db8f8f542ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:23.729913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303765b3-b8ff-4e41-8a63-6b6046474413 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:23.734424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a74ff56c-9b57-443f-a6cf-db8f8f542ad8 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:23.736239 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a74ff56c-9b57-443f-a6cf-db8f8f542ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:23.775460 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:23.807886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d96c1c-199a-439d-8cde-77edb0b64cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:23.808894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d96c1c-199a-439d-8cde-77edb0b64cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:23.809393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d96c1c-199a-439d-8cde-77edb0b64cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:23.809856 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d96c1c-199a-439d-8cde-77edb0b64cc1 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:23.810814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d96c1c-199a-439d-8cde-77edb0b64cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:23.811187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d96c1c-199a-439d-8cde-77edb0b64cc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:23.812694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d96c1c-199a-439d-8cde-77edb0b64cc1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:23.824851 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 299/616] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:15:23.848861 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 318/617] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Sep 12 23:15:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:23.854493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ff56c-9b57-443f-a6cf-db8f8f542ad8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:23.994204 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ff56c-9b57-443f-a6cf-db8f8f542ad8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:24.030752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420456c-bec0-4f4b-b139-d0b1cbe77e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:24.031320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420456c-bec0-4f4b-b139-d0b1cbe77e64 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:24.031638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420456c-bec0-4f4b-b139-d0b1cbe77e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:24.031911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420456c-bec0-4f4b-b139-d0b1cbe77e64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:24.042881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420456c-bec0-4f4b-b139-d0b1cbe77e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:24.044351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420456c-bec0-4f4b-b139-d0b1cbe77e64 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b420456c-bec0-4f4b-b139-d0b1cbe77e64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:24.060055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:24.061033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:24.061910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:24.061910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:24.061910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:24.061910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 300/618] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:24.068039 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d96c1c-199a-439d-8cde-77edb0b64cc1 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:24.214304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d96c1c-199a-439d-8cde-77edb0b64cc1 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:24.230000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:24.238852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420456c-bec0-4f4b-b139-d0b1cbe77e64 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:24.261795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cdcdf-34a6-40cd-b068-b7bf7bcf1e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:24.262441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cdcdf-34a6-40cd-b068-b7bf7bcf1e5c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:24.262728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cdcdf-34a6-40cd-b068-b7bf7bcf1e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:24.263005 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cdcdf-34a6-40cd-b068-b7bf7bcf1e5c None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:24.263673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cdcdf-34a6-40cd-b068-b7bf7bcf1e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:24.264090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cdcdf-34a6-40cd-b068-b7bf7bcf1e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:24.265583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cdcdf-34a6-40cd-b068-b7bf7bcf1e5c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:24.274348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:24.286232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 319/619] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:24.292115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cdcdf-34a6-40cd-b068-b7bf7bcf1e5c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:24.433866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420456c-bec0-4f4b-b139-d0b1cbe77e64 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:24.484660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cdcdf-34a6-40cd-b068-b7bf7bcf1e5c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:24.508254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153570c-7b61-4f76-901b-1c31e042d494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:24.508909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153570c-7b61-4f76-901b-1c31e042d494 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:24.509187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153570c-7b61-4f76-901b-1c31e042d494 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:24.509460 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153570c-7b61-4f76-901b-1c31e042d494 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:24.529462 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153570c-7b61-4f76-901b-1c31e042d494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5153570c-7b61-4f76-901b-1c31e042d494 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:24.536057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:24.537050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:24.537932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:24.537932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:24.537932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:24.537932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:24.537932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:24.537932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:24.537932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:24.537932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:24.537932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:24.537932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:24.537932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:24.537932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:24.539081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 301/620] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:24.545663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153570c-7b61-4f76-901b-1c31e042d494 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:24.551059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28e0cd-e90c-47cc-9ec0-08c0075abed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:24.551762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28e0cd-e90c-47cc-9ec0-08c0075abed4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:24.552047 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28e0cd-e90c-47cc-9ec0-08c0075abed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:24.552321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28e0cd-e90c-47cc-9ec0-08c0075abed4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:24.567099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28e0cd-e90c-47cc-9ec0-08c0075abed4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:24.568582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28e0cd-e90c-47cc-9ec0-08c0075abed4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-ee28e0cd-e90c-47cc-9ec0-08c0075abed4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:24.588522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:24.589457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:24.590326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:24.590326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:24.590326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:24.590326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:24.590326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:24.590326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:24.590326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:24.590326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:24.590326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 320/621] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:24.596734 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101a70a-b011-4f81-965a-2c5d09a6eb8b None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:24.597016 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101a70a-b011-4f81-965a-2c5d09a6eb8b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:24.597290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101a70a-b011-4f81-965a-2c5d09a6eb8b None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:24.599516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 321/622] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:24.602188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101a70a-b011-4f81-965a-2c5d09a6eb8b None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:24.646751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:24.674744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:24.703429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153570c-7b61-4f76-901b-1c31e042d494 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:24.728086 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101a70a-b011-4f81-965a-2c5d09a6eb8b None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:24.746960 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d8046-d329-4f2b-b53a-9ff853359f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:24.747739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d8046-d329-4f2b-b53a-9ff853359f71 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:24.748024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d8046-d329-4f2b-b53a-9ff853359f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:24.748595 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d8046-d329-4f2b-b53a-9ff853359f71 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:24.749277 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d8046-d329-4f2b-b53a-9ff853359f71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:24.749641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d8046-d329-4f2b-b53a-9ff853359f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:24.752189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d8046-d329-4f2b-b53a-9ff853359f71 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:24.763564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 302/623] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:24.765016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312e0cb-eb73-4cdd-8216-7749be61539d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:24.765304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312e0cb-eb73-4cdd-8216-7749be61539d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:24.765576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312e0cb-eb73-4cdd-8216-7749be61539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:24.766218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa52405-3b4c-43ae-bc92-e52e7029d77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:24.767056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa52405-3b4c-43ae-bc92-e52e7029d77c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:24.767339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa52405-3b4c-43ae-bc92-e52e7029d77c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:24.767619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa52405-3b4c-43ae-bc92-e52e7029d77c None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:24.768659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa52405-3b4c-43ae-bc92-e52e7029d77c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:24.769080 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa52405-3b4c-43ae-bc92-e52e7029d77c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:24.770749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa52405-3b4c-43ae-bc92-e52e7029d77c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:24.785940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 322/624] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:24.786348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c312e0cb-eb73-4cdd-8216-7749be61539d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:24.786714 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa52405-3b4c-43ae-bc92-e52e7029d77c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:24.795297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c312e0cb-eb73-4cdd-8216-7749be61539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:24.880762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 303/625] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:24.881677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312e0cb-eb73-4cdd-8216-7749be61539d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:24.908674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:24.921545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa52405-3b4c-43ae-bc92-e52e7029d77c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:24.959391 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:24.972205 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25ae8d-6565-428b-b75b-ceddb010f072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:24.972848 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ae8d-6565-428b-b75b-ceddb010f072 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:24.973128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ae8d-6565-428b-b75b-ceddb010f072 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:24.973399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ae8d-6565-428b-b75b-ceddb010f072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:24.988066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25ae8d-6565-428b-b75b-ceddb010f072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:24.989781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25ae8d-6565-428b-b75b-ceddb010f072 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:24.996830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312e0cb-eb73-4cdd-8216-7749be61539d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-8b25ae8d-6565-428b-b75b-ceddb010f072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:25.010615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:25.012152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:25.013975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:25.013975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:25.013975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:25.013975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 323/626] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:25.013975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9a1a0-e0c6-48fe-b1ae-00ee807a17a1 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:25.014575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9a1a0-e0c6-48fe-b1ae-00ee807a17a1 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:25.014575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9a1a0-e0c6-48fe-b1ae-00ee807a17a1 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:25.019749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 324/627] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:25.020681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9a1a0-e0c6-48fe-b1ae-00ee807a17a1 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:25.051181 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367a647-ba32-45de-a913-f5e40c959992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:25.052329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a647-ba32-45de-a913-f5e40c959992 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:25.053129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a647-ba32-45de-a913-f5e40c959992 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:25.053890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a647-ba32-45de-a913-f5e40c959992 None admin] PATH_INFO: `/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/53214ffdc5d04c14b3b3ac868862480b/roles/bb220d22e80a428d8855c3d5767fbc03` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:25.071635 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367a647-ba32-45de-a913-f5e40c959992 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd655924cf9a4736ba38740ade63ec52, user_id=53214ffdc5d04c14b3b3ac868862480b, role_id=bb220d22e80a428d8855c3d5767fbc03)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:25.073751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367a647-ba32-45de-a913-f5e40c959992 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:25.092846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 304/628] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:15:24 2022] PUT /identity/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/53214ffdc5d04c14b3b3ac868862480b/roles/bb220d22e80a428d8855c3d5767fbc03 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:15:25.095635 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d76a4-42f9-4409-8f8a-3d63e9f7474f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:25.096236 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d76a4-42f9-4409-8f8a-3d63e9f7474f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:25.096747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d76a4-42f9-4409-8f8a-3d63e9f7474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:25.120177 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fa0d76a4-42f9-4409-8f8a-3d63e9f7474f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:25.122289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fa0d76a4-42f9-4409-8f8a-3d63e9f7474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:25.158697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9a1a0-e0c6-48fe-b1ae-00ee807a17a1 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:25.208557 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbc89c-9630-4642-bc35-39bd15ee61bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:25.209831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbc89c-9630-4642-bc35-39bd15ee61bf None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:25.210184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbc89c-9630-4642-bc35-39bd15ee61bf None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:25.210750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbc89c-9630-4642-bc35-39bd15ee61bf None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:25.211692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbc89c-9630-4642-bc35-39bd15ee61bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:25.212111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbc89c-9630-4642-bc35-39bd15ee61bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:25.213720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbc89c-9630-4642-bc35-39bd15ee61bf None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:25.215281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 305/629] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:25.238628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 325/630] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:25.244321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d76a4-42f9-4409-8f8a-3d63e9f7474f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:25.253479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbc89c-9630-4642-bc35-39bd15ee61bf None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:25.256432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:25.334567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:25.419565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbc89c-9630-4642-bc35-39bd15ee61bf None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:25.422953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d76a4-42f9-4409-8f8a-3d63e9f7474f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:25.462425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e23f69-a120-4d4b-b171-32fc18a7f859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:25.463445 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e23f69-a120-4d4b-b171-32fc18a7f859 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:25.463881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e23f69-a120-4d4b-b171-32fc18a7f859 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:25.464312 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e23f69-a120-4d4b-b171-32fc18a7f859 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:25.467541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e1f3b-2c9f-48e3-9663-971c77f71a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:25.468366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e1f3b-2c9f-48e3-9663-971c77f71a63 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:25.468796 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e1f3b-2c9f-48e3-9663-971c77f71a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:25.469281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e1f3b-2c9f-48e3-9663-971c77f71a63 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:25.476021 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e23f69-a120-4d4b-b171-32fc18a7f859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:25.478184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e1f3b-2c9f-48e3-9663-971c77f71a63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:25.479822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e1f3b-2c9f-48e3-9663-971c77f71a63 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-56e23f69-a120-4d4b-b171-32fc18a7f859 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:25.481524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:25.482681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:25.483724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:25.483724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:25.483724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:25.483724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:25.483724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:25.483724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:25.483724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:25.483724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:25.483724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:25.483724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:25.483724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:25.483724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:25.487031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 326/631] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ab2e1f3b-2c9f-48e3-9663-971c77f71a63 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:25.499775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:25.500879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:25.501844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:25.501844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:25.501844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:25.501844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:25.501844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:25.501844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:25.501844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:25.501844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:25.501844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 12 23:15:25.501844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:25.504297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 306/632] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:25.506084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e23f69-a120-4d4b-b171-32fc18a7f859 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:25.510573 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e1f3b-2c9f-48e3-9663-971c77f71a63 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:25.602714 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:25.662279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e23f69-a120-4d4b-b171-32fc18a7f859 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:25.664072 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e1f3b-2c9f-48e3-9663-971c77f71a63 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:25.674279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:25.702632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9371e1-f3c5-4dce-bdf5-d769f43e59e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:25.703245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9371e1-f3c5-4dce-bdf5-d769f43e59e0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:25.703617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9371e1-f3c5-4dce-bdf5-d769f43e59e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:25.703904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9371e1-f3c5-4dce-bdf5-d769f43e59e0 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:25.704614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9371e1-f3c5-4dce-bdf5-d769f43e59e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:25.704918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9371e1-f3c5-4dce-bdf5-d769f43e59e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:25.706352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9371e1-f3c5-4dce-bdf5-d769f43e59e0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:25.709937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3ce2a-6079-43a6-b16a-f0bb54c8134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:25.710790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3ce2a-6079-43a6-b16a-f0bb54c8134c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:25.711278 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3ce2a-6079-43a6-b16a-f0bb54c8134c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:25.711739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3ce2a-6079-43a6-b16a-f0bb54c8134c None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:25.712593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3ce2a-6079-43a6-b16a-f0bb54c8134c None admin] RBAC: Adding query filter params (name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:25.713077 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3ce2a-6079-43a6-b16a-f0bb54c8134c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:25.715099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3ce2a-6079-43a6-b16a-f0bb54c8134c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:25.725619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 307/633] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Sep 12 23:15:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:25.730924 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9371e1-f3c5-4dce-bdf5-d769f43e59e0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:25.731052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 327/634] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:25.731417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3ce2a-6079-43a6-b16a-f0bb54c8134c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:25.838289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9371e1-f3c5-4dce-bdf5-d769f43e59e0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:25.847187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3ce2a-6079-43a6-b16a-f0bb54c8134c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:25.873387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:25.873952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f9ef1-66dd-4b72-bedc-c4664d067529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:25.874948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f9ef1-66dd-4b72-bedc-c4664d067529 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:25.874948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f9ef1-66dd-4b72-bedc-c4664d067529 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:25.875670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f9ef1-66dd-4b72-bedc-c4664d067529 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:25.886065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08a2b9-5258-4215-935e-eec3043b88ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:25.886658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08a2b9-5258-4215-935e-eec3043b88ec None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:25.886870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f9ef1-66dd-4b72-bedc-c4664d067529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:25.887300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08a2b9-5258-4215-935e-eec3043b88ec None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:25.887300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08a2b9-5258-4215-935e-eec3043b88ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-723f9ef1-66dd-4b72-bedc-c4664d067529 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:25.891720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:25.892657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:25.893511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 308/635] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:25.894209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f9ef1-66dd-4b72-bedc-c4664d067529 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:25.928736 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:25.960593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08a2b9-5258-4215-935e-eec3043b88ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:25.962042 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08a2b9-5258-4215-935e-eec3043b88ec None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:26.008492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f9ef1-66dd-4b72-bedc-c4664d067529 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:26.044781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a00480-2e67-480f-abdf-e0d674ada7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:26.045763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a00480-2e67-480f-abdf-e0d674ada7fe None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:26.046194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a00480-2e67-480f-abdf-e0d674ada7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:26.046645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a00480-2e67-480f-abdf-e0d674ada7fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:26.057553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a00480-2e67-480f-abdf-e0d674ada7fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:26.059221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a00480-2e67-480f-abdf-e0d674ada7fe None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:26.072524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 328/636] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:26.072524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864a571-3905-4b52-a348-f28a6615eee7 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:26.072524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864a571-3905-4b52-a348-f28a6615eee7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:26.072524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864a571-3905-4b52-a348-f28a6615eee7 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:26.072524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 329/637] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:26.072524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864a571-3905-4b52-a348-f28a6615eee7 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c3a00480-2e67-480f-abdf-e0d674ada7fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:26.081841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:26.083031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:26.084292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:26.084292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:26.084292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:26.084292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 309/638] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:26.084292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a00480-2e67-480f-abdf-e0d674ada7fe None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:26.103380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:26.168643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:26.193389 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a00480-2e67-480f-abdf-e0d674ada7fe None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:26.194409 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864a571-3905-4b52-a348-f28a6615eee7 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:26.231262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde93c3-411d-4272-aaaf-e8688e64a2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:26.231607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0d565-d0fb-4a85-a2d5-b9d1d9e10d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:26.231900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde93c3-411d-4272-aaaf-e8688e64a2ef None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:26.232179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde93c3-411d-4272-aaaf-e8688e64a2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:26.232290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0d565-d0fb-4a85-a2d5-b9d1d9e10d76 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:26.232453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde93c3-411d-4272-aaaf-e8688e64a2ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:26.232547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0d565-d0fb-4a85-a2d5-b9d1d9e10d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:26.232742 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0d565-d0fb-4a85-a2d5-b9d1d9e10d76 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:26.233402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0d565-d0fb-4a85-a2d5-b9d1d9e10d76 None admin] RBAC: Adding query filter params (name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:26.233708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0d565-d0fb-4a85-a2d5-b9d1d9e10d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:26.235947 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0d565-d0fb-4a85-a2d5-b9d1d9e10d76 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:26.244368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 330/639] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:26.245337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8acda9-b09c-40ef-85a1-816808869b8b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:26.245621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8acda9-b09c-40ef-85a1-816808869b8b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:26.245895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8acda9-b09c-40ef-85a1-816808869b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:26.249650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde93c3-411d-4272-aaaf-e8688e64a2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:26.251369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde93c3-411d-4272-aaaf-e8688e64a2ef None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:26.264812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-9d8acda9-b09c-40ef-85a1-816808869b8b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-8dde93c3-411d-4272-aaaf-e8688e64a2ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:26.266630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:26.267531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:26.268403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:26.268403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:26.268403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:26.268403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 310/640] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:26.269103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde93c3-411d-4272-aaaf-e8688e64a2ef None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:26.269513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9d8acda9-b09c-40ef-85a1-816808869b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:26.350404 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 331/641] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:26.350404 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8acda9-b09c-40ef-85a1-816808869b8b None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:26.367342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:26.395276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde93c3-411d-4272-aaaf-e8688e64a2ef None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:26.427866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:26.434761 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff9d41-adb3-46f9-98f7-6ca3da80015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:26.435558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff9d41-adb3-46f9-98f7-6ca3da80015e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:26.435934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff9d41-adb3-46f9-98f7-6ca3da80015e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:26.436310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff9d41-adb3-46f9-98f7-6ca3da80015e None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:26.437042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff9d41-adb3-46f9-98f7-6ca3da80015e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:26.437437 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff9d41-adb3-46f9-98f7-6ca3da80015e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:26.439583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff9d41-adb3-46f9-98f7-6ca3da80015e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:26.456556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 311/642] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:26.461616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff9d41-adb3-46f9-98f7-6ca3da80015e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:26.475671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8acda9-b09c-40ef-85a1-816808869b8b None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:26.524700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfdc54-0884-4432-afdf-665e41788b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:26.525334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfdc54-0884-4432-afdf-665e41788b41 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:26.525609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfdc54-0884-4432-afdf-665e41788b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:26.525876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfdc54-0884-4432-afdf-665e41788b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:26.542795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfdc54-0884-4432-afdf-665e41788b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:26.544319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfdc54-0884-4432-afdf-665e41788b41 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-89dfdc54-0884-4432-afdf-665e41788b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:26.560934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:26.561998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:26.563635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:26.563635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:26.563635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:26.563635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 332/643] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:26.563635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfdc54-0884-4432-afdf-665e41788b41 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:26.578865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff9d41-adb3-46f9-98f7-6ca3da80015e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:26.617780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2249de6-9e8a-4182-9b97-a568082fa768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:26.618765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2249de6-9e8a-4182-9b97-a568082fa768 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:26.619281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2249de6-9e8a-4182-9b97-a568082fa768 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:26.619753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2249de6-9e8a-4182-9b97-a568082fa768 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:26.620588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2249de6-9e8a-4182-9b97-a568082fa768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:26.621074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2249de6-9e8a-4182-9b97-a568082fa768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:26.622650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2249de6-9e8a-4182-9b97-a568082fa768 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:26.635234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 312/644] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:26.636482 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2249de6-9e8a-4182-9b97-a568082fa768 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:26.644030 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:26.688580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfdc54-0884-4432-afdf-665e41788b41 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:26.692067 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:26.724913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3c3fb-6bc4-4e94-8277-6b1a272e3753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:26.725539 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3c3fb-6bc4-4e94-8277-6b1a272e3753 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:26.725822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3c3fb-6bc4-4e94-8277-6b1a272e3753 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:26.726094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3c3fb-6bc4-4e94-8277-6b1a272e3753 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:26.733748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3c3fb-6bc4-4e94-8277-6b1a272e3753 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:26.735480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3c3fb-6bc4-4e94-8277-6b1a272e3753 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-f5c3c3fb-6bc4-4e94-8277-6b1a272e3753 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:26.746820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:26.747746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:26.748836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:26.748836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:26.748836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:26.748836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:26.748836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:26.748836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:26.748836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:26.748836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:26.748836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:15:26.748836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:26.749390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2249de6-9e8a-4182-9b97-a568082fa768 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:26.750808 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 333/645] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Sep 12 23:15:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:26.752864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3c3fb-6bc4-4e94-8277-6b1a272e3753 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:26.788676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f52e79-1d3e-4384-80b7-465f582eca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:26.789286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f52e79-1d3e-4384-80b7-465f582eca23 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:26.789730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f52e79-1d3e-4384-80b7-465f582eca23 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:26.790007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f52e79-1d3e-4384-80b7-465f582eca23 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:26.791694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f52e79-1d3e-4384-80b7-465f582eca23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:26.792004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f52e79-1d3e-4384-80b7-465f582eca23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:26.793379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f52e79-1d3e-4384-80b7-465f582eca23 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:26.811873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 313/646] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:26.811873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f52e79-1d3e-4384-80b7-465f582eca23 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:26.858565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3c3fb-6bc4-4e94-8277-6b1a272e3753 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:26.886137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:26.896684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f3d48-cc18-4b8c-9e50-c2c1ff4baf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:26.897328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f3d48-cc18-4b8c-9e50-c2c1ff4baf01 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:26.897603 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f3d48-cc18-4b8c-9e50-c2c1ff4baf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:26.897874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f3d48-cc18-4b8c-9e50-c2c1ff4baf01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:26.905842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f3d48-cc18-4b8c-9e50-c2c1ff4baf01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:26.907852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f3d48-cc18-4b8c-9e50-c2c1ff4baf01 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-e59f3d48-cc18-4b8c-9e50-c2c1ff4baf01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:26.919307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:26.920176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:26.921055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:26.921055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:26.921055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:26.921055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:26.921055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:26.921055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:26.921055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:26.921055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:26.921055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 334/647] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:26.921522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f3d48-cc18-4b8c-9e50-c2c1ff4baf01 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:26.928901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f52e79-1d3e-4384-80b7-465f582eca23 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:26.940123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:26.966490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd792e-49d2-4cea-8177-4961abec6092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:26.967124 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd792e-49d2-4cea-8177-4961abec6092 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:26.967406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd792e-49d2-4cea-8177-4961abec6092 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:26.967682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd792e-49d2-4cea-8177-4961abec6092 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:26.978299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd792e-49d2-4cea-8177-4961abec6092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e6bd792e-49d2-4cea-8177-4961abec6092 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:26.983119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:26.984054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:26.985592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 314/648] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:26.986553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd792e-49d2-4cea-8177-4961abec6092 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:27.032811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f3d48-cc18-4b8c-9e50-c2c1ff4baf01 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:27.069506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9df06-c68c-4dc5-9f9e-391ea32c7d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:27.070108 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9df06-c68c-4dc5-9f9e-391ea32c7d99 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:27.070412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9df06-c68c-4dc5-9f9e-391ea32c7d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:27.070687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9df06-c68c-4dc5-9f9e-391ea32c7d99 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:27.071410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9df06-c68c-4dc5-9f9e-391ea32c7d99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:27.071711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9df06-c68c-4dc5-9f9e-391ea32c7d99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:27.073125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9df06-c68c-4dc5-9f9e-391ea32c7d99 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:27.090593 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd792e-49d2-4cea-8177-4961abec6092 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:27.095927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 335/649] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Sep 12 23:15:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:27.095927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9df06-c68c-4dc5-9f9e-391ea32c7d99 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:27.130673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37589efa-b2db-4648-9afd-20c6f6d1faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:27.131308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37589efa-b2db-4648-9afd-20c6f6d1faf7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:27.131586 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37589efa-b2db-4648-9afd-20c6f6d1faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:27.131857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37589efa-b2db-4648-9afd-20c6f6d1faf7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:27.140569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37589efa-b2db-4648-9afd-20c6f6d1faf7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:27.142051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37589efa-b2db-4648-9afd-20c6f6d1faf7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:27.143008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-37589efa-b2db-4648-9afd-20c6f6d1faf7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:27.154781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:27.155745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:27.157202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:27.157202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:27.157202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:27.157202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:27.157202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:27.157202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:27.157202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:27.157202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:27.157202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:15:27.157202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:27.157202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 315/650] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:27.157202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37589efa-b2db-4648-9afd-20c6f6d1faf7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:27.194725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:27.206055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9df06-c68c-4dc5-9f9e-391ea32c7d99 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:27.244109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75465577-a104-400b-bcb8-1fb92cf8e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:27.244793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75465577-a104-400b-bcb8-1fb92cf8e64e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:27.244989 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75465577-a104-400b-bcb8-1fb92cf8e64e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:27.245263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75465577-a104-400b-bcb8-1fb92cf8e64e None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:27.246131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75465577-a104-400b-bcb8-1fb92cf8e64e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:27.246249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75465577-a104-400b-bcb8-1fb92cf8e64e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:27.247716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75465577-a104-400b-bcb8-1fb92cf8e64e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:27.260496 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 336/651] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:27.261209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75465577-a104-400b-bcb8-1fb92cf8e64e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:27.274676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37589efa-b2db-4648-9afd-20c6f6d1faf7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:27.309061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d6ddc-78a9-4681-a171-01736af2a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:27.309669 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d6ddc-78a9-4681-a171-01736af2a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:27.309950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d6ddc-78a9-4681-a171-01736af2a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:27.310232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d6ddc-78a9-4681-a171-01736af2a9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:27.310942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d6ddc-78a9-4681-a171-01736af2a9d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:27.311248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d6ddc-78a9-4681-a171-01736af2a9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:27.313135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d6ddc-78a9-4681-a171-01736af2a9d0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:27.325524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 316/652] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:27.325524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d6ddc-78a9-4681-a171-01736af2a9d0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:27.372694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75465577-a104-400b-bcb8-1fb92cf8e64e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:27.382539 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:27.414566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c9b45-fbfa-4bfb-9313-c91555c369f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:27.415180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c9b45-fbfa-4bfb-9313-c91555c369f8 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:27.415575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c9b45-fbfa-4bfb-9313-c91555c369f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:27.416103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c9b45-fbfa-4bfb-9313-c91555c369f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:27.429888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:27.439716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d6ddc-78a9-4681-a171-01736af2a9d0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:27.475796 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b763a28-ca69-4e6f-aec3-065cb1d34104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:27.476413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b763a28-ca69-4e6f-aec3-065cb1d34104 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:27.476849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b763a28-ca69-4e6f-aec3-065cb1d34104 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:27.477128 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b763a28-ca69-4e6f-aec3-065cb1d34104 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:27.477858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b763a28-ca69-4e6f-aec3-065cb1d34104 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:27.478175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b763a28-ca69-4e6f-aec3-065cb1d34104 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:27.479663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b763a28-ca69-4e6f-aec3-065cb1d34104 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:27.492542 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c9b45-fbfa-4bfb-9313-c91555c369f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:27.494034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c9b45-fbfa-4bfb-9313-c91555c369f8 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:27.497132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 317/653] 10.222.0.33 () {56 vars in 1137 bytes} [Mon Sep 12 23:15:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:27.497951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b763a28-ca69-4e6f-aec3-065cb1d34104 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:27.592543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 337/654] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:27.593372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c9b45-fbfa-4bfb-9313-c91555c369f8 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:27.600553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b763a28-ca69-4e6f-aec3-065cb1d34104 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:27.601251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:27.635354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bffc1-6dcb-46ff-9df1-a0c2ec1087f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:27.635954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bffc1-6dcb-46ff-9df1-a0c2ec1087f3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:27.636231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bffc1-6dcb-46ff-9df1-a0c2ec1087f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:27.636499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bffc1-6dcb-46ff-9df1-a0c2ec1087f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:27.637218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bffc1-6dcb-46ff-9df1-a0c2ec1087f3 None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=46f96bbb14c04691ac403271de293224) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:27.637527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bffc1-6dcb-46ff-9df1-a0c2ec1087f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:27.638981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bffc1-6dcb-46ff-9df1-a0c2ec1087f3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:27.644791 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 318/655] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:27 2022] GET /identity/v3/role_assignments?user.id=46f96bbb14c04691ac403271de293224&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:27.645937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff5a8c-9fd6-4096-a166-00ddc31ddac2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:27.646232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff5a8c-9fd6-4096-a166-00ddc31ddac2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:27.646524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff5a8c-9fd6-4096-a166-00ddc31ddac2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:27.647925 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 319/656] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:27.648401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff5a8c-9fd6-4096-a166-00ddc31ddac2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:27.666694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:27.709934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c9b45-fbfa-4bfb-9313-c91555c369f8 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:27.749751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ab5e0-bcd6-4669-815f-694aee69bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:27.751814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab5e0-bcd6-4669-815f-694aee69bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:27.752113 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab5e0-bcd6-4669-815f-694aee69bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:27.752390 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab5e0-bcd6-4669-815f-694aee69bfc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:27.764273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ab5e0-bcd6-4669-815f-694aee69bfc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:27.765780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ab5e0-bcd6-4669-815f-694aee69bfc6 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:27.771436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff5a8c-9fd6-4096-a166-00ddc31ddac2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-c30ab5e0-bcd6-4669-815f-694aee69bfc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:27.783957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:27.784958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:27.785813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:27.785813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:27.785813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:27.785813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 338/657] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:27.786048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ab5e0-bcd6-4669-815f-694aee69bfc6 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:27.817269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5549184-b713-4ae2-a97c-7da26abd10a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:27.818198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5549184-b713-4ae2-a97c-7da26abd10a0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:27.818506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5549184-b713-4ae2-a97c-7da26abd10a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:27.818780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5549184-b713-4ae2-a97c-7da26abd10a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:27.863383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:27.904584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5549184-b713-4ae2-a97c-7da26abd10a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:27.906883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5549184-b713-4ae2-a97c-7da26abd10a0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:27.917309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ab5e0-bcd6-4669-815f-694aee69bfc6 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:27.924452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:27.956706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08412d-9f20-4e22-8ac2-53637d62f803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:27.957599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08412d-9f20-4e22-8ac2-53637d62f803 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:27.957876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08412d-9f20-4e22-8ac2-53637d62f803 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:27.958143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08412d-9f20-4e22-8ac2-53637d62f803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:27.971301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08412d-9f20-4e22-8ac2-53637d62f803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:27.973440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08412d-9f20-4e22-8ac2-53637d62f803 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-5d08412d-9f20-4e22-8ac2-53637d62f803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:27.990966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:27.991969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:27.992842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:27.992842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:27.992842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:27.992842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 339/658] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:27.993492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397711d5-36b3-417f-810c-5c888c1ca17a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:27.993658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397711d5-36b3-417f-810c-5c888c1ca17a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:27.993892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397711d5-36b3-417f-810c-5c888c1ca17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:28.017549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-397711d5-36b3-417f-810c-5c888c1ca17a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:28.019101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-397711d5-36b3-417f-810c-5c888c1ca17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:28.019241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 320/659] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:28.019840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5549184-b713-4ae2-a97c-7da26abd10a0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:28.110420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 340/660] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:28.110420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397711d5-36b3-417f-810c-5c888c1ca17a None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:28.131919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5549184-b713-4ae2-a97c-7da26abd10a0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:28.152274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:28.154834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:28.177368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e46695-99a7-4630-a12e-0c3a52b42793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:28.177990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e46695-99a7-4630-a12e-0c3a52b42793 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:28.178268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e46695-99a7-4630-a12e-0c3a52b42793 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:28.178702 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e46695-99a7-4630-a12e-0c3a52b42793 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:28.179474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e46695-99a7-4630-a12e-0c3a52b42793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:28.179781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e46695-99a7-4630-a12e-0c3a52b42793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:28.181193 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e46695-99a7-4630-a12e-0c3a52b42793 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:28.198808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 321/661] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:28.200313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e46695-99a7-4630-a12e-0c3a52b42793 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:28.226165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397711d5-36b3-417f-810c-5c888c1ca17a None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:28.264882 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159a651-eb2f-432c-ae93-49c7d60cdce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:28.265526 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159a651-eb2f-432c-ae93-49c7d60cdce5 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:28.265884 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159a651-eb2f-432c-ae93-49c7d60cdce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:28.266157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159a651-eb2f-432c-ae93-49c7d60cdce5 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:28.266860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159a651-eb2f-432c-ae93-49c7d60cdce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:28.267162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159a651-eb2f-432c-ae93-49c7d60cdce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:28.268834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159a651-eb2f-432c-ae93-49c7d60cdce5 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:28.286816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 341/662] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:28.287894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159a651-eb2f-432c-ae93-49c7d60cdce5 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:28.341813 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e46695-99a7-4630-a12e-0c3a52b42793 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:28.398522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38681d6a-7d03-4b41-9926-386eb91dbed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:28.399170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38681d6a-7d03-4b41-9926-386eb91dbed7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:28.399452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38681d6a-7d03-4b41-9926-386eb91dbed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:28.399726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38681d6a-7d03-4b41-9926-386eb91dbed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:28.412958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:28.416527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38681d6a-7d03-4b41-9926-386eb91dbed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:28.418083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38681d6a-7d03-4b41-9926-386eb91dbed7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:28.418623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159a651-eb2f-432c-ae93-49c7d60cdce5 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-38681d6a-7d03-4b41-9926-386eb91dbed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:28.436238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:28.437229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:28.439251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:28.439251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:28.439251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:28.439251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 322/663] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:28.439251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38681d6a-7d03-4b41-9926-386eb91dbed7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:28.462561 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a0632-4c58-4586-981b-0d5a18f64a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:28.463197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a0632-4c58-4586-981b-0d5a18f64a92 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:28.463469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a0632-4c58-4586-981b-0d5a18f64a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:28.463737 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a0632-4c58-4586-981b-0d5a18f64a92 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:28.471172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:28.474134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a0632-4c58-4586-981b-0d5a18f64a92 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:28.475705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a0632-4c58-4586-981b-0d5a18f64a92 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-a62a0632-4c58-4586-981b-0d5a18f64a92 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:28.488623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:28.489980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:28.491530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:28.491530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:28.491530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:28.491530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:28.491530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:28.491530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:28.491530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:28.491530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:28.491530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 23:15:28.491530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:28.491530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 342/664] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:28.491530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a0632-4c58-4586-981b-0d5a18f64a92 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:28.561640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38681d6a-7d03-4b41-9926-386eb91dbed7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:28.598601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e7480-e03a-4f5c-b5a5-c3b03edcf213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:28.599231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e7480-e03a-4f5c-b5a5-c3b03edcf213 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:28.599508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e7480-e03a-4f5c-b5a5-c3b03edcf213 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:28.599775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e7480-e03a-4f5c-b5a5-c3b03edcf213 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:28.607070 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e7480-e03a-4f5c-b5a5-c3b03edcf213 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:28.609333 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e7480-e03a-4f5c-b5a5-c3b03edcf213 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:28.614522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a0632-4c58-4586-981b-0d5a18f64a92 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f56e7480-e03a-4f5c-b5a5-c3b03edcf213 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:28.621387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:28.622295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:28.623256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:28.623256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:28.623256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:28.623256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:28.623256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:28.623256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:28.623256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:28.623256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:28.623256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 323/665] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:28.623256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e7480-e03a-4f5c-b5a5-c3b03edcf213 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:28.660130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9f513-4a70-41b2-aad0-265b893e6a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:28.661090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9f513-4a70-41b2-aad0-265b893e6a9d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:28.661402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9f513-4a70-41b2-aad0-265b893e6a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:28.661686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9f513-4a70-41b2-aad0-265b893e6a9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:28.674807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9f513-4a70-41b2-aad0-265b893e6a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-b8c9f513-4a70-41b2-aad0-265b893e6a9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:28.681673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:28.682652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:28.683512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 343/666] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:28.684253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9f513-4a70-41b2-aad0-265b893e6a9d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:28.713511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:28.737449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:28.754254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e7480-e03a-4f5c-b5a5-c3b03edcf213 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:28.793428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e517eab-543a-40e2-93d5-953781e5c532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:28.794019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e517eab-543a-40e2-93d5-953781e5c532 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:28.794797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e517eab-543a-40e2-93d5-953781e5c532 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:28.794797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e517eab-543a-40e2-93d5-953781e5c532 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:28.795224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e517eab-543a-40e2-93d5-953781e5c532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:28.795582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e517eab-543a-40e2-93d5-953781e5c532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:28.797663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e517eab-543a-40e2-93d5-953781e5c532 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:28.808699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9f513-4a70-41b2-aad0-265b893e6a9d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:28.811340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 324/667] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:28.812309 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e517eab-543a-40e2-93d5-953781e5c532 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:28.849677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6b26c-3e69-403e-a425-8f06c8af7913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:28.850294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6b26c-3e69-403e-a425-8f06c8af7913 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:28.850602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6b26c-3e69-403e-a425-8f06c8af7913 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:28.850872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6b26c-3e69-403e-a425-8f06c8af7913 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:28.851601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6b26c-3e69-403e-a425-8f06c8af7913 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:28.851907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6b26c-3e69-403e-a425-8f06c8af7913 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:28.853497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6b26c-3e69-403e-a425-8f06c8af7913 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:28.876118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 344/668] 10.222.0.33 () {56 vars in 1139 bytes} [Mon Sep 12 23:15:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:28.877041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6b26c-3e69-403e-a425-8f06c8af7913 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:28.945465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e517eab-543a-40e2-93d5-953781e5c532 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:28.973712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:28.981596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c067ad-5e7e-447a-ac89-0489eea67114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:28.982207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c067ad-5e7e-447a-ac89-0489eea67114 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:28.982513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c067ad-5e7e-447a-ac89-0489eea67114 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:28.982942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c067ad-5e7e-447a-ac89-0489eea67114 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:28.983573 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c067ad-5e7e-447a-ac89-0489eea67114 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:28.983888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c067ad-5e7e-447a-ac89-0489eea67114 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:28.986363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c067ad-5e7e-447a-ac89-0489eea67114 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:29.002904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 325/669] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:29.003090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6b26c-3e69-403e-a425-8f06c8af7913 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:29.003176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c067ad-5e7e-447a-ac89-0489eea67114 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:29.013031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:29.040281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9c58-1bfe-4e47-b0f4-218487d7ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:29.041152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9c58-1bfe-4e47-b0f4-218487d7ba50 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:29.041438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9c58-1bfe-4e47-b0f4-218487d7ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:29.041700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9c58-1bfe-4e47-b0f4-218487d7ba50 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:29.042348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f9c58-1bfe-4e47-b0f4-218487d7ba50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:29.042697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f9c58-1bfe-4e47-b0f4-218487d7ba50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:29.044092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f9c58-1bfe-4e47-b0f4-218487d7ba50 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:29.058353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 345/670] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:29.058353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9c58-1bfe-4e47-b0f4-218487d7ba50 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:29.116001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c067ad-5e7e-447a-ac89-0489eea67114 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:29.153090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e89cd1-5629-499d-abbf-b0bc5cf40a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:29.153906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e89cd1-5629-499d-abbf-b0bc5cf40a0e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:29.154190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e89cd1-5629-499d-abbf-b0bc5cf40a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:29.154492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e89cd1-5629-499d-abbf-b0bc5cf40a0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:29.162541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e89cd1-5629-499d-abbf-b0bc5cf40a0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:29.164104 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e89cd1-5629-499d-abbf-b0bc5cf40a0e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:29.173047 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9c58-1bfe-4e47-b0f4-218487d7ba50 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-30e89cd1-5629-499d-abbf-b0bc5cf40a0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:29.176789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:29.177649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:29.183363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:29.183363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:29.183363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:29.183363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:29.183363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:29.183363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:29.183363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:29.183363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:29.183363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 326/671] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:29.183363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e89cd1-5629-499d-abbf-b0bc5cf40a0e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:29.213695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14279090-9cd7-4282-81fe-e66c88d73f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:29.214303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14279090-9cd7-4282-81fe-e66c88d73f88 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:29.214629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14279090-9cd7-4282-81fe-e66c88d73f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:29.214902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14279090-9cd7-4282-81fe-e66c88d73f88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:29.227285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:29.252133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:29.287304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e89cd1-5629-499d-abbf-b0bc5cf40a0e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:29.291333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14279090-9cd7-4282-81fe-e66c88d73f88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:29.292773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14279090-9cd7-4282-81fe-e66c88d73f88 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:29.321634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33632c-264a-4cf6-a1d7-96d46b14e9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:29.322318 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33632c-264a-4cf6-a1d7-96d46b14e9ae None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:29.322700 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33632c-264a-4cf6-a1d7-96d46b14e9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:29.322976 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33632c-264a-4cf6-a1d7-96d46b14e9ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:29.323698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33632c-264a-4cf6-a1d7-96d46b14e9ae None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=67b0698294e94845ae0dbdfb87059755) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:29.324002 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33632c-264a-4cf6-a1d7-96d46b14e9ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:29.325433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33632c-264a-4cf6-a1d7-96d46b14e9ae None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:29.338406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 327/672] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:29 2022] GET /identity/v3/role_assignments?user.id=67b0698294e94845ae0dbdfb87059755&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:29.338406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33632c-264a-4cf6-a1d7-96d46b14e9ae None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:29.424082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 346/673] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:29.425066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14279090-9cd7-4282-81fe-e66c88d73f88 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:29.449190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33632c-264a-4cf6-a1d7-96d46b14e9ae None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:29.480476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:29.484161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:29.492217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084afba-b531-400f-916e-fb3a2eb752cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:29.492875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084afba-b531-400f-916e-fb3a2eb752cb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:29.493154 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084afba-b531-400f-916e-fb3a2eb752cb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:29.493424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084afba-b531-400f-916e-fb3a2eb752cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:29.505566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084afba-b531-400f-916e-fb3a2eb752cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:29.507124 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084afba-b531-400f-916e-fb3a2eb752cb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6084afba-b531-400f-916e-fb3a2eb752cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:29.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:29.525033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:29.525911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:29.525911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:29.525911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:29.528254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 328/674] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:29.529187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084afba-b531-400f-916e-fb3a2eb752cb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:29.570853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14279090-9cd7-4282-81fe-e66c88d73f88 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:29.615994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605d91d-3590-4bf0-9812-d649dbb610ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:29.616617 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605d91d-3590-4bf0-9812-d649dbb610ed None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:29.616948 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605d91d-3590-4bf0-9812-d649dbb610ed None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:29.617497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605d91d-3590-4bf0-9812-d649dbb610ed None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:29.618362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605d91d-3590-4bf0-9812-d649dbb610ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:29.618862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605d91d-3590-4bf0-9812-d649dbb610ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:29.620303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605d91d-3590-4bf0-9812-d649dbb610ed None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:29.635935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 347/675] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:29.636261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605d91d-3590-4bf0-9812-d649dbb610ed None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:29.667162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084afba-b531-400f-916e-fb3a2eb752cb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:29.717000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13503b-6a7e-4624-b358-cfa75363f8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:29.719287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13503b-6a7e-4624-b358-cfa75363f8fe None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:29.719801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13503b-6a7e-4624-b358-cfa75363f8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:29.720980 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13503b-6a7e-4624-b358-cfa75363f8fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:29.733618 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13503b-6a7e-4624-b358-cfa75363f8fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:29.735902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13503b-6a7e-4624-b358-cfa75363f8fe None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fe13503b-6a7e-4624-b358-cfa75363f8fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:29.751701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:29.752655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:29.753531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:29.753531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:29.753531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:29.755737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 329/676] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:29.759960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:29.759960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605d91d-3590-4bf0-9812-d649dbb610ed None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:29.760846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13503b-6a7e-4624-b358-cfa75363f8fe None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:29.800248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366fff4-d0e3-45de-bb76-cc746ba0916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:29.801487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366fff4-d0e3-45de-bb76-cc746ba0916d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:29.802208 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366fff4-d0e3-45de-bb76-cc746ba0916d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:29.802742 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366fff4-d0e3-45de-bb76-cc746ba0916d None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:29.803723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366fff4-d0e3-45de-bb76-cc746ba0916d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:29.804437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366fff4-d0e3-45de-bb76-cc746ba0916d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:29.806358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366fff4-d0e3-45de-bb76-cc746ba0916d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:29.807479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:29.826466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 348/677] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:29.827719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366fff4-d0e3-45de-bb76-cc746ba0916d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:29.900233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13503b-6a7e-4624-b358-cfa75363f8fe None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:29.939157 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20af69-624a-43c3-8a6f-a5918a882cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:29.939699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20af69-624a-43c3-8a6f-a5918a882cab None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:29.939981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20af69-624a-43c3-8a6f-a5918a882cab None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:29.940255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20af69-624a-43c3-8a6f-a5918a882cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:29.941011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20af69-624a-43c3-8a6f-a5918a882cab None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=4f5d6fe6235447acb395030fb0f0555d) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:29.941334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20af69-624a-43c3-8a6f-a5918a882cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:29.942994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20af69-624a-43c3-8a6f-a5918a882cab None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:29.946091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366fff4-d0e3-45de-bb76-cc746ba0916d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:29.949968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 330/678] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:29 2022] GET /identity/v3/role_assignments?user.id=4f5d6fe6235447acb395030fb0f0555d&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:29.950974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20af69-624a-43c3-8a6f-a5918a882cab None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:29.988675 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793c746-5a06-4dbf-8f24-fe17e5f75ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:29.989663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793c746-5a06-4dbf-8f24-fe17e5f75ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:29.990166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793c746-5a06-4dbf-8f24-fe17e5f75ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:29.990682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793c746-5a06-4dbf-8f24-fe17e5f75ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:29.991586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793c746-5a06-4dbf-8f24-fe17e5f75ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:29.992107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793c746-5a06-4dbf-8f24-fe17e5f75ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:29.993684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793c746-5a06-4dbf-8f24-fe17e5f75ec8 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:30.007382 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 349/679] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:30.013327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793c746-5a06-4dbf-8f24-fe17e5f75ec8 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:30.040219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:30.063558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:30.068344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20af69-624a-43c3-8a6f-a5918a882cab None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:30.111292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa635dae-2a1b-4cd8-8c01-702cac7279c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:30.111946 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa635dae-2a1b-4cd8-8c01-702cac7279c3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:30.112228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa635dae-2a1b-4cd8-8c01-702cac7279c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:30.112503 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa635dae-2a1b-4cd8-8c01-702cac7279c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:30.121589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa635dae-2a1b-4cd8-8c01-702cac7279c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:30.123111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa635dae-2a1b-4cd8-8c01-702cac7279c3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-aa635dae-2a1b-4cd8-8c01-702cac7279c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:30.136574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:30.137950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:30.138914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:30.138914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:30.138914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:30.138914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:30.138914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:30.138914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:30.138914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:30.138914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:30.138914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:15:30.138914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:30.138914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 331/680] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:30.143062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793c746-5a06-4dbf-8f24-fe17e5f75ec8 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:30.144672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aa185-132b-452a-844a-90cdb2d4d698 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:30.145114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aa185-132b-452a-844a-90cdb2d4d698 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:30.145451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aa185-132b-452a-844a-90cdb2d4d698 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:30.147304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 332/681] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:30.148121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7aa185-132b-452a-844a-90cdb2d4d698 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:30.193214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87436d2a-ce1b-49c5-afa6-96ed6f23a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:30.193901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87436d2a-ce1b-49c5-afa6-96ed6f23a732 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:30.194186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87436d2a-ce1b-49c5-afa6-96ed6f23a732 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:30.194496 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87436d2a-ce1b-49c5-afa6-96ed6f23a732 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:30.201912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87436d2a-ce1b-49c5-afa6-96ed6f23a732 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:30.204094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87436d2a-ce1b-49c5-afa6-96ed6f23a732 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-87436d2a-ce1b-49c5-afa6-96ed6f23a732 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:30.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:30.222071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:30.223015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:30.223015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:30.223015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:30.223015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:30.223015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:30.223015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:30.223015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:30.223015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:30.223448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 350/682] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:30.225010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd9b49-39a5-43ee-9741-2b5cc26d8269 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:30.225289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd9b49-39a5-43ee-9741-2b5cc26d8269 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:30.225564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd9b49-39a5-43ee-9741-2b5cc26d8269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:30.253629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-9efd9b49-39a5-43ee-9741-2b5cc26d8269 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:30.254594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9efd9b49-39a5-43ee-9741-2b5cc26d8269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:30.274360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7aa185-132b-452a-844a-90cdb2d4d698 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:30.317929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc36d1c-6ad9-44ad-9263-8326638444f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:30.318577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc36d1c-6ad9-44ad-9263-8326638444f8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:30.318859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc36d1c-6ad9-44ad-9263-8326638444f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:30.319141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc36d1c-6ad9-44ad-9263-8326638444f8 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:30.319882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc36d1c-6ad9-44ad-9263-8326638444f8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:30.320191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc36d1c-6ad9-44ad-9263-8326638444f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:30.322269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc36d1c-6ad9-44ad-9263-8326638444f8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:30.337548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 351/683] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:30.338750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd9b49-39a5-43ee-9741-2b5cc26d8269 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:30.354678 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 333/684] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Sep 12 23:15:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:30.359090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:30.361650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc36d1c-6ad9-44ad-9263-8326638444f8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:30.401280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:30.539350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc36d1c-6ad9-44ad-9263-8326638444f8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:30.543220 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd9b49-39a5-43ee-9741-2b5cc26d8269 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:30.602206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22299f60-e978-4580-9d87-549d8c198d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:30.602853 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299f60-e978-4580-9d87-549d8c198d2e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:30.603135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299f60-e978-4580-9d87-549d8c198d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:30.603408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299f60-e978-4580-9d87-549d8c198d2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:30.606725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a946c3-3479-4a06-adc9-30235b9bdc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:30.607336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a946c3-3479-4a06-adc9-30235b9bdc21 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:30.607618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a946c3-3479-4a06-adc9-30235b9bdc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:30.607894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a946c3-3479-4a06-adc9-30235b9bdc21 None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:30.608594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a946c3-3479-4a06-adc9-30235b9bdc21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:30.608901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a946c3-3479-4a06-adc9-30235b9bdc21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:30.610976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a946c3-3479-4a06-adc9-30235b9bdc21 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:30.623346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 352/685] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:30.630023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a946c3-3479-4a06-adc9-30235b9bdc21 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:30.720654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:30.721574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22299f60-e978-4580-9d87-549d8c198d2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:30.724974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22299f60-e978-4580-9d87-549d8c198d2e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:30.748919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:30.761498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a946c3-3479-4a06-adc9-30235b9bdc21 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:30.808661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0033fab-4ae5-48a7-bfbc-e92b6ce7455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:30.809190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0033fab-4ae5-48a7-bfbc-e92b6ce7455f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:30.809466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0033fab-4ae5-48a7-bfbc-e92b6ce7455f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:30.809734 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0033fab-4ae5-48a7-bfbc-e92b6ce7455f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:30.810487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0033fab-4ae5-48a7-bfbc-e92b6ce7455f None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=b1d4b0f322c741c5b69b922071aab3d6) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:30.810792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0033fab-4ae5-48a7-bfbc-e92b6ce7455f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:30.813327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0033fab-4ae5-48a7-bfbc-e92b6ce7455f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:30.820197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 353/686] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:30 2022] GET /identity/v3/role_assignments?user.id=b1d4b0f322c741c5b69b922071aab3d6&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:30.821273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0033fab-4ae5-48a7-bfbc-e92b6ce7455f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:30.854624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 334/687] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:30.857544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22299f60-e978-4580-9d87-549d8c198d2e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:30.971893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0033fab-4ae5-48a7-bfbc-e92b6ce7455f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:31.009879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22299f60-e978-4580-9d87-549d8c198d2e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:31.019522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2793b3-91b7-4edf-869e-0631cb5ed1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:31.020222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2793b3-91b7-4edf-869e-0631cb5ed1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:31.020501 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2793b3-91b7-4edf-869e-0631cb5ed1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:31.020771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2793b3-91b7-4edf-869e-0631cb5ed1f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:31.024615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:31.036629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:31.043587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2793b3-91b7-4edf-869e-0631cb5ed1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:31.045508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2793b3-91b7-4edf-869e-0631cb5ed1f2 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:31.057448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e7a66-0d30-4014-89ad-01991c47994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:31.057902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e7a66-0d30-4014-89ad-01991c47994f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:31.058179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e7a66-0d30-4014-89ad-01991c47994f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:31.058477 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e7a66-0d30-4014-89ad-01991c47994f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:31.071909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e7a66-0d30-4014-89ad-01991c47994f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:31.071909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e7a66-0d30-4014-89ad-01991c47994f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-9c2793b3-91b7-4edf-869e-0631cb5ed1f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:31.079182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:31.080194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:31.081079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:31.081079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:31.081079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:31.091127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 354/688] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-629e7a66-0d30-4014-89ad-01991c47994f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:31.092217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:31.093305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:31.095336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:31.095336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:31.095336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:31.100127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 335/689] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:31.101353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2793b3-91b7-4edf-869e-0631cb5ed1f2 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:31.103099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e7a66-0d30-4014-89ad-01991c47994f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:31.226298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e7a66-0d30-4014-89ad-01991c47994f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:31.246939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2793b3-91b7-4edf-869e-0631cb5ed1f2 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:31.265900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aca6b7-774d-4f62-b795-0f0bc19174a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:31.266719 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aca6b7-774d-4f62-b795-0f0bc19174a0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:31.266917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aca6b7-774d-4f62-b795-0f0bc19174a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:31.267199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aca6b7-774d-4f62-b795-0f0bc19174a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:31.267852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aca6b7-774d-4f62-b795-0f0bc19174a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:31.268420 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aca6b7-774d-4f62-b795-0f0bc19174a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:31.269632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aca6b7-774d-4f62-b795-0f0bc19174a0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:31.283488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 336/690] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:31.290417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aca6b7-774d-4f62-b795-0f0bc19174a0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:31.296901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e1ffe-75b2-42ec-b8cd-71d9911f9657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:31.297821 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e1ffe-75b2-42ec-b8cd-71d9911f9657 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:31.298199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e1ffe-75b2-42ec-b8cd-71d9911f9657 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:31.298493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e1ffe-75b2-42ec-b8cd-71d9911f9657 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:31.299151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e1ffe-75b2-42ec-b8cd-71d9911f9657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:31.302408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e1ffe-75b2-42ec-b8cd-71d9911f9657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:31.302408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e1ffe-75b2-42ec-b8cd-71d9911f9657 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:31.314729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 355/691] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:31.320938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e1ffe-75b2-42ec-b8cd-71d9911f9657 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:31.324119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:31.374283 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:31.413299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aca6b7-774d-4f62-b795-0f0bc19174a0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:31.443775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e1ffe-75b2-42ec-b8cd-71d9911f9657 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:31.478315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f727396-8c4c-4dfc-bbf9-a3e65f171d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:31.479274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f727396-8c4c-4dfc-bbf9-a3e65f171d45 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:31.480156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f727396-8c4c-4dfc-bbf9-a3e65f171d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:31.481031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f727396-8c4c-4dfc-bbf9-a3e65f171d45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:31.485719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9213ec-31dd-4b42-a77e-5c6411511333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:31.486684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9213ec-31dd-4b42-a77e-5c6411511333 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:31.487886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9213ec-31dd-4b42-a77e-5c6411511333 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:31.488402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9213ec-31dd-4b42-a77e-5c6411511333 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:31.492419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9213ec-31dd-4b42-a77e-5c6411511333 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:31.494101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9213ec-31dd-4b42-a77e-5c6411511333 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:31.503480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f727396-8c4c-4dfc-bbf9-a3e65f171d45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:31.505201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f727396-8c4c-4dfc-bbf9-a3e65f171d45 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3f727396-8c4c-4dfc-bbf9-a3e65f171d45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:31.523887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:31.525057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:31.526152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:31.526152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:31.526152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:31.526152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:31.526152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:31.526152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:31.526152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:31.526152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:31.528341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 337/692] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:31.538773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f727396-8c4c-4dfc-bbf9-a3e65f171d45 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:31.540351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 356/693] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:15:31 2022] POST /identity/v3/users => generated 254 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:15:31.664229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:31.685442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f727396-8c4c-4dfc-bbf9-a3e65f171d45 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:31.740755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5aae2-5bd5-4403-8487-06ef34545cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:31.741403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5aae2-5bd5-4403-8487-06ef34545cfc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:31.741682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5aae2-5bd5-4403-8487-06ef34545cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:31.741951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5aae2-5bd5-4403-8487-06ef34545cfc None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:31.742711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5aae2-5bd5-4403-8487-06ef34545cfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:31.743022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5aae2-5bd5-4403-8487-06ef34545cfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:31.744518 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5aae2-5bd5-4403-8487-06ef34545cfc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:31.762872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 338/694] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:31.769256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9213ec-31dd-4b42-a77e-5c6411511333 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:31.923676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9213ec-31dd-4b42-a77e-5c6411511333 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:31.925496 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:31.961587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2f2c6-835d-476f-ac43-dc3f3c37112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:31.962200 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2f2c6-835d-476f-ac43-dc3f3c37112a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:31.962502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2f2c6-835d-476f-ac43-dc3f3c37112a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:31.962836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2f2c6-835d-476f-ac43-dc3f3c37112a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:31.963570 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2f2c6-835d-476f-ac43-dc3f3c37112a None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=53214ffdc5d04c14b3b3ac868862480b) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:31.963878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2f2c6-835d-476f-ac43-dc3f3c37112a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:31.965306 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2f2c6-835d-476f-ac43-dc3f3c37112a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:31.978566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 357/695] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:31 2022] GET /identity/v3/role_assignments?user.id=53214ffdc5d04c14b3b3ac868862480b&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:32.005587 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4e3c-1582-47f6-938f-8d1f4b3054f2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:32.005922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4e3c-1582-47f6-938f-8d1f4b3054f2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:32.006142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4e3c-1582-47f6-938f-8d1f4b3054f2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:32.007902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 339/696] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:32.013732 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2f5ab-f0d2-4473-a781-08e5a9a93c61 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:32.014028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2f5ab-f0d2-4473-a781-08e5a9a93c61 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:32.014278 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2f5ab-f0d2-4473-a781-08e5a9a93c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:32.035995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-41f2f5ab-f0d2-4473-a781-08e5a9a93c61 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:32.037224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-41f2f5ab-f0d2-4473-a781-08e5a9a93c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:32.116749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 358/697] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:32.411864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c4e3c-1582-47f6-938f-8d1f4b3054f2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:32.533850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c4e3c-1582-47f6-938f-8d1f4b3054f2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:32.543272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e5fff-b352-481c-bfd0-358ce0e17ecb None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:32.543272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e5fff-b352-481c-bfd0-358ce0e17ecb None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:32.543272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e5fff-b352-481c-bfd0-358ce0e17ecb None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:32.544638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 359/698] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:15:32.554303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c1dd0-3011-4d8c-aa79-f31b1ea4f4a0 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:32.554883 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c1dd0-3011-4d8c-aa79-f31b1ea4f4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:32.555375 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c1dd0-3011-4d8c-aa79-f31b1ea4f4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:32.574172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0f645-3191-4675-84b0-954e399d3d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:32.575170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0f645-3191-4675-84b0-954e399d3d8d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:32.575170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0f645-3191-4675-84b0-954e399d3d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:32.575368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0f645-3191-4675-84b0-954e399d3d8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:32.579327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-419c1dd0-3011-4d8c-aa79-f31b1ea4f4a0 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:32.580865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-419c1dd0-3011-4d8c-aa79-f31b1ea4f4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:32.588493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0f645-3191-4675-84b0-954e399d3d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e9e0f645-3191-4675-84b0-954e399d3d8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:32.595255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:32.596246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:32.597126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 340/699] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:32.604766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0f645-3191-4675-84b0-954e399d3d8d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:32.618833 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:32.671298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 360/700] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:15:32.758046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0f645-3191-4675-84b0-954e399d3d8d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:32.801339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac491c-9b2c-4a11-afaf-d37dcaf1fca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:32.802330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac491c-9b2c-4a11-afaf-d37dcaf1fca1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:32.802843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac491c-9b2c-4a11-afaf-d37dcaf1fca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:32.803306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac491c-9b2c-4a11-afaf-d37dcaf1fca1 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:32.804163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac491c-9b2c-4a11-afaf-d37dcaf1fca1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:32.804677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac491c-9b2c-4a11-afaf-d37dcaf1fca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:32.806234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac491c-9b2c-4a11-afaf-d37dcaf1fca1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:32.818279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 341/701] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:32.824224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c1dd0-3011-4d8c-aa79-f31b1ea4f4a0 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:32.856462 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:32.949103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c1dd0-3011-4d8c-aa79-f31b1ea4f4a0 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:33.001042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac491c-9b2c-4a11-afaf-d37dcaf1fca1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:33.005205 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc57716-37dc-425e-8265-7380805268e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:33.005900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc57716-37dc-425e-8265-7380805268e7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:33.006176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc57716-37dc-425e-8265-7380805268e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:33.006464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc57716-37dc-425e-8265-7380805268e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:33.032199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc57716-37dc-425e-8265-7380805268e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:33.035168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc57716-37dc-425e-8265-7380805268e7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-ffc57716-37dc-425e-8265-7380805268e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:33.057710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:33.058735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:33.059594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:33.059594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:33.059594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:33.061784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 361/702] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:33.075267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc57716-37dc-425e-8265-7380805268e7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:33.138306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:33.173088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:33.192378 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac491c-9b2c-4a11-afaf-d37dcaf1fca1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:33.202875 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc57716-37dc-425e-8265-7380805268e7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:33.243347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360b058-fcaf-42bd-aac3-5041e4316f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:33.244298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360b058-fcaf-42bd-aac3-5041e4316f54 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:33.244772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360b058-fcaf-42bd-aac3-5041e4316f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:33.245238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360b058-fcaf-42bd-aac3-5041e4316f54 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:33.246091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360b058-fcaf-42bd-aac3-5041e4316f54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:33.246663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360b058-fcaf-42bd-aac3-5041e4316f54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:33.247802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc5081-a3c3-456f-b31c-377f8832e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:33.248442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5081-a3c3-456f-b31c-377f8832e898 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:33.248718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5081-a3c3-456f-b31c-377f8832e898 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:33.248962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360b058-fcaf-42bd-aac3-5041e4316f54 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:33.249070 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5081-a3c3-456f-b31c-377f8832e898 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:33.249552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc5081-a3c3-456f-b31c-377f8832e898 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:33.252003 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc5081-a3c3-456f-b31c-377f8832e898 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:33.263380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 362/703] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-4dbc5081-a3c3-456f-b31c-377f8832e898 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:33.274238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:33.275357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:15:33.276168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:33.278210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 342/704] 10.222.0.33 () {56 vars in 1129 bytes} [Mon Sep 12 23:15:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:33.279305 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360b058-fcaf-42bd-aac3-5041e4316f54 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:33.294837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc5081-a3c3-456f-b31c-377f8832e898 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:33.415121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360b058-fcaf-42bd-aac3-5041e4316f54 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:33.467538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231cb81-13c7-4152-855b-aaedb4378327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:33.468093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231cb81-13c7-4152-855b-aaedb4378327 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:33.468370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231cb81-13c7-4152-855b-aaedb4378327 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:33.469259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231cb81-13c7-4152-855b-aaedb4378327 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:33.483112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231cb81-13c7-4152-855b-aaedb4378327 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:33.485632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231cb81-13c7-4152-855b-aaedb4378327 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:33.490675 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-8231cb81-13c7-4152-855b-aaedb4378327 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:33.507268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:33.508263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:33.509178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:33.509178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:33.509178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:33.509178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:33.509178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:33.509178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:33.509178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:33.509178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:33.509178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:15:33.509178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:33.511484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 363/705] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Sep 12 23:15:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:33.516100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231cb81-13c7-4152-855b-aaedb4378327 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:33.518610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc5081-a3c3-456f-b31c-377f8832e898 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:33.582878 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4a0c0-6b29-42b1-9479-bbe81bcd4a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:33.583508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4a0c0-6b29-42b1-9479-bbe81bcd4a5b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:33.583791 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4a0c0-6b29-42b1-9479-bbe81bcd4a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:33.584067 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4a0c0-6b29-42b1-9479-bbe81bcd4a5b None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:33.584711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4a0c0-6b29-42b1-9479-bbe81bcd4a5b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:33.585017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4a0c0-6b29-42b1-9479-bbe81bcd4a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:33.587580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4a0c0-6b29-42b1-9479-bbe81bcd4a5b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:33.593135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:33.600546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 343/706] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Sep 12 23:15:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:33.605643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4a0c0-6b29-42b1-9479-bbe81bcd4a5b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:33.717093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231cb81-13c7-4152-855b-aaedb4378327 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:33.761544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4a0c0-6b29-42b1-9479-bbe81bcd4a5b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:33.767306 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44867d-47a4-4800-ad1b-d198df33bd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:33.768125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44867d-47a4-4800-ad1b-d198df33bd51 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:33.768559 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44867d-47a4-4800-ad1b-d198df33bd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:33.768980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44867d-47a4-4800-ad1b-d198df33bd51 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:33.769842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44867d-47a4-4800-ad1b-d198df33bd51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:33.770298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44867d-47a4-4800-ad1b-d198df33bd51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:33.772493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44867d-47a4-4800-ad1b-d198df33bd51 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:33.794973 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 364/707] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Sep 12 23:15:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:33.796555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faad9e-d0bb-4ced-abd6-9dda08462594 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:33.797721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faad9e-d0bb-4ced-abd6-9dda08462594 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:33.798183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faad9e-d0bb-4ced-abd6-9dda08462594 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:33.803665 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 365/708] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:33.803799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69d591-79f6-490d-b3c4-7bc3ec5f1053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:33.803799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69d591-79f6-490d-b3c4-7bc3ec5f1053 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:33.803799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69d591-79f6-490d-b3c4-7bc3ec5f1053 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:33.803799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69d591-79f6-490d-b3c4-7bc3ec5f1053 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:33.804170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69d591-79f6-490d-b3c4-7bc3ec5f1053 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:33.804170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69d591-79f6-490d-b3c4-7bc3ec5f1053 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:33.805175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faad9e-d0bb-4ced-abd6-9dda08462594 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:33.805855 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69d591-79f6-490d-b3c4-7bc3ec5f1053 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:33.812004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 344/709] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Sep 12 23:15:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:33.813685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86158c65-ca3a-4a91-ae8e-8e4ae6bb5851 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:33.814066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86158c65-ca3a-4a91-ae8e-8e4ae6bb5851 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:33.814497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86158c65-ca3a-4a91-ae8e-8e4ae6bb5851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:33.852411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-86158c65-ca3a-4a91-ae8e-8e4ae6bb5851 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:33.853889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-86158c65-ca3a-4a91-ae8e-8e4ae6bb5851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:33.927529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:33.960708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:33.980252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 345/710] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:34.015218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faad9e-d0bb-4ced-abd6-9dda08462594 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:34.051493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806199c9-ffd1-41b1-a434-f7ac49a4db6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:34.052110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806199c9-ffd1-41b1-a434-f7ac49a4db6f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:34.052388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806199c9-ffd1-41b1-a434-f7ac49a4db6f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:34.052717 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806199c9-ffd1-41b1-a434-f7ac49a4db6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:34.130540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806199c9-ffd1-41b1-a434-f7ac49a4db6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:34.131938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806199c9-ffd1-41b1-a434-f7ac49a4db6f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:34.194604 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:34.241152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 366/711] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:34.248168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86158c65-ca3a-4a91-ae8e-8e4ae6bb5851 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:34.275691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806199c9-ffd1-41b1-a434-f7ac49a4db6f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:34.433699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86158c65-ca3a-4a91-ae8e-8e4ae6bb5851 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:34.472602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806199c9-ffd1-41b1-a434-f7ac49a4db6f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:34.499464 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef16a8-7a2c-4da8-9a53-471b44883009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:34.500175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef16a8-7a2c-4da8-9a53-471b44883009 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:34.500452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef16a8-7a2c-4da8-9a53-471b44883009 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:34.500726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef16a8-7a2c-4da8-9a53-471b44883009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:34.518956 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef16a8-7a2c-4da8-9a53-471b44883009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:34.520590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef16a8-7a2c-4da8-9a53-471b44883009 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:34.530987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075a63f-109f-4bdb-a50c-70a8e14f48d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:34.532716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a63f-109f-4bdb-a50c-70a8e14f48d5 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:34.533162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a63f-109f-4bdb-a50c-70a8e14f48d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:34.533590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a63f-109f-4bdb-a50c-70a8e14f48d5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:34.534318 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075a63f-109f-4bdb-a50c-70a8e14f48d5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:34.535856 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075a63f-109f-4bdb-a50c-70a8e14f48d5 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-02ef16a8-7a2c-4da8-9a53-471b44883009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:34.537370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:34.538496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:34.539611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:34.539611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:34.539611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:34.541196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 346/712] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:34.542583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74321a07-d99e-4169-ab23-3140f5801adf None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:34.542954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74321a07-d99e-4169-ab23-3140f5801adf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:34.543295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74321a07-d99e-4169-ab23-3140f5801adf None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:34.544715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 347/713] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:34.549555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74321a07-d99e-4169-ab23-3140f5801adf None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-a075a63f-109f-4bdb-a50c-70a8e14f48d5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:34.552743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:34.553827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:15:34.554698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:34.558049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 367/714] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:34 2022] GET /identity/v3/services/network => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:34.559735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7509ab3-5e2a-4dde-883e-9a1cd56adf69 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:34.560225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7509ab3-5e2a-4dde-883e-9a1cd56adf69 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:34.560750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7509ab3-5e2a-4dde-883e-9a1cd56adf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:34.583916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e7509ab3-5e2a-4dde-883e-9a1cd56adf69 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:34.585099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e7509ab3-5e2a-4dde-883e-9a1cd56adf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:34.603551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:34.617024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:34.671085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 368/715] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:34.672541 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7509ab3-5e2a-4dde-883e-9a1cd56adf69 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:34.696522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74321a07-d99e-4169-ab23-3140f5801adf None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:34.761487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cba03e-efa7-4c9b-b9e4-aaf7be55cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:34.763061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cba03e-efa7-4c9b-b9e4-aaf7be55cb1a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:34.763772 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cba03e-efa7-4c9b-b9e4-aaf7be55cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:34.764457 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cba03e-efa7-4c9b-b9e4-aaf7be55cb1a None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:34.766651 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cba03e-efa7-4c9b-b9e4-aaf7be55cb1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:34.767990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cba03e-efa7-4c9b-b9e4-aaf7be55cb1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:34.772000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cba03e-efa7-4c9b-b9e4-aaf7be55cb1a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:34.795041 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 348/716] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:34.803845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cba03e-efa7-4c9b-b9e4-aaf7be55cb1a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:34.833612 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7509ab3-5e2a-4dde-883e-9a1cd56adf69 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:34.873656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e4551-2fc3-4748-ac82-5c3ef7f438a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:34.874421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e4551-2fc3-4748-ac82-5c3ef7f438a4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:34.875328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e4551-2fc3-4748-ac82-5c3ef7f438a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:34.875708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e4551-2fc3-4748-ac82-5c3ef7f438a4 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:34.876433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e4551-2fc3-4748-ac82-5c3ef7f438a4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:34.876850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e4551-2fc3-4748-ac82-5c3ef7f438a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:34.883195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e4551-2fc3-4748-ac82-5c3ef7f438a4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:34.883195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 369/717] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:15:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:34.890400 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e4551-2fc3-4748-ac82-5c3ef7f438a4 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:34.910207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:35.009730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e4551-2fc3-4748-ac82-5c3ef7f438a4 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:35.013884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cba03e-efa7-4c9b-b9e4-aaf7be55cb1a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:35.022314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:35.050122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb81515-c77a-42c9-8028-bd6c9c3dac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:35.050680 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb81515-c77a-42c9-8028-bd6c9c3dac78 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:35.050956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb81515-c77a-42c9-8028-bd6c9c3dac78 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:35.051227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb81515-c77a-42c9-8028-bd6c9c3dac78 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:35.051997 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb81515-c77a-42c9-8028-bd6c9c3dac78 None admin] RBAC: Adding query filter params (type=network) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:35.052253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb81515-c77a-42c9-8028-bd6c9c3dac78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:35.053609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb81515-c77a-42c9-8028-bd6c9c3dac78 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:35.059224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 370/718] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:15:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:35.102874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a70b59-cc72-422b-bae6-f0109f431444 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:35.103202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a70b59-cc72-422b-bae6-f0109f431444 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:35.103418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a70b59-cc72-422b-bae6-f0109f431444 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:35.105002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 371/719] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:15:35.107870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a70b59-cc72-422b-bae6-f0109f431444 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:35.114328 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048fffe-f2fb-4066-90ad-714e341c82ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:35.115008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048fffe-f2fb-4066-90ad-714e341c82ee None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:35.115349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048fffe-f2fb-4066-90ad-714e341c82ee None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:35.115680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048fffe-f2fb-4066-90ad-714e341c82ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:35.124621 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048fffe-f2fb-4066-90ad-714e341c82ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:35.127337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048fffe-f2fb-4066-90ad-714e341c82ee None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e048fffe-f2fb-4066-90ad-714e341c82ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:35.143868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:35.144873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:35.146347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:35.146347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:35.146347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:35.146347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:35.146347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:35.146347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:35.146347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:35.146347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:35.146347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 349/720] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:35.146996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6a6a2-b893-434f-9322-28d5ef1194d1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:35.147066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6a6a2-b893-434f-9322-28d5ef1194d1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:35.147290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6a6a2-b893-434f-9322-28d5ef1194d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:35.171898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-32b6a6a2-b893-434f-9322-28d5ef1194d1 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:35.173701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-32b6a6a2-b893-434f-9322-28d5ef1194d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:35.214441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:35.247110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a70b59-cc72-422b-bae6-f0109f431444 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:35.267217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 350/721] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:35.267934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6a6a2-b893-434f-9322-28d5ef1194d1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:35.298144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8f3f7-014b-405e-b520-b1699e51e4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:35.299025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8f3f7-014b-405e-b520-b1699e51e4fd None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:35.299483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8f3f7-014b-405e-b520-b1699e51e4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:35.299852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8f3f7-014b-405e-b520-b1699e51e4fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:35.317407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8f3f7-014b-405e-b520-b1699e51e4fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-60c8f3f7-014b-405e-b520-b1699e51e4fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:35.323172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:35.324347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:35.325245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 372/722] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:35.338756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8f3f7-014b-405e-b520-b1699e51e4fd None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:35.416868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:35.425611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6a6a2-b893-434f-9322-28d5ef1194d1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:35.461179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8f3f7-014b-405e-b520-b1699e51e4fd None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:35.498667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54478ef-a9c0-45ab-9cbc-3f64cbeaf016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:35.499287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54478ef-a9c0-45ab-9cbc-3f64cbeaf016 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:35.500598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54478ef-a9c0-45ab-9cbc-3f64cbeaf016 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:35.500870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54478ef-a9c0-45ab-9cbc-3f64cbeaf016 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:35.501684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54478ef-a9c0-45ab-9cbc-3f64cbeaf016 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:35.501988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54478ef-a9c0-45ab-9cbc-3f64cbeaf016 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:35.503554 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54478ef-a9c0-45ab-9cbc-3f64cbeaf016 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:35.506662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671f1b7-68b7-4ce1-b920-2c7f19550248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:35.507277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671f1b7-68b7-4ce1-b920-2c7f19550248 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:35.507548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671f1b7-68b7-4ce1-b920-2c7f19550248 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:35.507817 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671f1b7-68b7-4ce1-b920-2c7f19550248 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:35.508479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671f1b7-68b7-4ce1-b920-2c7f19550248 None admin] RBAC: Adding query filter params (name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:35.508775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671f1b7-68b7-4ce1-b920-2c7f19550248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:35.510194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671f1b7-68b7-4ce1-b920-2c7f19550248 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:35.524344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:35.525945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 351/723] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:35.530501 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 373/724] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:35.531996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54478ef-a9c0-45ab-9cbc-3f64cbeaf016 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:35.536449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671f1b7-68b7-4ce1-b920-2c7f19550248 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:35.652968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54478ef-a9c0-45ab-9cbc-3f64cbeaf016 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:35.694342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c613d-33fd-4b81-a140-8d15a1415710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:35.695660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c613d-33fd-4b81-a140-8d15a1415710 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:35.696092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c613d-33fd-4b81-a140-8d15a1415710 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:35.696884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c613d-33fd-4b81-a140-8d15a1415710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:35.697893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c613d-33fd-4b81-a140-8d15a1415710 None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=67b0698294e94845ae0dbdfb87059755) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:35.698498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c613d-33fd-4b81-a140-8d15a1415710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:35.700089 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c613d-33fd-4b81-a140-8d15a1415710 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:35.707300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 352/725] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:35 2022] GET /identity/v3/role_assignments?user.id=67b0698294e94845ae0dbdfb87059755&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=6413aac4240a46ba816472c29e305973 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:35.720644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c613d-33fd-4b81-a140-8d15a1415710 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:35.745166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:35.778279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671f1b7-68b7-4ce1-b920-2c7f19550248 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:35.871609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc8edc-1ab8-461b-8113-c74879250bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:35.872241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc8edc-1ab8-461b-8113-c74879250bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:35.872526 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc8edc-1ab8-461b-8113-c74879250bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:35.872798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc8edc-1ab8-461b-8113-c74879250bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:35.896022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc8edc-1ab8-461b-8113-c74879250bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:35.897504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc8edc-1ab8-461b-8113-c74879250bc4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:35.901650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c613d-33fd-4b81-a140-8d15a1415710 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-14cc8edc-1ab8-461b-8113-c74879250bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:35.926923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:35.927913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:35.928775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:35.928775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:35.928775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:35.932221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 374/726] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:35.934651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc8edc-1ab8-461b-8113-c74879250bc4 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:35.975101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f0904-a988-4e66-9fba-269fd7be9317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:35.976105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f0904-a988-4e66-9fba-269fd7be9317 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:35.976579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f0904-a988-4e66-9fba-269fd7be9317 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:35.977068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f0904-a988-4e66-9fba-269fd7be9317 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:35.997056 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f0904-a988-4e66-9fba-269fd7be9317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:35.999246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e17f0904-a988-4e66-9fba-269fd7be9317 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:36.004880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:36.005803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:36.007103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:36.007103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:36.007103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:36.007103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:36.007103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:36.007103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:36.007103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:36.007103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:36.007103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:36.007103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:36.007103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:36.007103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:36.009529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 353/727] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:36.016488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f0904-a988-4e66-9fba-269fd7be9317 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:36.108544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc8edc-1ab8-461b-8113-c74879250bc4 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:36.123743 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:36.148446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f0904-a988-4e66-9fba-269fd7be9317 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:36.185771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d687474-f446-408a-980a-33980bd666fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:36.186433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d687474-f446-408a-980a-33980bd666fc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:36.186782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d687474-f446-408a-980a-33980bd666fc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:36.187803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d687474-f446-408a-980a-33980bd666fc None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:36.188589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d687474-f446-408a-980a-33980bd666fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:36.188899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d687474-f446-408a-980a-33980bd666fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:36.190276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d687474-f446-408a-980a-33980bd666fc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:36.204928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 354/728] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:36.206185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d687474-f446-408a-980a-33980bd666fc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:36.247783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983c023-68a9-49dc-9546-55a6a2fd6b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:36.248450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983c023-68a9-49dc-9546-55a6a2fd6b0f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:36.248701 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983c023-68a9-49dc-9546-55a6a2fd6b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:36.248975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983c023-68a9-49dc-9546-55a6a2fd6b0f None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:36.249631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983c023-68a9-49dc-9546-55a6a2fd6b0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:36.250632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983c023-68a9-49dc-9546-55a6a2fd6b0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:36.252404 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983c023-68a9-49dc-9546-55a6a2fd6b0f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:36.293111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 375/729] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:36.311502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983c023-68a9-49dc-9546-55a6a2fd6b0f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:36.323492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d687474-f446-408a-980a-33980bd666fc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:36.362482 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585508d-b86d-4921-bfeb-3bd63f08ddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:36.363129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585508d-b86d-4921-bfeb-3bd63f08ddc6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:36.363409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585508d-b86d-4921-bfeb-3bd63f08ddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:36.363682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585508d-b86d-4921-bfeb-3bd63f08ddc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:36.377707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:36.382028 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585508d-b86d-4921-bfeb-3bd63f08ddc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:36.383572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585508d-b86d-4921-bfeb-3bd63f08ddc6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2585508d-b86d-4921-bfeb-3bd63f08ddc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:36.414943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:36.416224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:36.417088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:36.417088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:36.417088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:36.421193 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 355/730] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:36.422887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d79d1-7edf-47b7-8446-9443fb8874f8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:36.423171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d79d1-7edf-47b7-8446-9443fb8874f8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:36.423441 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d79d1-7edf-47b7-8446-9443fb8874f8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:36.425287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 356/731] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:36.425987 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d79d1-7edf-47b7-8446-9443fb8874f8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:36.486799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983c023-68a9-49dc-9546-55a6a2fd6b0f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:36.500913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:36.523622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cab24-5511-4715-b8da-d0adf5fadb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:36.524424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cab24-5511-4715-b8da-d0adf5fadb76 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:36.524928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cab24-5511-4715-b8da-d0adf5fadb76 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:36.525173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cab24-5511-4715-b8da-d0adf5fadb76 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:36.533441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cab24-5511-4715-b8da-d0adf5fadb76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:36.535081 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cab24-5511-4715-b8da-d0adf5fadb76 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:36.539385 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d79d1-7edf-47b7-8446-9443fb8874f8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-7d4cab24-5511-4715-b8da-d0adf5fadb76 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:36.548066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:36.549010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:36.549927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:36.549927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:36.549927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:36.549927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:36.549927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:36.549927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:36.549927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:36.549927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:36.549927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:15:36.549927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:36.549927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 376/732] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Sep 12 23:15:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:36.551072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e7c24-1f46-4796-88b9-107051867a4f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:36.554182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e7c24-1f46-4796-88b9-107051867a4f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:36.554182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e7c24-1f46-4796-88b9-107051867a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:36.570696 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-287e7c24-1f46-4796-88b9-107051867a4f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:36.572050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-287e7c24-1f46-4796-88b9-107051867a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:36.581794 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11669bc-997f-4eb9-979b-b0c0da3f706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:36.582434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11669bc-997f-4eb9-979b-b0c0da3f706c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:36.582717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11669bc-997f-4eb9-979b-b0c0da3f706c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:36.582988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11669bc-997f-4eb9-979b-b0c0da3f706c None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:36.583744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11669bc-997f-4eb9-979b-b0c0da3f706c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:36.584045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11669bc-997f-4eb9-979b-b0c0da3f706c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:36.585533 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11669bc-997f-4eb9-979b-b0c0da3f706c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:36.603408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 357/733] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:36.604401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11669bc-997f-4eb9-979b-b0c0da3f706c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:36.644459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 377/734] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:36.645313 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e7c24-1f46-4796-88b9-107051867a4f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:36.663082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:36.713553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11669bc-997f-4eb9-979b-b0c0da3f706c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:36.750674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928bd12-3b27-4a94-973d-4ac637742704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:36.751611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928bd12-3b27-4a94-973d-4ac637742704 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:36.752052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928bd12-3b27-4a94-973d-4ac637742704 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:36.752527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928bd12-3b27-4a94-973d-4ac637742704 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:36.753500 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928bd12-3b27-4a94-973d-4ac637742704 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:36.753949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928bd12-3b27-4a94-973d-4ac637742704 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:36.762400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928bd12-3b27-4a94-973d-4ac637742704 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:36.788041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e7c24-1f46-4796-88b9-107051867a4f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:36.798703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 358/735] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Sep 12 23:15:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:36.799262 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:36.807505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928bd12-3b27-4a94-973d-4ac637742704 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:36.827568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae485e-2e52-4e1d-b00e-049f2f93b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:36.828789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae485e-2e52-4e1d-b00e-049f2f93b44a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:36.829078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae485e-2e52-4e1d-b00e-049f2f93b44a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:36.829356 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae485e-2e52-4e1d-b00e-049f2f93b44a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:36.837054 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae485e-2e52-4e1d-b00e-049f2f93b44a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:36.838570 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae485e-2e52-4e1d-b00e-049f2f93b44a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-06ae485e-2e52-4e1d-b00e-049f2f93b44a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:36.851340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:36.852483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:36.853862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:36.853862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:36.853862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:36.853862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:36.853862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:36.853862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:36.853862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:36.853862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:36.853862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:15:36.853862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:36.853862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 378/736] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:36.861197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae485e-2e52-4e1d-b00e-049f2f93b44a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:37.021874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae485e-2e52-4e1d-b00e-049f2f93b44a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:37.060605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928bd12-3b27-4a94-973d-4ac637742704 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:37.060957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a501aeb-83cc-4ecd-b4bd-63396a4d7a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:37.061729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a501aeb-83cc-4ecd-b4bd-63396a4d7a70 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:37.062154 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a501aeb-83cc-4ecd-b4bd-63396a4d7a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:37.063288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a501aeb-83cc-4ecd-b4bd-63396a4d7a70 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:37.064334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a501aeb-83cc-4ecd-b4bd-63396a4d7a70 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:37.064801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a501aeb-83cc-4ecd-b4bd-63396a4d7a70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:37.066410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a501aeb-83cc-4ecd-b4bd-63396a4d7a70 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:37.078755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:37.087021 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 379/737] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Sep 12 23:15:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:37.088198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a501aeb-83cc-4ecd-b4bd-63396a4d7a70 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:37.102488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65d1fb-1605-48f0-98e1-a533f56936aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:37.103162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65d1fb-1605-48f0-98e1-a533f56936aa None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:37.103377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65d1fb-1605-48f0-98e1-a533f56936aa None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:37.103652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65d1fb-1605-48f0-98e1-a533f56936aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:37.113679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:37.175037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65d1fb-1605-48f0-98e1-a533f56936aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:37.176510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65d1fb-1605-48f0-98e1-a533f56936aa None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:37.211677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a501aeb-83cc-4ecd-b4bd-63396a4d7a70 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:37.261985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4667a2-9ef8-4ff3-a75e-526810d574b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:37.263350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4667a2-9ef8-4ff3-a75e-526810d574b9 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:37.263860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4667a2-9ef8-4ff3-a75e-526810d574b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:37.264875 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4667a2-9ef8-4ff3-a75e-526810d574b9 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:37.266150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4667a2-9ef8-4ff3-a75e-526810d574b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:37.268603 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4667a2-9ef8-4ff3-a75e-526810d574b9 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:37.296083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 359/738] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:37.296083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65d1fb-1605-48f0-98e1-a533f56936aa None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:37.300343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 380/739] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:15:37 2022] POST /identity/v3/services => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:15:37.300343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4667a2-9ef8-4ff3-a75e-526810d574b9 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:37.317325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:37.449746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:37.485765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65d1fb-1605-48f0-98e1-a533f56936aa None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:37.492628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4667a2-9ef8-4ff3-a75e-526810d574b9 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:37.535777 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eab5c0-b15b-422c-9c46-a4ccf724643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:37.536881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eab5c0-b15b-422c-9c46-a4ccf724643d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:37.537718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eab5c0-b15b-422c-9c46-a4ccf724643d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:37.538570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eab5c0-b15b-422c-9c46-a4ccf724643d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:37.541593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a63645-dee6-47c1-8c9c-6e3b7b13ed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:37.542337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a63645-dee6-47c1-8c9c-6e3b7b13ed60 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:37.542741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a63645-dee6-47c1-8c9c-6e3b7b13ed60 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:37.543108 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a63645-dee6-47c1-8c9c-6e3b7b13ed60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:37.555751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a63645-dee6-47c1-8c9c-6e3b7b13ed60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:37.557547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a63645-dee6-47c1-8c9c-6e3b7b13ed60 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-70a63645-dee6-47c1-8c9c-6e3b7b13ed60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:37.573642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:37.574937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:37.576056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:37.576056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:37.576056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:37.576887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 381/740] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:37.578866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb23401-f6ca-41ea-859c-b7741d5adce3 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:37.579210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb23401-f6ca-41ea-859c-b7741d5adce3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:37.579545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb23401-f6ca-41ea-859c-b7741d5adce3 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:37.581128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 382/741] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:37.584748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb23401-f6ca-41ea-859c-b7741d5adce3 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:37.619495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eab5c0-b15b-422c-9c46-a4ccf724643d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:37.621145 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eab5c0-b15b-422c-9c46-a4ccf724643d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:37.634152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:37.695064 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb23401-f6ca-41ea-859c-b7741d5adce3 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:37.725448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:37.734913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae99050-ce7b-4e5c-86dd-0f059b87c37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:37.735587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae99050-ce7b-4e5c-86dd-0f059b87c37a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:37.736037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae99050-ce7b-4e5c-86dd-0f059b87c37a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:37.736248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 360/742] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:37 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:15:37.736352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae99050-ce7b-4e5c-86dd-0f059b87c37a None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:37.737051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae99050-ce7b-4e5c-86dd-0f059b87c37a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:37.737361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae99050-ce7b-4e5c-86dd-0f059b87c37a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:37.738355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c42257-b223-4b2a-a15f-293b20158efc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:37.738799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae99050-ce7b-4e5c-86dd-0f059b87c37a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:37.739076 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c42257-b223-4b2a-a15f-293b20158efc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:37.739552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c42257-b223-4b2a-a15f-293b20158efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:37.757333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 383/743] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:37.757333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae99050-ce7b-4e5c-86dd-0f059b87c37a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:37.764245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a3c42257-b223-4b2a-a15f-293b20158efc None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:37.765901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a3c42257-b223-4b2a-a15f-293b20158efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:37.862609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 361/744] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:37.863930 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c42257-b223-4b2a-a15f-293b20158efc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:37.872537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae99050-ce7b-4e5c-86dd-0f059b87c37a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:37.928623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1640dd-c8ae-4b81-97e2-fcf226a71165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:37.929410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1640dd-c8ae-4b81-97e2-fcf226a71165 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:37.929693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1640dd-c8ae-4b81-97e2-fcf226a71165 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:37.929977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1640dd-c8ae-4b81-97e2-fcf226a71165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:37.941704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1640dd-c8ae-4b81-97e2-fcf226a71165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:37.944090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1640dd-c8ae-4b81-97e2-fcf226a71165 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:37.955382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-8f1640dd-c8ae-4b81-97e2-fcf226a71165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:37.961319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:37.962233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:37.963181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:37.963181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:37.963181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:37.967912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 384/745] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:37.974130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1640dd-c8ae-4b81-97e2-fcf226a71165 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:38.058765 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:38.090099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c42257-b223-4b2a-a15f-293b20158efc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:38.131512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1640dd-c8ae-4b81-97e2-fcf226a71165 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:38.147125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad419eca-0fbe-419a-b6d5-91b8caab710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:38.147787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad419eca-0fbe-419a-b6d5-91b8caab710f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:38.148068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad419eca-0fbe-419a-b6d5-91b8caab710f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:38.148335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad419eca-0fbe-419a-b6d5-91b8caab710f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:38.156621 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad419eca-0fbe-419a-b6d5-91b8caab710f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:38.158299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad419eca-0fbe-419a-b6d5-91b8caab710f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:38.168533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0861cf3-e827-487c-9f7c-006edb28871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:38.169150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0861cf3-e827-487c-9f7c-006edb28871f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:38.169435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0861cf3-e827-487c-9f7c-006edb28871f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:38.169713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0861cf3-e827-487c-9f7c-006edb28871f None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ad419eca-0fbe-419a-b6d5-91b8caab710f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:38.170019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:38.170900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:38.171926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:38.171926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:38.171926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:38.171926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:38.171926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:38.171926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:38.171926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:38.171926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:38.172705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0861cf3-e827-487c-9f7c-006edb28871f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:38.172705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0861cf3-e827-487c-9f7c-006edb28871f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:38.172705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0861cf3-e827-487c-9f7c-006edb28871f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:38.174549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 362/746] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:38.175828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52126f-5a85-4d1a-bce0-95de63972b99 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:38.176114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52126f-5a85-4d1a-bce0-95de63972b99 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:38.176390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52126f-5a85-4d1a-bce0-95de63972b99 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:38.179928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 363/747] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:38.180658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52126f-5a85-4d1a-bce0-95de63972b99 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:38.184858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 385/748] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:38.186115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77c24a-db6f-48fb-9105-c8673afaaf95 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:38.186424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77c24a-db6f-48fb-9105-c8673afaaf95 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:38.186720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77c24a-db6f-48fb-9105-c8673afaaf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:38.206537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-dd77c24a-db6f-48fb-9105-c8673afaaf95 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:38.208261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-dd77c24a-db6f-48fb-9105-c8673afaaf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:38.279504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 386/749] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:15:38.280599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77c24a-db6f-48fb-9105-c8673afaaf95 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:38.300447 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:38.309184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52126f-5a85-4d1a-bce0-95de63972b99 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:38.321584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:38.348017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7aeb7-94dc-42a7-8ab9-5758701dcf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:38.348627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7aeb7-94dc-42a7-8ab9-5758701dcf1f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:38.349003 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7aeb7-94dc-42a7-8ab9-5758701dcf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:38.349275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7aeb7-94dc-42a7-8ab9-5758701dcf1f None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:38.349958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7aeb7-94dc-42a7-8ab9-5758701dcf1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:38.350449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7aeb7-94dc-42a7-8ab9-5758701dcf1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:38.351918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7aeb7-94dc-42a7-8ab9-5758701dcf1f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:38.366744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 364/750] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:38.367676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7aeb7-94dc-42a7-8ab9-5758701dcf1f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:38.417271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77c24a-db6f-48fb-9105-c8673afaaf95 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:38.462786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff2d91-0584-491e-9bac-5711d6a3432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:38.463654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff2d91-0584-491e-9bac-5711d6a3432e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:38.464592 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff2d91-0584-491e-9bac-5711d6a3432e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:38.465058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff2d91-0584-491e-9bac-5711d6a3432e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:38.474804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff2d91-0584-491e-9bac-5711d6a3432e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:38.476243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff2d91-0584-491e-9bac-5711d6a3432e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-daff2d91-0584-491e-9bac-5711d6a3432e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:38.488662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:38.489764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:38.490806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:38.490806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:38.490806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:38.490806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:38.490806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:38.490806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:38.490806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:38.490806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:38.494543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 387/751] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:38.495358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff2d91-0584-491e-9bac-5711d6a3432e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:38.502438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7aeb7-94dc-42a7-8ab9-5758701dcf1f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:38.545895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cbafa-46e7-4bf7-9ea6-ea49792b7057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:38.547409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbafa-46e7-4bf7-9ea6-ea49792b7057 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:38.547969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbafa-46e7-4bf7-9ea6-ea49792b7057 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:38.548439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbafa-46e7-4bf7-9ea6-ea49792b7057 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:38.549360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cbafa-46e7-4bf7-9ea6-ea49792b7057 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:38.550990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cbafa-46e7-4bf7-9ea6-ea49792b7057 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:38.571191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 365/752] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:15:38 2022] POST /identity/v3/services => generated 240 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:15:38.573325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cbafa-46e7-4bf7-9ea6-ea49792b7057 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:38.597587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:38.607151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:38.612862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff2d91-0584-491e-9bac-5711d6a3432e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:38.660658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94f6d8-e491-4ee2-9b65-c56a4010ccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:38.661215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94f6d8-e491-4ee2-9b65-c56a4010ccfb None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:38.661727 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94f6d8-e491-4ee2-9b65-c56a4010ccfb None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:38.661846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94f6d8-e491-4ee2-9b65-c56a4010ccfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:38.662572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94f6d8-e491-4ee2-9b65-c56a4010ccfb None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=f66201e006624a69811e7c613702125e) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:38.662907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94f6d8-e491-4ee2-9b65-c56a4010ccfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:38.664374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94f6d8-e491-4ee2-9b65-c56a4010ccfb None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:38.671668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 388/753] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:38 2022] GET /identity/v3/role_assignments?user.id=f66201e006624a69811e7c613702125e&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:38.673016 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94f6d8-e491-4ee2-9b65-c56a4010ccfb None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:38.736336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cbafa-46e7-4bf7-9ea6-ea49792b7057 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:38.814259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886729a-3cdb-4f15-9cf7-7dc417b564b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:38.815309 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886729a-3cdb-4f15-9cf7-7dc417b564b3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:38.815744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886729a-3cdb-4f15-9cf7-7dc417b564b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:38.816169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886729a-3cdb-4f15-9cf7-7dc417b564b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:38.817196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886729a-3cdb-4f15-9cf7-7dc417b564b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:38.817658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886729a-3cdb-4f15-9cf7-7dc417b564b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:38.819708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886729a-3cdb-4f15-9cf7-7dc417b564b3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:38.838916 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 366/754] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:38.845239 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886729a-3cdb-4f15-9cf7-7dc417b564b3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:38.847111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94f6d8-e491-4ee2-9b65-c56a4010ccfb None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:38.901112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101cad5-9692-4227-b47d-4ec845276b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:38.901971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101cad5-9692-4227-b47d-4ec845276b91 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:38.902349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101cad5-9692-4227-b47d-4ec845276b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:38.902856 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101cad5-9692-4227-b47d-4ec845276b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:38.915000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101cad5-9692-4227-b47d-4ec845276b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-3101cad5-9692-4227-b47d-4ec845276b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:38.920686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:38.922333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:38.923361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:38.923361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:38.923361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:38.923361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:38.923361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:38.923361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:38.923361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:38.923361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:38.923361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:38.923361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:38.923361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:38.923361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:38.928653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 389/755] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:38.931514 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101cad5-9692-4227-b47d-4ec845276b91 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:38.946439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:38.954413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:38.978845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886729a-3cdb-4f15-9cf7-7dc417b564b3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:39.033767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2a2f1-7716-4878-b9bd-2b366f6f7f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:39.034474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2a2f1-7716-4878-b9bd-2b366f6f7f1e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:39.034760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2a2f1-7716-4878-b9bd-2b366f6f7f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:39.035034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2a2f1-7716-4878-b9bd-2b366f6f7f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:39.035770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2a2f1-7716-4878-b9bd-2b366f6f7f1e None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=53214ffdc5d04c14b3b3ac868862480b) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:39.036082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2a2f1-7716-4878-b9bd-2b366f6f7f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:39.037529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2a2f1-7716-4878-b9bd-2b366f6f7f1e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:39.056634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 367/756] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:38 2022] GET /identity/v3/role_assignments?user.id=53214ffdc5d04c14b3b3ac868862480b&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=6413aac4240a46ba816472c29e305973 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:39.069660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101cad5-9692-4227-b47d-4ec845276b91 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:39.113903 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a9342-df37-4835-8f89-ed1025c2e3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:39.114566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a9342-df37-4835-8f89-ed1025c2e3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:39.114873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a9342-df37-4835-8f89-ed1025c2e3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:39.115145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a9342-df37-4835-8f89-ed1025c2e3f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:39.115806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a9342-df37-4835-8f89-ed1025c2e3f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:39.116112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a9342-df37-4835-8f89-ed1025c2e3f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:39.117507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a9342-df37-4835-8f89-ed1025c2e3f1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:39.127853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 390/757] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:39.133564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2a2f1-7716-4878-b9bd-2b366f6f7f1e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:39.294157 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2a2f1-7716-4878-b9bd-2b366f6f7f1e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:39.334657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09758abe-38ef-467b-90a1-f5251b50f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:39.335299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09758abe-38ef-467b-90a1-f5251b50f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:39.335575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09758abe-38ef-467b-90a1-f5251b50f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:39.335843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09758abe-38ef-467b-90a1-f5251b50f1a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:39.356345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09758abe-38ef-467b-90a1-f5251b50f1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:39.357886 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09758abe-38ef-467b-90a1-f5251b50f1a3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:39.367482 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-09758abe-38ef-467b-90a1-f5251b50f1a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:39.380281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:39.381294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:39.382491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:39.382491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:39.382491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:39.382491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 368/758] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:39.389596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a9342-df37-4835-8f89-ed1025c2e3f1 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:39.499511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:39.536877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a9342-df37-4835-8f89-ed1025c2e3f1 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:39.599221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87216e88-779d-4828-98ab-18371f8a4533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:39.599772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87216e88-779d-4828-98ab-18371f8a4533 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:39.600058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87216e88-779d-4828-98ab-18371f8a4533 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:39.600332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87216e88-779d-4828-98ab-18371f8a4533 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:39.600996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87216e88-779d-4828-98ab-18371f8a4533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:39.601304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87216e88-779d-4828-98ab-18371f8a4533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:39.602708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87216e88-779d-4828-98ab-18371f8a4533 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:39.620879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 391/759] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:39.626637 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09758abe-38ef-467b-90a1-f5251b50f1a3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:39.754859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09758abe-38ef-467b-90a1-f5251b50f1a3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:39.791476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444b536-e5c4-4331-bb59-e400270fc3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:39.792111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444b536-e5c4-4331-bb59-e400270fc3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:39.792390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444b536-e5c4-4331-bb59-e400270fc3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:39.792659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444b536-e5c4-4331-bb59-e400270fc3c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:39.801881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444b536-e5c4-4331-bb59-e400270fc3c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:39.803398 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444b536-e5c4-4331-bb59-e400270fc3c8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:39.808942 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a7698-2140-4761-94d1-a2df48426c38 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:39.809229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a7698-2140-4761-94d1-a2df48426c38 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:39.809508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a7698-2140-4761-94d1-a2df48426c38 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:39.811310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 392/760] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c444b536-e5c4-4331-bb59-e400270fc3c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:39.815376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:39.816287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:39.817712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:39.817712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:39.817712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:39.817712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:39.817712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:39.817712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:39.817712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:39.817712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:39.817712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:15:39.817712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:39.817712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 369/761] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Sep 12 23:15:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:39.819831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320bc8f-243b-4ed4-afcd-a845fa1c326c None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:39.820242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320bc8f-243b-4ed4-afcd-a845fa1c326c None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:39.820657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320bc8f-243b-4ed4-afcd-a845fa1c326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:39.833451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444b536-e5c4-4331-bb59-e400270fc3c8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:39.845700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f320bc8f-243b-4ed4-afcd-a845fa1c326c None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:39.847329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f320bc8f-243b-4ed4-afcd-a845fa1c326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:39.908902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:39.964330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444b536-e5c4-4331-bb59-e400270fc3c8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:39.986482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 393/762] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:40.009236 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913befc-5ea5-49c1-a5ea-1837fb8707aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:40.010114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913befc-5ea5-49c1-a5ea-1837fb8707aa None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:40.010632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913befc-5ea5-49c1-a5ea-1837fb8707aa None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:40.011136 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913befc-5ea5-49c1-a5ea-1837fb8707aa None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:40.012052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913befc-5ea5-49c1-a5ea-1837fb8707aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:40.012571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913befc-5ea5-49c1-a5ea-1837fb8707aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:40.014201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913befc-5ea5-49c1-a5ea-1837fb8707aa None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:40.036857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 370/763] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Sep 12 23:15:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:40.043229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320bc8f-243b-4ed4-afcd-a845fa1c326c None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:40.143468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:40.191444 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320bc8f-243b-4ed4-afcd-a845fa1c326c None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:40.231300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88aabc1-9f1e-4091-abba-87e1cf05ee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:40.231936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88aabc1-9f1e-4091-abba-87e1cf05ee63 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:40.232214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88aabc1-9f1e-4091-abba-87e1cf05ee63 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:40.232486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88aabc1-9f1e-4091-abba-87e1cf05ee63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:40.243116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88aabc1-9f1e-4091-abba-87e1cf05ee63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:40.244579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88aabc1-9f1e-4091-abba-87e1cf05ee63 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-e88aabc1-9f1e-4091-abba-87e1cf05ee63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:40.261107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:40.262068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:40.263397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:40.263397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:40.263397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:40.263397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 394/764] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:40.269462 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913befc-5ea5-49c1-a5ea-1837fb8707aa None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:40.297264 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88aabc1-9f1e-4091-abba-87e1cf05ee63 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:40.486703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913befc-5ea5-49c1-a5ea-1837fb8707aa None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:40.514654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:40.560738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfacb1-bcdf-4014-bdeb-4e53d313b920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:40.561755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfacb1-bcdf-4014-bdeb-4e53d313b920 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:40.562298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfacb1-bcdf-4014-bdeb-4e53d313b920 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:40.562823 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfacb1-bcdf-4014-bdeb-4e53d313b920 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:40.563696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfacb1-bcdf-4014-bdeb-4e53d313b920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:40.565341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfacb1-bcdf-4014-bdeb-4e53d313b920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:40.567977 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfacb1-bcdf-4014-bdeb-4e53d313b920 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:40.578573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88aabc1-9f1e-4091-abba-87e1cf05ee63 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:40.594948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 371/765] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:40.600598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfacb1-bcdf-4014-bdeb-4e53d313b920 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:40.605887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:40.655147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f7830-7ad5-44cf-9da0-c2f92dd4f7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:40.656715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f7830-7ad5-44cf-9da0-c2f92dd4f7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:40.657619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f7830-7ad5-44cf-9da0-c2f92dd4f7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:40.658310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f7830-7ad5-44cf-9da0-c2f92dd4f7f7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:40.659135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f7830-7ad5-44cf-9da0-c2f92dd4f7f7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:40.660722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f7830-7ad5-44cf-9da0-c2f92dd4f7f7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-442f7830-7ad5-44cf-9da0-c2f92dd4f7f7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:40.671338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:40.672372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:15:40.673284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:40.676030 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 395/766] 10.222.0.33 () {56 vars in 1129 bytes} [Mon Sep 12 23:15:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:40.683417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f7830-7ad5-44cf-9da0-c2f92dd4f7f7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:40.827828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f7830-7ad5-44cf-9da0-c2f92dd4f7f7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:40.831229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfacb1-bcdf-4014-bdeb-4e53d313b920 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:40.869673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f30836-0cc7-4d9b-84a8-f82b50e9cf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:40.870313 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30836-0cc7-4d9b-84a8-f82b50e9cf89 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:40.870622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30836-0cc7-4d9b-84a8-f82b50e9cf89 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:40.870894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30836-0cc7-4d9b-84a8-f82b50e9cf89 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:40.871531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f30836-0cc7-4d9b-84a8-f82b50e9cf89 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:40.871831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f30836-0cc7-4d9b-84a8-f82b50e9cf89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:40.873700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f30836-0cc7-4d9b-84a8-f82b50e9cf89 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:40.879850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 396/767] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Sep 12 23:15:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:40.885720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f30836-0cc7-4d9b-84a8-f82b50e9cf89 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:40.916025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ead64-322f-4a27-a14e-0cb93a6b4791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:40.917053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ead64-322f-4a27-a14e-0cb93a6b4791 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:40.917638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ead64-322f-4a27-a14e-0cb93a6b4791 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:40.918107 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ead64-322f-4a27-a14e-0cb93a6b4791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:40.935378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:40.936913 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ead64-322f-4a27-a14e-0cb93a6b4791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:40.939444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ead64-322f-4a27-a14e-0cb93a6b4791 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b41ead64-322f-4a27-a14e-0cb93a6b4791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:40.967947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:40.969730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:40.970642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:40.970642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:40.970642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:40.970642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:40.970642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:40.970642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:40.970642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:40.970642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:40.977504 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 372/768] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:40.983677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ead64-322f-4a27-a14e-0cb93a6b4791 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:40.997406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f30836-0cc7-4d9b-84a8-f82b50e9cf89 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:41.037200 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c536a6-6a6c-4d6d-bdc3-2bee9caa08e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:41.038161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c536a6-6a6c-4d6d-bdc3-2bee9caa08e6 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:41.038839 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c536a6-6a6c-4d6d-bdc3-2bee9caa08e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:41.039347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c536a6-6a6c-4d6d-bdc3-2bee9caa08e6 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:41.040145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c536a6-6a6c-4d6d-bdc3-2bee9caa08e6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:41.040630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c536a6-6a6c-4d6d-bdc3-2bee9caa08e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:41.042421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c536a6-6a6c-4d6d-bdc3-2bee9caa08e6 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:41.048868 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 397/769] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Sep 12 23:15:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:41.059553 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c536a6-6a6c-4d6d-bdc3-2bee9caa08e6 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:41.070771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:41.194349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ead64-322f-4a27-a14e-0cb93a6b4791 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:41.253001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a3543-38ce-4af3-b5cf-63e644f9994b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:41.253628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3543-38ce-4af3-b5cf-63e644f9994b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:41.253911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3543-38ce-4af3-b5cf-63e644f9994b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:41.254354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3543-38ce-4af3-b5cf-63e644f9994b None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:41.255400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a3543-38ce-4af3-b5cf-63e644f9994b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:41.255713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a3543-38ce-4af3-b5cf-63e644f9994b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:41.257451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a3543-38ce-4af3-b5cf-63e644f9994b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:41.270276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c536a6-6a6c-4d6d-bdc3-2bee9caa08e6 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:41.271837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 373/770] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:41.277409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a3543-38ce-4af3-b5cf-63e644f9994b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:41.292145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:41.337436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b55e7d-0142-443b-94f0-cbd16c797b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:41.338052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b55e7d-0142-443b-94f0-cbd16c797b34 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:41.338333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b55e7d-0142-443b-94f0-cbd16c797b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:41.338635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b55e7d-0142-443b-94f0-cbd16c797b34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:41.339338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b55e7d-0142-443b-94f0-cbd16c797b34 None admin] RBAC: Adding query filter params (interface=public, service_id=53015be2af2f4e52b5dffb4146c70562, region_id=RegionOne) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:41.339769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b55e7d-0142-443b-94f0-cbd16c797b34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:41.341028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b55e7d-0142-443b-94f0-cbd16c797b34 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:41.349573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 398/771] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Sep 12 23:15:41 2022] GET /identity/v3/endpoints?service_id=53015be2af2f4e52b5dffb4146c70562&interface=public®ion_id=RegionOne => generated 194 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:41.354983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0653-68e6-4f35-bd37-953f7fe80e06 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:41.355292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0653-68e6-4f35-bd37-953f7fe80e06 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:41.355573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0653-68e6-4f35-bd37-953f7fe80e06 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:41.361783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 399/772] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:41.361783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b0653-68e6-4f35-bd37-953f7fe80e06 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:41.435042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:41.443816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a3543-38ce-4af3-b5cf-63e644f9994b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:41.484211 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b0653-68e6-4f35-bd37-953f7fe80e06 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:41.487293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773255af-2c67-4a38-9a4b-0a7235f4c5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:41.487959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773255af-2c67-4a38-9a4b-0a7235f4c5b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:41.488234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773255af-2c67-4a38-9a4b-0a7235f4c5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:41.488504 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773255af-2c67-4a38-9a4b-0a7235f4c5b0 None admin] PATH_INFO: `/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/67b0698294e94845ae0dbdfb87059755/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:41.490450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773255af-2c67-4a38-9a4b-0a7235f4c5b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd655924cf9a4736ba38740ade63ec52, user_id=67b0698294e94845ae0dbdfb87059755, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:41.491893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773255af-2c67-4a38-9a4b-0a7235f4c5b0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:41.513951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 374/773] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:15:41 2022] PUT /identity/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/67b0698294e94845ae0dbdfb87059755/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:15:41.513951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af6a86-6c15-4e03-9327-1e072fece39c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:41.513951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af6a86-6c15-4e03-9327-1e072fece39c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:41.513951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af6a86-6c15-4e03-9327-1e072fece39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:41.529755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e2af6a86-6c15-4e03-9327-1e072fece39c None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:41.531252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e2af6a86-6c15-4e03-9327-1e072fece39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:41.532833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f104dcd-aca7-40ce-a950-150e1be1c46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:41.533547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f104dcd-aca7-40ce-a950-150e1be1c46d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:41.534044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f104dcd-aca7-40ce-a950-150e1be1c46d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:41.534516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f104dcd-aca7-40ce-a950-150e1be1c46d None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:41.535360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f104dcd-aca7-40ce-a950-150e1be1c46d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:41.536836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f104dcd-aca7-40ce-a950-150e1be1c46d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:41.550875 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 400/774] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Sep 12 23:15:41 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:41.552686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6a744-ef34-451d-841e-62e45596eb09 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:41.553041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6a744-ef34-451d-841e-62e45596eb09 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:41.553385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6a744-ef34-451d-841e-62e45596eb09 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:41.555114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 401/775] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:41.563223 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f64b-c228-42e8-9976-05f00ad2b48d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:41.563632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f64b-c228-42e8-9976-05f00ad2b48d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:41.564044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f64b-c228-42e8-9976-05f00ad2b48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:41.608208 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-7f51f64b-c228-42e8-9976-05f00ad2b48d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:41.612350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7f51f64b-c228-42e8-9976-05f00ad2b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:41.647242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 375/776] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:41.662843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:41.712828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 402/777] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:15:41.916607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c66180-30fa-4255-a0b8-d297c6b79a20 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:41.917093 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c66180-30fa-4255-a0b8-d297c6b79a20 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:41.917093 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c66180-30fa-4255-a0b8-d297c6b79a20 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:41.918835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 376/778] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:41.925115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dda672-a3d8-4bfd-98d1-01b48421a9f7 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:41.925500 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dda672-a3d8-4bfd-98d1-01b48421a9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:41.925841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dda672-a3d8-4bfd-98d1-01b48421a9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:41.944405 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-83dda672-a3d8-4bfd-98d1-01b48421a9f7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:41.945572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-83dda672-a3d8-4bfd-98d1-01b48421a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:41.954555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c66180-30fa-4255-a0b8-d297c6b79a20 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:42.017377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 403/779] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:42.022582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dda672-a3d8-4bfd-98d1-01b48421a9f7 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:42.076993 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:42.108590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c66180-30fa-4255-a0b8-d297c6b79a20 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:42.164183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78508921-3a2a-4e3c-bb7e-970e29effb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:42.165210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78508921-3a2a-4e3c-bb7e-970e29effb9f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:42.165695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78508921-3a2a-4e3c-bb7e-970e29effb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:42.166462 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78508921-3a2a-4e3c-bb7e-970e29effb9f None admin] PATH_INFO: `/v3/services/network` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:42.167331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78508921-3a2a-4e3c-bb7e-970e29effb9f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:42.168964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78508921-3a2a-4e3c-bb7e-970e29effb9f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:42.178316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-78508921-3a2a-4e3c-bb7e-970e29effb9f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:42.178780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:42.179708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:15:42.180519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:42.183239 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 377/780] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:41 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:42.191392 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dda672-a3d8-4bfd-98d1-01b48421a9f7 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:42.202660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78508921-3a2a-4e3c-bb7e-970e29effb9f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:42.230366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8dd32-2c9b-4a4d-9070-c79b33edf3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:42.238512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8dd32-2c9b-4a4d-9070-c79b33edf3ac None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:42.238512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8dd32-2c9b-4a4d-9070-c79b33edf3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:42.238512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8dd32-2c9b-4a4d-9070-c79b33edf3ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:42.243034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8dd32-2c9b-4a4d-9070-c79b33edf3ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-05e8dd32-2c9b-4a4d-9070-c79b33edf3ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:42.248284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:42.249418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:42.254957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 404/781] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:42.259483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8dd32-2c9b-4a4d-9070-c79b33edf3ac None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:42.346354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78508921-3a2a-4e3c-bb7e-970e29effb9f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:42.392307 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46946d-21b5-410a-84af-048cc25907e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:42.393183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46946d-21b5-410a-84af-048cc25907e2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:42.393642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46946d-21b5-410a-84af-048cc25907e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:42.394093 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46946d-21b5-410a-84af-048cc25907e2 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:42.394941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46946d-21b5-410a-84af-048cc25907e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:42.395450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46946d-21b5-410a-84af-048cc25907e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:42.397013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46946d-21b5-410a-84af-048cc25907e2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:42.402350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 378/782] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:15:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:42.403421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46946d-21b5-410a-84af-048cc25907e2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:42.409912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8dd32-2c9b-4a4d-9070-c79b33edf3ac None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:42.420319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:42.447444 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930cc1d-6907-40cb-9af8-ae19a4b28621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:42.448260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930cc1d-6907-40cb-9af8-ae19a4b28621 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:42.448493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930cc1d-6907-40cb-9af8-ae19a4b28621 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:42.448955 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930cc1d-6907-40cb-9af8-ae19a4b28621 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:42.449740 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930cc1d-6907-40cb-9af8-ae19a4b28621 None admin] RBAC: Adding query filter params (name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:42.450126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930cc1d-6907-40cb-9af8-ae19a4b28621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:42.451586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930cc1d-6907-40cb-9af8-ae19a4b28621 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:42.465543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 405/783] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:42.465543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930cc1d-6907-40cb-9af8-ae19a4b28621 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:42.483667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:42.534870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46946d-21b5-410a-84af-048cc25907e2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:42.572802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930cc1d-6907-40cb-9af8-ae19a4b28621 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:42.581103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db8ac6-018a-43eb-868e-a40246c1b335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:42.582018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db8ac6-018a-43eb-868e-a40246c1b335 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:42.582555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db8ac6-018a-43eb-868e-a40246c1b335 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:42.583503 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db8ac6-018a-43eb-868e-a40246c1b335 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:42.597842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db8ac6-018a-43eb-868e-a40246c1b335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-78db8ac6-018a-43eb-868e-a40246c1b335 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:42.605292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:42.606209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:42.607095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:42.607095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:42.607095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:42.607095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:42.607095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:42.607095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:42.607095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:42.607095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:42.607095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:42.607095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:42.607095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:42.607095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:42.608198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1662dd-5b8b-4219-be2d-d8b941f2c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:42.608536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1662dd-5b8b-4219-be2d-d8b941f2c038 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:42.608810 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1662dd-5b8b-4219-be2d-d8b941f2c038 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:42.609742 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1662dd-5b8b-4219-be2d-d8b941f2c038 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:42.610371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1662dd-5b8b-4219-be2d-d8b941f2c038 None admin] RBAC: Adding query filter params (type=network) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:42.610696 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1662dd-5b8b-4219-be2d-d8b941f2c038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:42.611622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 379/784] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:42.612056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1662dd-5b8b-4219-be2d-d8b941f2c038 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:42.612887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db8ac6-018a-43eb-868e-a40246c1b335 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:42.622394 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 406/785] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:15:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:42.623549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1662dd-5b8b-4219-be2d-d8b941f2c038 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:42.694771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:42.715611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:42.731554 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db8ac6-018a-43eb-868e-a40246c1b335 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:42.738495 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1662dd-5b8b-4219-be2d-d8b941f2c038 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:42.768460 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3574-7b05-4bfe-aff7-40e5e839deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:42.769455 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3574-7b05-4bfe-aff7-40e5e839deaa None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:42.769971 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3574-7b05-4bfe-aff7-40e5e839deaa None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:42.770484 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3574-7b05-4bfe-aff7-40e5e839deaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:42.773799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c6e56-b621-4ea9-b1de-11e1ef0d239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:42.774188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c6e56-b621-4ea9-b1de-11e1ef0d239c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:42.774501 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c6e56-b621-4ea9-b1de-11e1ef0d239c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:42.774770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c6e56-b621-4ea9-b1de-11e1ef0d239c None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:42.775422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c6e56-b621-4ea9-b1de-11e1ef0d239c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:42.775717 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c6e56-b621-4ea9-b1de-11e1ef0d239c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:42.777068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c6e56-b621-4ea9-b1de-11e1ef0d239c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:42.783860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee3574-7b05-4bfe-aff7-40e5e839deaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:42.785589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee3574-7b05-4bfe-aff7-40e5e839deaa None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:42.790664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 407/786] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:42.791787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c6e56-b621-4ea9-b1de-11e1ef0d239c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6eee3574-7b05-4bfe-aff7-40e5e839deaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:42.802046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:42.803018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:42.803904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:42.803904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:42.803904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:42.810172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 380/787] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:42.811222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3574-7b05-4bfe-aff7-40e5e839deaa None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:42.897944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c6e56-b621-4ea9-b1de-11e1ef0d239c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:42.919430 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3574-7b05-4bfe-aff7-40e5e839deaa None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:42.933721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8d248-46bd-481c-985f-00ef03b6dfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:42.934329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8d248-46bd-481c-985f-00ef03b6dfaf None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:42.934643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8d248-46bd-481c-985f-00ef03b6dfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:42.934911 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8d248-46bd-481c-985f-00ef03b6dfaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:42.935610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8d248-46bd-481c-985f-00ef03b6dfaf None admin] RBAC: Adding query filter params (interface=public, service_id=08ba01fe4c714f4d9587c224d26ca247, region_id=RegionOne) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:42.935910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8d248-46bd-481c-985f-00ef03b6dfaf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:42.937861 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8d248-46bd-481c-985f-00ef03b6dfaf None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:42.943976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 408/788] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Sep 12 23:15:42 2022] GET /identity/v3/endpoints?service_id=08ba01fe4c714f4d9587c224d26ca247&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:42.944694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8d248-46bd-481c-985f-00ef03b6dfaf None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:42.951239 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:42.955598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:42.965349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc02522-3ec3-429a-b6e3-61da1427b520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:42.965986 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc02522-3ec3-429a-b6e3-61da1427b520 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:42.966268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc02522-3ec3-429a-b6e3-61da1427b520 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:42.966575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc02522-3ec3-429a-b6e3-61da1427b520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:42.977996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc02522-3ec3-429a-b6e3-61da1427b520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:42.979647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc02522-3ec3-429a-b6e3-61da1427b520 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bcc02522-3ec3-429a-b6e3-61da1427b520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:42.997750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:42.998850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:43.000321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:43.000321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:43.000321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:43.000489 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 381/789] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:43.001888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc02522-3ec3-429a-b6e3-61da1427b520 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:43.063329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8d248-46bd-481c-985f-00ef03b6dfaf None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:43.099933 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532fc75-55f8-4b20-847f-754281178348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:43.100889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532fc75-55f8-4b20-847f-754281178348 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:43.101391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532fc75-55f8-4b20-847f-754281178348 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:43.101872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532fc75-55f8-4b20-847f-754281178348 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:43.102761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532fc75-55f8-4b20-847f-754281178348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:43.103293 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532fc75-55f8-4b20-847f-754281178348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:43.104829 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532fc75-55f8-4b20-847f-754281178348 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:43.112029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc02522-3ec3-429a-b6e3-61da1427b520 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:43.118556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 409/790] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:43.119668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532fc75-55f8-4b20-847f-754281178348 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:43.153834 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce0dce-4708-4143-9622-5a71aed923cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:43.154839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce0dce-4708-4143-9622-5a71aed923cf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:43.155127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce0dce-4708-4143-9622-5a71aed923cf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:43.155403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce0dce-4708-4143-9622-5a71aed923cf None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:43.156060 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce0dce-4708-4143-9622-5a71aed923cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:43.157451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce0dce-4708-4143-9622-5a71aed923cf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:43.164162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 382/791] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Sep 12 23:15:43 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:43.165392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce0dce-4708-4143-9622-5a71aed923cf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:43.195709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:43.213265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:43.246407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532fc75-55f8-4b20-847f-754281178348 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:43.284142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e13be4-44c0-4ea5-9e25-0d2bc7902e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:43.285162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e13be4-44c0-4ea5-9e25-0d2bc7902e36 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:43.285372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e13be4-44c0-4ea5-9e25-0d2bc7902e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:43.287277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e13be4-44c0-4ea5-9e25-0d2bc7902e36 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:43.287770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e13be4-44c0-4ea5-9e25-0d2bc7902e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:43.288074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e13be4-44c0-4ea5-9e25-0d2bc7902e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:43.290421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e13be4-44c0-4ea5-9e25-0d2bc7902e36 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:43.318501 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 410/792] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:43.322490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce0dce-4708-4143-9622-5a71aed923cf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:43.323858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e13be4-44c0-4ea5-9e25-0d2bc7902e36 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:43.399630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334bf5-75f0-45a8-a9bb-bd7dc77cfbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:43.400284 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334bf5-75f0-45a8-a9bb-bd7dc77cfbc6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:43.400564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334bf5-75f0-45a8-a9bb-bd7dc77cfbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:43.400841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334bf5-75f0-45a8-a9bb-bd7dc77cfbc6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:43.412830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334bf5-75f0-45a8-a9bb-bd7dc77cfbc6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:43.415129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334bf5-75f0-45a8-a9bb-bd7dc77cfbc6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1e334bf5-75f0-45a8-a9bb-bd7dc77cfbc6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:43.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:43.432628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:43.433562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:43.433562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:43.433562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:43.433562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:43.433562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:43.433562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:43.433562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:43.433562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:43.433562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:15:43.433562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:43.434083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 383/793] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Sep 12 23:15:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:43.443383 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334bf5-75f0-45a8-a9bb-bd7dc77cfbc6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:43.485721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e13be4-44c0-4ea5-9e25-0d2bc7902e36 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:43.514488 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:43.551040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb75be-3a21-46e8-b907-77d715ca57b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:43.551685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb75be-3a21-46e8-b907-77d715ca57b7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:43.552011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb75be-3a21-46e8-b907-77d715ca57b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:43.552284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb75be-3a21-46e8-b907-77d715ca57b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:43.571638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb75be-3a21-46e8-b907-77d715ca57b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:43.572982 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb75be-3a21-46e8-b907-77d715ca57b7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:43.575367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:43.581638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334bf5-75f0-45a8-a9bb-bd7dc77cfbc6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-2ceb75be-3a21-46e8-b907-77d715ca57b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:43.596929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:43.597960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:43.598944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:43.598944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:43.598944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:43.598944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:43.598944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:43.598944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:43.598944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:43.598944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:43.598944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:15:43.598944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:43.604580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 411/794] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:43.605450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb75be-3a21-46e8-b907-77d715ca57b7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:43.625920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bced7d-258a-4593-903e-d95814aeb0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:43.626928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bced7d-258a-4593-903e-d95814aeb0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:43.627416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bced7d-258a-4593-903e-d95814aeb0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:43.628335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bced7d-258a-4593-903e-d95814aeb0b0 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:43.629569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bced7d-258a-4593-903e-d95814aeb0b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:43.630100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bced7d-258a-4593-903e-d95814aeb0b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:43.632059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bced7d-258a-4593-903e-d95814aeb0b0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:43.655803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 384/795] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Sep 12 23:15:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:43.662294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bced7d-258a-4593-903e-d95814aeb0b0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:43.776038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bced7d-258a-4593-903e-d95814aeb0b0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:43.791212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb75be-3a21-46e8-b907-77d715ca57b7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:43.815833 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaa272-843e-43c7-82a3-afeec64d27e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:43.816854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaa272-843e-43c7-82a3-afeec64d27e8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:43.817340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaa272-843e-43c7-82a3-afeec64d27e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:43.817835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaa272-843e-43c7-82a3-afeec64d27e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:43.829964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfaa272-843e-43c7-82a3-afeec64d27e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:43.831737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfaa272-843e-43c7-82a3-afeec64d27e8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2cfaa272-843e-43c7-82a3-afeec64d27e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:43.847524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:43.848478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:43.849345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:43.849345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:43.849345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:43.851487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 385/796] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:43.857059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaa272-843e-43c7-82a3-afeec64d27e8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:43.870672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:43.888475 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13675094-f1ea-461e-a405-d95c14417839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:43.889126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13675094-f1ea-461e-a405-d95c14417839 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:43.889425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13675094-f1ea-461e-a405-d95c14417839 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:43.889647 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13675094-f1ea-461e-a405-d95c14417839 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:43.890990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13675094-f1ea-461e-a405-d95c14417839 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:43.891315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13675094-f1ea-461e-a405-d95c14417839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:43.892737 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13675094-f1ea-461e-a405-d95c14417839 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:43.925611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 412/797] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Sep 12 23:15:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:43.930838 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13675094-f1ea-461e-a405-d95c14417839 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:43.977692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaa272-843e-43c7-82a3-afeec64d27e8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:44.011677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:44.019331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7f737-c034-487b-85d8-12aedd88e903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:44.020839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7f737-c034-487b-85d8-12aedd88e903 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:44.021392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7f737-c034-487b-85d8-12aedd88e903 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:44.022013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7f737-c034-487b-85d8-12aedd88e903 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:44.023381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7f737-c034-487b-85d8-12aedd88e903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:44.023920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7f737-c034-487b-85d8-12aedd88e903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:44.025542 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7f737-c034-487b-85d8-12aedd88e903 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:44.039713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 386/798] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:44.045890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7f737-c034-487b-85d8-12aedd88e903 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:44.128870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:44.144563 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13675094-f1ea-461e-a405-d95c14417839 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:44.165287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7f737-c034-487b-85d8-12aedd88e903 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:44.204522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633c23c-cd77-4294-bd8e-982d94fee6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:44.205667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633c23c-cd77-4294-bd8e-982d94fee6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:44.206162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633c23c-cd77-4294-bd8e-982d94fee6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:44.206789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633c23c-cd77-4294-bd8e-982d94fee6c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:44.214483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633c23c-cd77-4294-bd8e-982d94fee6c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:44.216283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633c23c-cd77-4294-bd8e-982d94fee6c6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:44.219846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b9f05-a9b8-4f50-b0a2-acd7a5711894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:44.220254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b9f05-a9b8-4f50-b0a2-acd7a5711894 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:44.220535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b9f05-a9b8-4f50-b0a2-acd7a5711894 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:44.220803 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b9f05-a9b8-4f50-b0a2-acd7a5711894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b633c23c-cd77-4294-bd8e-982d94fee6c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:44.230373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:44.231296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:44.232159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:44.232159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:44.232159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:44.232159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:44.232159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:44.232159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:44.232159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:44.232159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:44.238416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b9f05-a9b8-4f50-b0a2-acd7a5711894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:44.238947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 387/799] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:44.239200 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b9f05-a9b8-4f50-b0a2-acd7a5711894 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:44.241113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea40f81-5f26-4d7d-a845-b44885ecbbd3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:44.241642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea40f81-5f26-4d7d-a845-b44885ecbbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:44.242090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea40f81-5f26-4d7d-a845-b44885ecbbd3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:44.243860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 388/800] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:44.245047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff1c39-c36a-41a5-8740-69919bcd3bd8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:44.245496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff1c39-c36a-41a5-8740-69919bcd3bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:44.245927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff1c39-c36a-41a5-8740-69919bcd3bd8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:44.247536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 389/801] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:44.248697 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff1c39-c36a-41a5-8740-69919bcd3bd8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-411b9f05-a9b8-4f50-b0a2-acd7a5711894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:44.257271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:44.258291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:44.259229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:44.259229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:44.259229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:44.259229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 413/802] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:44.259941 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37754d26-de27-4654-bc2a-fdfa810698d6 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:44.260225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37754d26-de27-4654-bc2a-fdfa810698d6 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:44.260494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37754d26-de27-4654-bc2a-fdfa810698d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:44.279758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-37754d26-de27-4654-bc2a-fdfa810698d6 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:44.281521 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-37754d26-de27-4654-bc2a-fdfa810698d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:44.348446 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 414/803] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:44.349686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2fb9-7617-471a-9789-31075966adca None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:44.349976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2fb9-7617-471a-9789-31075966adca None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:44.350252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2fb9-7617-471a-9789-31075966adca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:44.365931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff1c39-c36a-41a5-8740-69919bcd3bd8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:44.377784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-face2fb9-7617-471a-9789-31075966adca None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:44.377784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-face2fb9-7617-471a-9789-31075966adca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:44.401798 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:44.409751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:44.410738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fcb2e-4070-4c86-8ab2-882916efdf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:44.411778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fcb2e-4070-4c86-8ab2-882916efdf5e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:44.412210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fcb2e-4070-4c86-8ab2-882916efdf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:44.412721 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fcb2e-4070-4c86-8ab2-882916efdf5e None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:44.413488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fcb2e-4070-4c86-8ab2-882916efdf5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:44.414493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fcb2e-4070-4c86-8ab2-882916efdf5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:44.416499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fcb2e-4070-4c86-8ab2-882916efdf5e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:44.435684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 390/804] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:44.435684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fcb2e-4070-4c86-8ab2-882916efdf5e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:44.478721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 415/805] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:44.479918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2fb9-7617-471a-9789-31075966adca None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:44.544549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fcb2e-4070-4c86-8ab2-882916efdf5e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:44.614189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa0141-3068-4b32-ac75-5bebd0e3341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:44.615344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa0141-3068-4b32-ac75-5bebd0e3341b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:44.617103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa0141-3068-4b32-ac75-5bebd0e3341b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:44.617643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa0141-3068-4b32-ac75-5bebd0e3341b None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:44.618664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa0141-3068-4b32-ac75-5bebd0e3341b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:44.620080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa0141-3068-4b32-ac75-5bebd0e3341b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:44.622428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa0141-3068-4b32-ac75-5bebd0e3341b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:44.643061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 391/806] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:44.643752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa0141-3068-4b32-ac75-5bebd0e3341b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:44.652999 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2fb9-7617-471a-9789-31075966adca None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:44.698563 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bc180-ee4b-406e-a670-326640c5291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:44.699610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bc180-ee4b-406e-a670-326640c5291f None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:44.700531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bc180-ee4b-406e-a670-326640c5291f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:44.701010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bc180-ee4b-406e-a670-326640c5291f None admin] PATH_INFO: `/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/f66201e006624a69811e7c613702125e/roles/bb220d22e80a428d8855c3d5767fbc03` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:44.709971 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:44.725987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bc180-ee4b-406e-a670-326640c5291f None admin] RBAC: Authorizing `identity:create_grant(project_id=fd655924cf9a4736ba38740ade63ec52, user_id=f66201e006624a69811e7c613702125e, role_id=bb220d22e80a428d8855c3d5767fbc03)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:44.727654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bc180-ee4b-406e-a670-326640c5291f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:44.746417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 416/807] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:15:44 2022] PUT /identity/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/f66201e006624a69811e7c613702125e/roles/bb220d22e80a428d8855c3d5767fbc03 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:15:44.746417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bc180-ee4b-406e-a670-326640c5291f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:44.753093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:44.801674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa0141-3068-4b32-ac75-5bebd0e3341b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:44.854100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8192a0b-cd0f-43e0-8e3d-106c9a8e4bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:44.854858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8192a0b-cd0f-43e0-8e3d-106c9a8e4bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:44.855429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8192a0b-cd0f-43e0-8e3d-106c9a8e4bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:44.855703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8192a0b-cd0f-43e0-8e3d-106c9a8e4bd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:44.866828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bc180-ee4b-406e-a670-326640c5291f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:44.875543 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8192a0b-cd0f-43e0-8e3d-106c9a8e4bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e8192a0b-cd0f-43e0-8e3d-106c9a8e4bd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:44.882454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:44.883423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:44.884264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:44.884264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:44.884264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:44.884264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:44.884264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:44.884264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:44.884264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:44.884264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:44.884264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:44.884264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:44.884264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:44.884264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:44.885597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 392/808] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:44.894653 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8192a0b-cd0f-43e0-8e3d-106c9a8e4bd2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:44.916579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d0b0f-a660-43a5-8e52-e94ca4268841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:44.917229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d0b0f-a660-43a5-8e52-e94ca4268841 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:44.917512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d0b0f-a660-43a5-8e52-e94ca4268841 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:44.917783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d0b0f-a660-43a5-8e52-e94ca4268841 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:44.926655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d0b0f-a660-43a5-8e52-e94ca4268841 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:44.928220 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d0b0f-a660-43a5-8e52-e94ca4268841 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-502d0b0f-a660-43a5-8e52-e94ca4268841 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:44.947145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:44.948075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:44.950169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:44.950169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:44.950169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:44.950169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:44.950169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:44.950169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:44.950169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:44.950169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:44.950169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 417/809] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:44.950169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d0b0f-a660-43a5-8e52-e94ca4268841 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:45.022472 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8192a0b-cd0f-43e0-8e3d-106c9a8e4bd2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:45.038308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:45.047770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:45.071169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1c1c2-ea0f-4496-b92e-b2dc1521412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:45.072494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1c1c2-ea0f-4496-b92e-b2dc1521412b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:45.073382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1c1c2-ea0f-4496-b92e-b2dc1521412b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:45.073859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1c1c2-ea0f-4496-b92e-b2dc1521412b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:45.074675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1c1c2-ea0f-4496-b92e-b2dc1521412b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:45.076835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1c1c2-ea0f-4496-b92e-b2dc1521412b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:45.090347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d0b0f-a660-43a5-8e52-e94ca4268841 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0ce1c1c2-ea0f-4496-b92e-b2dc1521412b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:45.090803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:45.091749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:15:45.092572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:45.101214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 393/810] 10.222.0.33 () {56 vars in 1129 bytes} [Mon Sep 12 23:15:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:45.101214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1c1c2-ea0f-4496-b92e-b2dc1521412b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:45.143615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464843cd-242c-4828-9cdf-e3ce53e6f175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:45.144171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464843cd-242c-4828-9cdf-e3ce53e6f175 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:45.144459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464843cd-242c-4828-9cdf-e3ce53e6f175 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:45.144735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464843cd-242c-4828-9cdf-e3ce53e6f175 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:45.145410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464843cd-242c-4828-9cdf-e3ce53e6f175 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:45.145713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464843cd-242c-4828-9cdf-e3ce53e6f175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:45.147125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464843cd-242c-4828-9cdf-e3ce53e6f175 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:45.162883 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 418/811] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:45.163807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464843cd-242c-4828-9cdf-e3ce53e6f175 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:45.237653 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1c1c2-ea0f-4496-b92e-b2dc1521412b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:45.284282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464843cd-242c-4828-9cdf-e3ce53e6f175 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:45.286549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476584f-6968-4cd8-8335-fcdcbdb00c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:45.288335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476584f-6968-4cd8-8335-fcdcbdb00c6f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:45.288844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476584f-6968-4cd8-8335-fcdcbdb00c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:45.289333 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476584f-6968-4cd8-8335-fcdcbdb00c6f None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:45.290227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476584f-6968-4cd8-8335-fcdcbdb00c6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:45.290758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476584f-6968-4cd8-8335-fcdcbdb00c6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:45.293265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476584f-6968-4cd8-8335-fcdcbdb00c6f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:45.311597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 394/812] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:45.313626 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476584f-6968-4cd8-8335-fcdcbdb00c6f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:45.315639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:45.325818 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d4b4c-f48d-488d-8cb9-67dbf0d04575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:45.326485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d4b4c-f48d-488d-8cb9-67dbf0d04575 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:45.327165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d4b4c-f48d-488d-8cb9-67dbf0d04575 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:45.327444 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d4b4c-f48d-488d-8cb9-67dbf0d04575 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:45.328346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d4b4c-f48d-488d-8cb9-67dbf0d04575 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:45.328656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d4b4c-f48d-488d-8cb9-67dbf0d04575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:45.330427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d4b4c-f48d-488d-8cb9-67dbf0d04575 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:45.340426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 419/813] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Sep 12 23:15:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:45.340426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d4b4c-f48d-488d-8cb9-67dbf0d04575 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:45.370940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:45.458012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d4b4c-f48d-488d-8cb9-67dbf0d04575 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:45.475631 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476584f-6968-4cd8-8335-fcdcbdb00c6f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:45.496408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64235c6a-1e39-4a48-b055-dc53ae10faa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:45.497428 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64235c6a-1e39-4a48-b055-dc53ae10faa4 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:45.497551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64235c6a-1e39-4a48-b055-dc53ae10faa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:45.497824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64235c6a-1e39-4a48-b055-dc53ae10faa4 None admin] PATH_INFO: `/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/53214ffdc5d04c14b3b3ac868862480b/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:45.500620 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64235c6a-1e39-4a48-b055-dc53ae10faa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd655924cf9a4736ba38740ade63ec52, user_id=53214ffdc5d04c14b3b3ac868862480b, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:45.502299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64235c6a-1e39-4a48-b055-dc53ae10faa4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:45.518985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 420/814] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:15:45 2022] PUT /identity/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/53214ffdc5d04c14b3b3ac868862480b/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:15:45.520056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64235c6a-1e39-4a48-b055-dc53ae10faa4 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:45.522729 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e52ebf-a9ff-46ff-8b21-592300ce7ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:45.523844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e52ebf-a9ff-46ff-8b21-592300ce7ace None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:45.524344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e52ebf-a9ff-46ff-8b21-592300ce7ace None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:45.524907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e52ebf-a9ff-46ff-8b21-592300ce7ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:45.538405 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e52ebf-a9ff-46ff-8b21-592300ce7ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:45.540376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e52ebf-a9ff-46ff-8b21-592300ce7ace None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b2e52ebf-a9ff-46ff-8b21-592300ce7ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:45.558421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:45.559408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:45.560287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:45.560287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:45.560287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:45.562715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 395/815] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:45.567401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598676-58c1-48cb-8b36-909155348bca None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:45.568021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598676-58c1-48cb-8b36-909155348bca None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:45.568519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598676-58c1-48cb-8b36-909155348bca None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:45.570422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 396/816] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:45.574412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da598676-58c1-48cb-8b36-909155348bca None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:45.593952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:45.662544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64235c6a-1e39-4a48-b055-dc53ae10faa4 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:45.700025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:45.705142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46aee-4ab0-4b1e-8928-be514a980b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:45.706123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46aee-4ab0-4b1e-8928-be514a980b13 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:45.706647 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46aee-4ab0-4b1e-8928-be514a980b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:45.707195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46aee-4ab0-4b1e-8928-be514a980b13 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:45.708197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e46aee-4ab0-4b1e-8928-be514a980b13 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:45.708711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e46aee-4ab0-4b1e-8928-be514a980b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:45.710329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e46aee-4ab0-4b1e-8928-be514a980b13 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:45.721856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da598676-58c1-48cb-8b36-909155348bca None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:45.722809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 421/817] 10.222.0.33 () {56 vars in 1124 bytes} [Mon Sep 12 23:15:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:45.724404 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0dec-57bb-49ec-823b-93b7d5fc5f2c None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:45.724924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0dec-57bb-49ec-823b-93b7d5fc5f2c None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:45.725412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0dec-57bb-49ec-823b-93b7d5fc5f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:45.751747 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-763f0dec-57bb-49ec-823b-93b7d5fc5f2c None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:45.753145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-763f0dec-57bb-49ec-823b-93b7d5fc5f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:45.761844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe7311-3aed-4c52-a79f-4e0fe78bccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:45.762945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe7311-3aed-4c52-a79f-4e0fe78bccd4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:45.763436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe7311-3aed-4c52-a79f-4e0fe78bccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:45.763993 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe7311-3aed-4c52-a79f-4e0fe78bccd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:45.764980 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe7311-3aed-4c52-a79f-4e0fe78bccd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:45.766129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe7311-3aed-4c52-a79f-4e0fe78bccd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:45.767934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe7311-3aed-4c52-a79f-4e0fe78bccd4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:45.782178 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 397/818] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:45.783578 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe7311-3aed-4c52-a79f-4e0fe78bccd4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:45.843777 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 422/819] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:45.850410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0dec-57bb-49ec-823b-93b7d5fc5f2c None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:45.899015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:45.959904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe7311-3aed-4c52-a79f-4e0fe78bccd4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:45.998395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a6f8f-713b-416f-9676-5bf9f08618a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:45.999037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a6f8f-713b-416f-9676-5bf9f08618a1 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:45.999309 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a6f8f-713b-416f-9676-5bf9f08618a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:45.999671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a6f8f-713b-416f-9676-5bf9f08618a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:46.000554 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a6f8f-713b-416f-9676-5bf9f08618a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:46.002285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a6f8f-713b-416f-9676-5bf9f08618a1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:46.012323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0dec-57bb-49ec-823b-93b7d5fc5f2c None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:46.028243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 398/820] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:15:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:15:46.099838 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e62f4-b05f-4780-a17e-d43d1b08d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:46.100745 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e62f4-b05f-4780-a17e-d43d1b08d1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:46.101171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e62f4-b05f-4780-a17e-d43d1b08d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:46.101586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e62f4-b05f-4780-a17e-d43d1b08d1d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:46.114685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e62f4-b05f-4780-a17e-d43d1b08d1d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:46.116505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e62f4-b05f-4780-a17e-d43d1b08d1d1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-816e62f4-b05f-4780-a17e-d43d1b08d1d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:46.130270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:46.131469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:46.132631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:46.132631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:46.132631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:46.132631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:46.132631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:46.132631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:46.132631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:46.132631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:46.132631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:15:46.132631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:46.134781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 423/821] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Sep 12 23:15:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:46.140769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a6f8f-713b-416f-9676-5bf9f08618a1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:46.143968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:46.180140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e62f4-b05f-4780-a17e-d43d1b08d1d1 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:46.313128 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a6f8f-713b-416f-9676-5bf9f08618a1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:46.340458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e62f4-b05f-4780-a17e-d43d1b08d1d1 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:46.351621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:46.353084 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4dcd4-fd81-46e3-a777-83b6bdc3ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:46.353961 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4dcd4-fd81-46e3-a777-83b6bdc3ad93 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:46.354479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4dcd4-fd81-46e3-a777-83b6bdc3ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:46.354967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4dcd4-fd81-46e3-a777-83b6bdc3ad93 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:46.355897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4dcd4-fd81-46e3-a777-83b6bdc3ad93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:46.356422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4dcd4-fd81-46e3-a777-83b6bdc3ad93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:46.358083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4dcd4-fd81-46e3-a777-83b6bdc3ad93 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:46.388276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 399/822] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Sep 12 23:15:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:46.393697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87d245-104c-4f0e-a281-67a2e34af85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:46.393697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d245-104c-4f0e-a281-67a2e34af85e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:46.393697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d245-104c-4f0e-a281-67a2e34af85e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:46.393697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d245-104c-4f0e-a281-67a2e34af85e None admin] PATH_INFO: `/v3/services/network` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:46.394064 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87d245-104c-4f0e-a281-67a2e34af85e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:46.395192 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87d245-104c-4f0e-a281-67a2e34af85e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:46.396455 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4dcd4-fd81-46e3-a777-83b6bdc3ad93 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-cf87d245-104c-4f0e-a281-67a2e34af85e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:46.405066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:46.406201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:15:46.407407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:46.410638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 424/823] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:46 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:46.418894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87d245-104c-4f0e-a281-67a2e34af85e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:46.477352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:46.525537 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4dcd4-fd81-46e3-a777-83b6bdc3ad93 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:46.576156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37208b-6c67-44f7-b0e8-52bc3d4f886e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:46.576702 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37208b-6c67-44f7-b0e8-52bc3d4f886e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:46.576984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37208b-6c67-44f7-b0e8-52bc3d4f886e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:46.577257 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37208b-6c67-44f7-b0e8-52bc3d4f886e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:46.644378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87d245-104c-4f0e-a281-67a2e34af85e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:46.669215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37208b-6c67-44f7-b0e8-52bc3d4f886e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:46.671131 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37208b-6c67-44f7-b0e8-52bc3d4f886e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:46.736428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:46.741381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e29f3-a251-4f96-b2d4-20bc5bff18c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:46.742116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e29f3-a251-4f96-b2d4-20bc5bff18c6 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:46.742606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e29f3-a251-4f96-b2d4-20bc5bff18c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:46.742977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e29f3-a251-4f96-b2d4-20bc5bff18c6 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:46.743739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e29f3-a251-4f96-b2d4-20bc5bff18c6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:46.746842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e29f3-a251-4f96-b2d4-20bc5bff18c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:46.748336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e29f3-a251-4f96-b2d4-20bc5bff18c6 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:46.768442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 425/824] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:15:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:46.784073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e29f3-a251-4f96-b2d4-20bc5bff18c6 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:46.792053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 400/825] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:15:46.799440 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37208b-6c67-44f7-b0e8-52bc3d4f886e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:46.826846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:46.895275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e29f3-a251-4f96-b2d4-20bc5bff18c6 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:46.931082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e09e5-cdc2-488b-a8db-77688bffdbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:46.931817 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e09e5-cdc2-488b-a8db-77688bffdbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:46.932162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e09e5-cdc2-488b-a8db-77688bffdbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:46.932509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e09e5-cdc2-488b-a8db-77688bffdbe2 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:46.933213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e09e5-cdc2-488b-a8db-77688bffdbe2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:46.933590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e09e5-cdc2-488b-a8db-77688bffdbe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:46.935075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e09e5-cdc2-488b-a8db-77688bffdbe2 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:46.941176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 426/826] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:15:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:46.947241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e09e5-cdc2-488b-a8db-77688bffdbe2 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:47.034402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37208b-6c67-44f7-b0e8-52bc3d4f886e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:47.106783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:47.116820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e09e5-cdc2-488b-a8db-77688bffdbe2 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:47.123788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ee1ca-5e49-45d1-bd52-ed22fd553c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:47.124563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ee1ca-5e49-45d1-bd52-ed22fd553c5c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:47.125011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ee1ca-5e49-45d1-bd52-ed22fd553c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:47.125332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ee1ca-5e49-45d1-bd52-ed22fd553c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:47.148352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ee1ca-5e49-45d1-bd52-ed22fd553c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:47.149830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ee1ca-5e49-45d1-bd52-ed22fd553c5c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:47.158338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f69ce-b60f-435e-b59a-374940d249a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:47.159272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f69ce-b60f-435e-b59a-374940d249a7 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:47.159754 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f69ce-b60f-435e-b59a-374940d249a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:47.160247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f69ce-b60f-435e-b59a-374940d249a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:47.161114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f69ce-b60f-435e-b59a-374940d249a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:47.163169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f69ce-b60f-435e-b59a-374940d249a7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f83ee1ca-5e49-45d1-bd52-ed22fd553c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:47.177306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:47.178308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:47.179225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:47.179225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:47.179225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:47.182513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 401/827] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:47.192621 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ee1ca-5e49-45d1-bd52-ed22fd553c5c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:47.208824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 427/828] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:15:46 2022] POST /identity/v3/endpoints => generated 337 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:15:47.223126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:47.245879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9217-1b79-47af-9623-03db3badf870 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:47.246581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9217-1b79-47af-9623-03db3badf870 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:47.247139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9217-1b79-47af-9623-03db3badf870 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:47.248838 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 428/829] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:47.255373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db9c6b-4140-460a-81b9-61651dba8778 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:47.255993 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db9c6b-4140-460a-81b9-61651dba8778 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:47.256493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db9c6b-4140-460a-81b9-61651dba8778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:47.290687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-21db9c6b-4140-460a-81b9-61651dba8778 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:47.295349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-21db9c6b-4140-460a-81b9-61651dba8778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:47.428841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ee1ca-5e49-45d1-bd52-ed22fd553c5c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:47.433609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 429/830] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:15:47.473505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcdbc3-68e8-481d-98e4-3aeba63b26a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:47.474132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcdbc3-68e8-481d-98e4-3aeba63b26a9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:47.474432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcdbc3-68e8-481d-98e4-3aeba63b26a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:47.474708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcdbc3-68e8-481d-98e4-3aeba63b26a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:47.475358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcdbc3-68e8-481d-98e4-3aeba63b26a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:47.475659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcdbc3-68e8-481d-98e4-3aeba63b26a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:47.477046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcdbc3-68e8-481d-98e4-3aeba63b26a9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:47.490487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 402/831] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:47.495633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db9c6b-4140-460a-81b9-61651dba8778 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:47.582132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:47.612050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db9c6b-4140-460a-81b9-61651dba8778 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:47.651548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9543-ea65-4c9f-b609-b697fc86243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:47.652105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9543-ea65-4c9f-b609-b697fc86243a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:47.652385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9543-ea65-4c9f-b609-b697fc86243a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:47.652661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9543-ea65-4c9f-b609-b697fc86243a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:47.660234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a9543-ea65-4c9f-b609-b697fc86243a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:47.661685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a9543-ea65-4c9f-b609-b697fc86243a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-b36a9543-ea65-4c9f-b609-b697fc86243a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:47.674825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:47.675731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:47.676606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:47.676606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:47.676606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:47.676606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:47.676606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:47.676606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:47.676606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:47.676606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:47.676606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 430/832] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:47.681975 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcdbc3-68e8-481d-98e4-3aeba63b26a9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:47.735610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9543-ea65-4c9f-b609-b697fc86243a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:47.767450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:47.807950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcdbc3-68e8-481d-98e4-3aeba63b26a9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:47.849052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6741af-a916-4719-82e8-e739d4d2267c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:47.849677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6741af-a916-4719-82e8-e739d4d2267c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:47.849960 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6741af-a916-4719-82e8-e739d4d2267c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:47.850236 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6741af-a916-4719-82e8-e739d4d2267c None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:47.850969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6741af-a916-4719-82e8-e739d4d2267c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:47.851296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6741af-a916-4719-82e8-e739d4d2267c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:47.852849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6741af-a916-4719-82e8-e739d4d2267c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:47.865543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9543-ea65-4c9f-b609-b697fc86243a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:47.868339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 403/833] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:47.873859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6741af-a916-4719-82e8-e739d4d2267c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:47.909108 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ecbdb-6224-4985-b9e5-060a06bb17ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:47.909662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ecbdb-6224-4985-b9e5-060a06bb17ab None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:47.909926 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ecbdb-6224-4985-b9e5-060a06bb17ab None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:47.910187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ecbdb-6224-4985-b9e5-060a06bb17ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:47.913240 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:47.923620 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ecbdb-6224-4985-b9e5-060a06bb17ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-8c3ecbdb-6224-4985-b9e5-060a06bb17ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:47.928354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:47.929303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:47.930125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:47.930125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:47.930125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:47.930125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:47.930125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:47.930125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:47.930125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:47.930125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:47.930125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:47.930125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:47.930125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:15:47.930125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:47.934320 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 431/834] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:15:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:47.935547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46994714-5c70-4fdc-adfe-b0500801132f None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:47.935830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46994714-5c70-4fdc-adfe-b0500801132f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:47.936107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46994714-5c70-4fdc-adfe-b0500801132f None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:47.938543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 432/835] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:47.938659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46994714-5c70-4fdc-adfe-b0500801132f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:47.981161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6741af-a916-4719-82e8-e739d4d2267c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:48.012039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:48.017966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af07a2c-7e40-4b85-9938-07ddda2d10e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:48.018696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af07a2c-7e40-4b85-9938-07ddda2d10e9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:48.018992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af07a2c-7e40-4b85-9938-07ddda2d10e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:48.019332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af07a2c-7e40-4b85-9938-07ddda2d10e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:48.020086 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af07a2c-7e40-4b85-9938-07ddda2d10e9 None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=67b0698294e94845ae0dbdfb87059755) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:48.020501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af07a2c-7e40-4b85-9938-07ddda2d10e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:48.022033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af07a2c-7e40-4b85-9938-07ddda2d10e9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:48.027979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 404/836] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:47 2022] GET /identity/v3/role_assignments?user.id=67b0698294e94845ae0dbdfb87059755&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=6413aac4240a46ba816472c29e305973 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:48.029115 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e7206-c034-4c61-a4d8-4c1489d77736 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:48.029394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e7206-c034-4c61-a4d8-4c1489d77736 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:48.029663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e7206-c034-4c61-a4d8-4c1489d77736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:48.050065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-619e7206-c034-4c61-a4d8-4c1489d77736 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:48.052133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-619e7206-c034-4c61-a4d8-4c1489d77736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:48.067297 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46994714-5c70-4fdc-adfe-b0500801132f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:48.112348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e65d6-6f26-407b-b5fa-97f5e3184a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:48.113307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e65d6-6f26-407b-b5fa-97f5e3184a06 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:48.113766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e65d6-6f26-407b-b5fa-97f5e3184a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:48.114215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e65d6-6f26-407b-b5fa-97f5e3184a06 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:48.115204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e65d6-6f26-407b-b5fa-97f5e3184a06 None admin] RBAC: Adding query filter params (name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:48.115779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e65d6-6f26-407b-b5fa-97f5e3184a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:48.117507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e65d6-6f26-407b-b5fa-97f5e3184a06 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:48.128342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 433/837] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:15:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:48.135620 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e65d6-6f26-407b-b5fa-97f5e3184a06 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:48.148735 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 405/838] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:48.209864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:48.256583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e65d6-6f26-407b-b5fa-97f5e3184a06 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:48.293140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b65d4-5208-4316-8d65-a053c60d2116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:48.294009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b65d4-5208-4316-8d65-a053c60d2116 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:48.294451 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b65d4-5208-4316-8d65-a053c60d2116 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:48.294939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b65d4-5208-4316-8d65-a053c60d2116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:48.306712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b65d4-5208-4316-8d65-a053c60d2116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:48.308421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b65d4-5208-4316-8d65-a053c60d2116 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-f70b65d4-5208-4316-8d65-a053c60d2116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:48.324171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:48.325363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:48.326489 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:48.326489 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:48.326489 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:48.328559 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 434/839] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:48.334497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e7206-c034-4c61-a4d8-4c1489d77736 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:48.441833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b65d4-5208-4316-8d65-a053c60d2116 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:48.457160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e7206-c034-4c61-a4d8-4c1489d77736 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:48.487049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:48.496472 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610169b0-3dee-47f7-b5f1-0a0d99e9888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:48.497191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610169b0-3dee-47f7-b5f1-0a0d99e9888d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:48.497471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610169b0-3dee-47f7-b5f1-0a0d99e9888d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:48.497739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610169b0-3dee-47f7-b5f1-0a0d99e9888d None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:48.498400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610169b0-3dee-47f7-b5f1-0a0d99e9888d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:48.498705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610169b0-3dee-47f7-b5f1-0a0d99e9888d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:48.501290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610169b0-3dee-47f7-b5f1-0a0d99e9888d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:48.514190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 406/840] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:48.519927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610169b0-3dee-47f7-b5f1-0a0d99e9888d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:48.573495 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b65d4-5208-4316-8d65-a053c60d2116 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:48.589765 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:48.621966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d83b-b3e8-4034-9ad4-38e7b93a596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:48.623043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d83b-b3e8-4034-9ad4-38e7b93a596d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:48.623400 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d83b-b3e8-4034-9ad4-38e7b93a596d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:48.623743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d83b-b3e8-4034-9ad4-38e7b93a596d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:48.633893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610169b0-3dee-47f7-b5f1-0a0d99e9888d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:48.638965 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4d83b-b3e8-4034-9ad4-38e7b93a596d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-a3b4d83b-b3e8-4034-9ad4-38e7b93a596d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:48.646593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:48.647801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:48.648905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:48.648905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:48.648905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:48.648905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:48.648905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:48.648905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:48.648905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:48.648905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:48.648905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:48.648905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:48.648905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:15:48.648905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:48.653457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 435/841] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:48.657860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d83b-b3e8-4034-9ad4-38e7b93a596d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:48.686568 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fdf82-5712-4139-8e90-99872de7f38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:48.687458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fdf82-5712-4139-8e90-99872de7f38b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:48.687944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fdf82-5712-4139-8e90-99872de7f38b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:48.688390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fdf82-5712-4139-8e90-99872de7f38b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:48.697287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fdf82-5712-4139-8e90-99872de7f38b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:48.698808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fdf82-5712-4139-8e90-99872de7f38b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fb6fdf82-5712-4139-8e90-99872de7f38b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:48.711933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:48.712893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:48.713836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:48.713836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:48.713836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:48.713836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:48.713836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:48.713836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:48.713836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:48.713836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:48.713836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:15:48.713836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:48.717738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 407/842] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Sep 12 23:15:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:48.719117 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fdf82-5712-4139-8e90-99872de7f38b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:48.770351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:48.790040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d83b-b3e8-4034-9ad4-38e7b93a596d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:48.825487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43448c7-99ca-4d09-9dd7-2805e2897bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:48.826093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43448c7-99ca-4d09-9dd7-2805e2897bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:48.826368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43448c7-99ca-4d09-9dd7-2805e2897bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:48.826660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43448c7-99ca-4d09-9dd7-2805e2897bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:48.827327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43448c7-99ca-4d09-9dd7-2805e2897bd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:48.828284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43448c7-99ca-4d09-9dd7-2805e2897bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:48.829741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43448c7-99ca-4d09-9dd7-2805e2897bd8 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:48.830191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fdf82-5712-4139-8e90-99872de7f38b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:48.838437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 436/843] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:48.844701 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976feb6-0809-4142-956e-13278a66cd63 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:48.844981 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976feb6-0809-4142-956e-13278a66cd63 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:48.845250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976feb6-0809-4142-956e-13278a66cd63 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:48.846508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 437/844] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:48.850626 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976feb6-0809-4142-956e-13278a66cd63 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:48.872488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29280632-637a-4464-aea3-f5e27edfebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:48.873097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29280632-637a-4464-aea3-f5e27edfebe8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:48.873373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29280632-637a-4464-aea3-f5e27edfebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:48.873641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29280632-637a-4464-aea3-f5e27edfebe8 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:48.874442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29280632-637a-4464-aea3-f5e27edfebe8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:48.875643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29280632-637a-4464-aea3-f5e27edfebe8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:48.877127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29280632-637a-4464-aea3-f5e27edfebe8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:48.885243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:48.900365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 408/845] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Sep 12 23:15:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:48.900365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e2151-3763-40ea-b6be-f29bc340bea4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:48.900365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e2151-3763-40ea-b6be-f29bc340bea4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:48.900365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e2151-3763-40ea-b6be-f29bc340bea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:48.917918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-106e2151-3763-40ea-b6be-f29bc340bea4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:48.919138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-106e2151-3763-40ea-b6be-f29bc340bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:48.968991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976feb6-0809-4142-956e-13278a66cd63 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:48.991293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 409/846] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:48.992421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e2151-3763-40ea-b6be-f29bc340bea4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:49.011172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98846568-e46c-46ce-a92a-eb36f0878667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:49.011813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98846568-e46c-46ce-a92a-eb36f0878667 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:49.012095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98846568-e46c-46ce-a92a-eb36f0878667 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:49.012369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98846568-e46c-46ce-a92a-eb36f0878667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:49.024202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98846568-e46c-46ce-a92a-eb36f0878667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:49.025622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98846568-e46c-46ce-a92a-eb36f0878667 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-98846568-e46c-46ce-a92a-eb36f0878667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:49.042785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:49.043784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:49.044662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:49.044662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:49.044662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:49.048656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:49.049546 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 438/847] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:49.051102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98846568-e46c-46ce-a92a-eb36f0878667 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:49.131198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e2151-3763-40ea-b6be-f29bc340bea4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:49.170557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9066555-832c-4eac-a4c5-75834e727d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:49.171526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9066555-832c-4eac-a4c5-75834e727d68 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:49.171841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9066555-832c-4eac-a4c5-75834e727d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:49.172110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9066555-832c-4eac-a4c5-75834e727d68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:49.173963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:49.196512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98846568-e46c-46ce-a92a-eb36f0878667 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:49.240536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db796b5-28ff-48cd-99a5-c499c016d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:49.241192 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db796b5-28ff-48cd-99a5-c499c016d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:49.241472 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db796b5-28ff-48cd-99a5-c499c016d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:49.241792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db796b5-28ff-48cd-99a5-c499c016d2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:49.242466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db796b5-28ff-48cd-99a5-c499c016d2b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:49.242773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db796b5-28ff-48cd-99a5-c499c016d2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:49.245000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db796b5-28ff-48cd-99a5-c499c016d2b9 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:49.258153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9066555-832c-4eac-a4c5-75834e727d68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:49.259946 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9066555-832c-4eac-a4c5-75834e727d68 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:49.262528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 439/848] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:49.266358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db796b5-28ff-48cd-99a5-c499c016d2b9 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:49.298981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:49.376073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 410/849] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:48 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:15:49.376073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9066555-832c-4eac-a4c5-75834e727d68 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:49.389345 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db796b5-28ff-48cd-99a5-c499c016d2b9 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:49.426565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37233123-2fd4-4c05-8dbc-5f7b1edb4238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:49.427510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37233123-2fd4-4c05-8dbc-5f7b1edb4238 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:49.428114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37233123-2fd4-4c05-8dbc-5f7b1edb4238 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:49.428536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37233123-2fd4-4c05-8dbc-5f7b1edb4238 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:49.436815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37233123-2fd4-4c05-8dbc-5f7b1edb4238 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:49.439226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37233123-2fd4-4c05-8dbc-5f7b1edb4238 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-37233123-2fd4-4c05-8dbc-5f7b1edb4238 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:49.451977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:49.453920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:49.455121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:49.455121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:49.455121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:49.455121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:49.455121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:49.455121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:49.455121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:49.455121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:49.455121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:15:49.455121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:49.461824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 440/850] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:15:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:49.462894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37233123-2fd4-4c05-8dbc-5f7b1edb4238 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:49.466674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:49.481706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9066555-832c-4eac-a4c5-75834e727d68 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:49.518145 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84039b93-4c4b-49e1-9a2d-115f28cee548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:49.518821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84039b93-4c4b-49e1-9a2d-115f28cee548 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:49.519104 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84039b93-4c4b-49e1-9a2d-115f28cee548 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:49.519410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84039b93-4c4b-49e1-9a2d-115f28cee548 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:49.519994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84039b93-4c4b-49e1-9a2d-115f28cee548 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:49.521366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84039b93-4c4b-49e1-9a2d-115f28cee548 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:49.523166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-84039b93-4c4b-49e1-9a2d-115f28cee548 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:49.531832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:49.532852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:15:49.533672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:49.541844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 411/851] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:15:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:49.542523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84039b93-4c4b-49e1-9a2d-115f28cee548 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:49.578616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37233123-2fd4-4c05-8dbc-5f7b1edb4238 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:49.616730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c82ec-18e0-4bc3-afb8-86d6d4ff62c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:49.617353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c82ec-18e0-4bc3-afb8-86d6d4ff62c1 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:49.617628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c82ec-18e0-4bc3-afb8-86d6d4ff62c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:49.617898 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c82ec-18e0-4bc3-afb8-86d6d4ff62c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:49.629466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c82ec-18e0-4bc3-afb8-86d6d4ff62c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:49.630941 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c82ec-18e0-4bc3-afb8-86d6d4ff62c1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-d55c82ec-18e0-4bc3-afb8-86d6d4ff62c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:49.645384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:49.646332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:49.647561 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:49.647561 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:49.647561 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:49.647561 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 441/852] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:49.647561 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c82ec-18e0-4bc3-afb8-86d6d4ff62c1 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:49.657367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84039b93-4c4b-49e1-9a2d-115f28cee548 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:49.694630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51c438-771d-4e57-8ae4-227e6a105791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:49.695242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51c438-771d-4e57-8ae4-227e6a105791 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:49.695522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51c438-771d-4e57-8ae4-227e6a105791 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:49.695807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51c438-771d-4e57-8ae4-227e6a105791 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:49.696535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51c438-771d-4e57-8ae4-227e6a105791 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:49.696838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51c438-771d-4e57-8ae4-227e6a105791 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:49.698282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51c438-771d-4e57-8ae4-227e6a105791 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:49.706959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:49.722408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 412/853] 10.222.0.33 () {56 vars in 1135 bytes} [Mon Sep 12 23:15:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:49.722408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51c438-771d-4e57-8ae4-227e6a105791 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:49.761749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c82ec-18e0-4bc3-afb8-86d6d4ff62c1 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:49.777390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:49.800133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cf9a8-9390-47d8-81ea-c43f54ae4904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:49.800769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cf9a8-9390-47d8-81ea-c43f54ae4904 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:49.801047 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cf9a8-9390-47d8-81ea-c43f54ae4904 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:49.801320 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cf9a8-9390-47d8-81ea-c43f54ae4904 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:49.801948 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cf9a8-9390-47d8-81ea-c43f54ae4904 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:49.802355 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cf9a8-9390-47d8-81ea-c43f54ae4904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:49.803643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cf9a8-9390-47d8-81ea-c43f54ae4904 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:49.808415 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 442/854] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:15:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:49.809287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cf9a8-9390-47d8-81ea-c43f54ae4904 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:49.825717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51c438-771d-4e57-8ae4-227e6a105791 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:49.863013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29ed5c-1a1a-450a-a6d6-0022fbec2308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:49.863538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29ed5c-1a1a-450a-a6d6-0022fbec2308 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:49.863818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29ed5c-1a1a-450a-a6d6-0022fbec2308 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:49.864095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29ed5c-1a1a-450a-a6d6-0022fbec2308 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:49.864734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29ed5c-1a1a-450a-a6d6-0022fbec2308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:49.865040 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29ed5c-1a1a-450a-a6d6-0022fbec2308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:49.866430 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29ed5c-1a1a-450a-a6d6-0022fbec2308 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:49.878673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 413/855] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:49.879488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29ed5c-1a1a-450a-a6d6-0022fbec2308 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:49.926165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cf9a8-9390-47d8-81ea-c43f54ae4904 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:49.948727 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:49.965751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a71d0-f902-49b8-ab5e-5703c5361cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:49.966394 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a71d0-f902-49b8-ab5e-5703c5361cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:49.966682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a71d0-f902-49b8-ab5e-5703c5361cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:49.966949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a71d0-f902-49b8-ab5e-5703c5361cf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:50.043221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a71d0-f902-49b8-ab5e-5703c5361cf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:50.044678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a71d0-f902-49b8-ab5e-5703c5361cf7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:50.102484 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29ed5c-1a1a-450a-a6d6-0022fbec2308 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:50.118807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:50.138435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216259e6-48ef-42e9-b6a2-b46ed35ed708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:50.139099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216259e6-48ef-42e9-b6a2-b46ed35ed708 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:50.139367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216259e6-48ef-42e9-b6a2-b46ed35ed708 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:50.139575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216259e6-48ef-42e9-b6a2-b46ed35ed708 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:50.140812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216259e6-48ef-42e9-b6a2-b46ed35ed708 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:50.141117 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216259e6-48ef-42e9-b6a2-b46ed35ed708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:50.142506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216259e6-48ef-42e9-b6a2-b46ed35ed708 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:50.156426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 414/856] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:15:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:50.156426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216259e6-48ef-42e9-b6a2-b46ed35ed708 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:50.156710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 443/857] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:49 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:15:50.156710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a71d0-f902-49b8-ab5e-5703c5361cf7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:50.179408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:50.288618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a71d0-f902-49b8-ab5e-5703c5361cf7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:50.300586 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216259e6-48ef-42e9-b6a2-b46ed35ed708 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:50.335069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5f5f6-b9fb-4689-80e9-aa26ee3e1a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:50.336048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f5f6-b9fb-4689-80e9-aa26ee3e1a23 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:50.336328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f5f6-b9fb-4689-80e9-aa26ee3e1a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:50.336702 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f5f6-b9fb-4689-80e9-aa26ee3e1a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:50.347051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2941f25-a444-4a16-bdd3-533a446333b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:50.347699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2941f25-a444-4a16-bdd3-533a446333b2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:50.347970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2941f25-a444-4a16-bdd3-533a446333b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:50.348240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2941f25-a444-4a16-bdd3-533a446333b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:50.348919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5f5f6-b9fb-4689-80e9-aa26ee3e1a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:50.350398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5f5f6-b9fb-4689-80e9-aa26ee3e1a23 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:50.356207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2941f25-a444-4a16-bdd3-533a446333b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:50.357672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2941f25-a444-4a16-bdd3-533a446333b2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-4ee5f5f6-b9fb-4689-80e9-aa26ee3e1a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:50.367177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:50.368173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:50.370535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:50.370535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:50.370535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:50.370535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 444/858] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:50.370535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1ffc-e4f4-43d1-bd84-925d68e895d5 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:50.370535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1ffc-e4f4-43d1-bd84-925d68e895d5 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d2941f25-a444-4a16-bdd3-533a446333b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:50.370897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:50.372954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:50.376844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:50.376844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:50.376844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:50.376844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:50.376844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:50.376844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:50.376844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:50.376844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:50.382323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1ffc-e4f4-43d1-bd84-925d68e895d5 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:50.382973 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 415/859] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:50.383050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 445/860] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:50.383050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b1ffc-e4f4-43d1-bd84-925d68e895d5 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:50.383190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2941f25-a444-4a16-bdd3-533a446333b2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:50.427364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:50.460745 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:50.491116 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2941f25-a444-4a16-bdd3-533a446333b2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:50.492869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b1ffc-e4f4-43d1-bd84-925d68e895d5 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:50.527250 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47800ef-c0c6-420c-8d12-4fbfc527a6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:50.527999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47800ef-c0c6-420c-8d12-4fbfc527a6dc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:50.528238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47800ef-c0c6-420c-8d12-4fbfc527a6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:50.528507 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47800ef-c0c6-420c-8d12-4fbfc527a6dc None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:50.529177 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47800ef-c0c6-420c-8d12-4fbfc527a6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:50.529541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47800ef-c0c6-420c-8d12-4fbfc527a6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:50.531566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dbc49-aa9a-403d-a91a-13c323788779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:50.531759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47800ef-c0c6-420c-8d12-4fbfc527a6dc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:50.532176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dbc49-aa9a-403d-a91a-13c323788779 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:50.532454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dbc49-aa9a-403d-a91a-13c323788779 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:50.532722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dbc49-aa9a-403d-a91a-13c323788779 None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:50.533404 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dbc49-aa9a-403d-a91a-13c323788779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:50.533706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dbc49-aa9a-403d-a91a-13c323788779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:50.535160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dbc49-aa9a-403d-a91a-13c323788779 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:50.544293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 416/861] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:50.547699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd261d-e23f-4c5d-ba27-62665a92900f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:50.552802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd261d-e23f-4c5d-ba27-62665a92900f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:50.552934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 446/862] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:50.552934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dbc49-aa9a-403d-a91a-13c323788779 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:50.553068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd261d-e23f-4c5d-ba27-62665a92900f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:50.569351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-71fd261d-e23f-4c5d-ba27-62665a92900f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:50.570584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-71fd261d-e23f-4c5d-ba27-62665a92900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:50.639464 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 417/863] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:50.640287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd261d-e23f-4c5d-ba27-62665a92900f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:50.659866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dbc49-aa9a-403d-a91a-13c323788779 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:50.679512 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:50.690796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:50.696019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321f295-7ef8-444d-ba6a-c1ac2d7a31c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:50.696995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f295-7ef8-444d-ba6a-c1ac2d7a31c9 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:50.697333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f295-7ef8-444d-ba6a-c1ac2d7a31c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:50.697669 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f295-7ef8-444d-ba6a-c1ac2d7a31c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:50.707388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321f295-7ef8-444d-ba6a-c1ac2d7a31c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:50.708960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321f295-7ef8-444d-ba6a-c1ac2d7a31c9 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-7321f295-7ef8-444d-ba6a-c1ac2d7a31c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:50.721371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:50.722298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:50.723238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:50.723238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:50.723238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:50.723238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:50.723238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:50.723238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:50.723238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:50.723238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:50.727102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 447/864] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:50.727928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321f295-7ef8-444d-ba6a-c1ac2d7a31c9 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:50.771693 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd261d-e23f-4c5d-ba27-62665a92900f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:50.817696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0fab2-3eba-4308-85d0-922b46928d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:50.818305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0fab2-3eba-4308-85d0-922b46928d91 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:50.818932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0fab2-3eba-4308-85d0-922b46928d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:50.819205 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0fab2-3eba-4308-85d0-922b46928d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:50.819933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0fab2-3eba-4308-85d0-922b46928d91 None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=f66201e006624a69811e7c613702125e) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:50.820237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0fab2-3eba-4308-85d0-922b46928d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:50.821669 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0fab2-3eba-4308-85d0-922b46928d91 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:50.838418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 418/865] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:50 2022] GET /identity/v3/role_assignments?user.id=f66201e006624a69811e7c613702125e&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:50.840885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321f295-7ef8-444d-ba6a-c1ac2d7a31c9 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:50.881685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6fccb-5271-410c-ba02-64dcda779c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:50.882366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6fccb-5271-410c-ba02-64dcda779c9e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:50.882676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6fccb-5271-410c-ba02-64dcda779c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:50.882979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6fccb-5271-410c-ba02-64dcda779c9e None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:50.883695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6fccb-5271-410c-ba02-64dcda779c9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:50.883999 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6fccb-5271-410c-ba02-64dcda779c9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:50.885565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6fccb-5271-410c-ba02-64dcda779c9e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:50.901204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 448/866] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:50.911610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0fab2-3eba-4308-85d0-922b46928d91 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:50.936064 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6fccb-5271-410c-ba02-64dcda779c9e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:51.009049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:51.031049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:51.043051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0fab2-3eba-4308-85d0-922b46928d91 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:51.069501 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6fccb-5271-410c-ba02-64dcda779c9e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:51.082840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd5cdc-7d05-4002-b750-9a5482f8c06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:51.083468 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd5cdc-7d05-4002-b750-9a5482f8c06a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:51.083747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd5cdc-7d05-4002-b750-9a5482f8c06a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:51.084015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd5cdc-7d05-4002-b750-9a5482f8c06a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:51.084760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd5cdc-7d05-4002-b750-9a5482f8c06a None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=53214ffdc5d04c14b3b3ac868862480b) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:51.085081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd5cdc-7d05-4002-b750-9a5482f8c06a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:51.086623 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd5cdc-7d05-4002-b750-9a5482f8c06a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:51.093962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 419/867] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:50 2022] GET /identity/v3/role_assignments?user.id=53214ffdc5d04c14b3b3ac868862480b&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=6413aac4240a46ba816472c29e305973 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:51.113711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914f6c-0e3c-46a5-8cb7-461f7b5c2f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:51.114721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914f6c-0e3c-46a5-8cb7-461f7b5c2f2d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:51.115177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914f6c-0e3c-46a5-8cb7-461f7b5c2f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:51.115624 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914f6c-0e3c-46a5-8cb7-461f7b5c2f2d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:51.116397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88914f6c-0e3c-46a5-8cb7-461f7b5c2f2d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:51.118131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88914f6c-0e3c-46a5-8cb7-461f7b5c2f2d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-88914f6c-0e3c-46a5-8cb7-461f7b5c2f2d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:51.128987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:51.130152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:15:51.131270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:51.133678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 449/868] 10.222.0.33 () {56 vars in 1132 bytes} [Mon Sep 12 23:15:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:51.140547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd5cdc-7d05-4002-b750-9a5482f8c06a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:51.260818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd5cdc-7d05-4002-b750-9a5482f8c06a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:51.300941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220c271-5f4c-4d80-a380-24d3a7dde4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:51.301561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220c271-5f4c-4d80-a380-24d3a7dde4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:51.301841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220c271-5f4c-4d80-a380-24d3a7dde4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:51.302115 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220c271-5f4c-4d80-a380-24d3a7dde4c3 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:51.303093 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220c271-5f4c-4d80-a380-24d3a7dde4c3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:51.303196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220c271-5f4c-4d80-a380-24d3a7dde4c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:51.304505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220c271-5f4c-4d80-a380-24d3a7dde4c3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:51.309452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 420/869] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Sep 12 23:15:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:51.315616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914f6c-0e3c-46a5-8cb7-461f7b5c2f2d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:51.427960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914f6c-0e3c-46a5-8cb7-461f7b5c2f2d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:51.446519 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:51.466962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141c242-4aaf-42c5-97a7-b4aee62f4527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:51.467565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141c242-4aaf-42c5-97a7-b4aee62f4527 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:51.467843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141c242-4aaf-42c5-97a7-b4aee62f4527 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:51.468722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141c242-4aaf-42c5-97a7-b4aee62f4527 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:51.469589 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141c242-4aaf-42c5-97a7-b4aee62f4527 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:51.469892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141c242-4aaf-42c5-97a7-b4aee62f4527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:51.471283 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141c242-4aaf-42c5-97a7-b4aee62f4527 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:51.476233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 450/870] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Sep 12 23:15:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:52.417496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a3751-d220-4ec4-9421-eed79b4dd6a5 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:52.417999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a3751-d220-4ec4-9421-eed79b4dd6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:52.418112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a3751-d220-4ec4-9421-eed79b4dd6a5 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:52.419737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 421/871] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:52.425523 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7e77-c8a0-48ea-8f7c-a01d8cc37f53 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:52.425913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7e77-c8a0-48ea-8f7c-a01d8cc37f53 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:52.426077 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7e77-c8a0-48ea-8f7c-a01d8cc37f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:52.444444 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-befa7e77-c8a0-48ea-8f7c-a01d8cc37f53 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:52.445638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-befa7e77-c8a0-48ea-8f7c-a01d8cc37f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:52.514458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 451/872] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:52.785440 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a3751-d220-4ec4-9421-eed79b4dd6a5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:52.811613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:52.893130 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a3751-d220-4ec4-9421-eed79b4dd6a5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:52.928658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f6f27-13f1-4c4b-8a72-650138607c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:52.929275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f6f27-13f1-4c4b-8a72-650138607c31 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:52.929558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f6f27-13f1-4c4b-8a72-650138607c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:52.929826 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f6f27-13f1-4c4b-8a72-650138607c31 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:52.930518 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f6f27-13f1-4c4b-8a72-650138607c31 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:52.931898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f6f27-13f1-4c4b-8a72-650138607c31 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:52.948156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 422/873] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:15:52 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:15:53.190715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42a0a6-5372-44f8-a361-395f417f4f47 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:53.191058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42a0a6-5372-44f8-a361-395f417f4f47 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:53.191171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42a0a6-5372-44f8-a361-395f417f4f47 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:53.192785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 452/874] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:53.198408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826ba5f-3088-4641-978f-93f1a894579b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:53.198711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826ba5f-3088-4641-978f-93f1a894579b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:53.198989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826ba5f-3088-4641-978f-93f1a894579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:53.219101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2826ba5f-3088-4641-978f-93f1a894579b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:53.219866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2826ba5f-3088-4641-978f-93f1a894579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:53.298438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 423/875] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:53 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:53.441437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321f662-e8fa-431d-b3e0-b531b316c329 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:53.441939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321f662-e8fa-431d-b3e0-b531b316c329 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:53.442110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321f662-e8fa-431d-b3e0-b531b316c329 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:53.443812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 453/876] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:53.449114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b6fba-4a25-4461-90bc-701f5942b77c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:53.449527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b6fba-4a25-4461-90bc-701f5942b77c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:53.449845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b6fba-4a25-4461-90bc-701f5942b77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:53.473470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-da0b6fba-4a25-4461-90bc-701f5942b77c None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:53.474691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-da0b6fba-4a25-4461-90bc-701f5942b77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:53.476772 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:53.548995 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 424/877] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:53 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:53.593648 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321f662-e8fa-431d-b3e0-b531b316c329 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:53.678948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751d8f9-e3dd-4d93-8ab2-49f00ed49591 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:53.679286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751d8f9-e3dd-4d93-8ab2-49f00ed49591 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:53.679500 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751d8f9-e3dd-4d93-8ab2-49f00ed49591 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:53.682223 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 425/878] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:53.686168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dffdb-61e1-4b52-8802-d642b9cc7154 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:53.686496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dffdb-61e1-4b52-8802-d642b9cc7154 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:53.687326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dffdb-61e1-4b52-8802-d642b9cc7154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:53.700602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321f662-e8fa-431d-b3e0-b531b316c329 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:53.709074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-129dffdb-61e1-4b52-8802-d642b9cc7154 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:53.710592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-129dffdb-61e1-4b52-8802-d642b9cc7154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:53.718992 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:53.739539 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bb489-ffaf-4fc6-aeb7-acab7389e3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:53.740175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bb489-ffaf-4fc6-aeb7-acab7389e3aa None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:53.740450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bb489-ffaf-4fc6-aeb7-acab7389e3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:53.740723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bb489-ffaf-4fc6-aeb7-acab7389e3aa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:53.754344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bb489-ffaf-4fc6-aeb7-acab7389e3aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-2d4bb489-ffaf-4fc6-aeb7-acab7389e3aa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:53.759806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:53.760709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:53.761579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:53.761579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:53.761579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:53.761579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:53.761579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:53.761579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:53.761579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:53.761579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:53.761579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:53.761579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:53.761579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:15:53.761579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:53.763863 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 454/879] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Sep 12 23:15:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:53.776257 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bb489-ffaf-4fc6-aeb7-acab7389e3aa None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:53.793552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 426/880] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:53 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:15:53.849489 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dffdb-61e1-4b52-8802-d642b9cc7154 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:53.890463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bb489-ffaf-4fc6-aeb7-acab7389e3aa None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:53.932730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7e5c9-9471-4b3c-a813-71be62f22819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:53.933704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7e5c9-9471-4b3c-a813-71be62f22819 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:53.934187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7e5c9-9471-4b3c-a813-71be62f22819 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:53.934709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7e5c9-9471-4b3c-a813-71be62f22819 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:53.935600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7e5c9-9471-4b3c-a813-71be62f22819 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:53.936329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7e5c9-9471-4b3c-a813-71be62f22819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:53.938307 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:53.939633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7e5c9-9471-4b3c-a813-71be62f22819 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:53.954834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 455/881] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Sep 12 23:15:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:53.956941 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7e5c9-9471-4b3c-a813-71be62f22819 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:53.980457 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dffdb-61e1-4b52-8802-d642b9cc7154 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:53.992789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:54.025571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438347c2-99c7-45d9-bfa1-824931e9b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:54.026583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438347c2-99c7-45d9-bfa1-824931e9b71b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:54.026865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438347c2-99c7-45d9-bfa1-824931e9b71b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:54.027129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438347c2-99c7-45d9-bfa1-824931e9b71b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:54.027963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438347c2-99c7-45d9-bfa1-824931e9b71b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:54.029538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438347c2-99c7-45d9-bfa1-824931e9b71b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-438347c2-99c7-45d9-bfa1-824931e9b71b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:54.041672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:54.042727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:54.047506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 427/882] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Sep 12 23:15:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:54.051427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438347c2-99c7-45d9-bfa1-824931e9b71b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:54.082089 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7e5c9-9471-4b3c-a813-71be62f22819 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:54.120199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae09db-80a4-426d-97b5-7ef0100130d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:54.120870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae09db-80a4-426d-97b5-7ef0100130d1 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:54.121144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae09db-80a4-426d-97b5-7ef0100130d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:54.121433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae09db-80a4-426d-97b5-7ef0100130d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:54.132721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae09db-80a4-426d-97b5-7ef0100130d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:54.134265 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae09db-80a4-426d-97b5-7ef0100130d1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-72ae09db-80a4-426d-97b5-7ef0100130d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:54.149760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:54.150994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:54.151867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:54.151867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:54.151867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:54.151867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 456/883] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:54.151867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae09db-80a4-426d-97b5-7ef0100130d1 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:54.162424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438347c2-99c7-45d9-bfa1-824931e9b71b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:54.192559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:54.198276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0e2bb-1bdd-4214-8c85-9498c25b92f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:54.198918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0e2bb-1bdd-4214-8c85-9498c25b92f6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:54.199192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0e2bb-1bdd-4214-8c85-9498c25b92f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:54.199463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0e2bb-1bdd-4214-8c85-9498c25b92f6 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:54.200093 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0e2bb-1bdd-4214-8c85-9498c25b92f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:54.200394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0e2bb-1bdd-4214-8c85-9498c25b92f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:54.201774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0e2bb-1bdd-4214-8c85-9498c25b92f6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:54.208180 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 428/884] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Sep 12 23:15:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:54.208901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0e2bb-1bdd-4214-8c85-9498c25b92f6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:54.252150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:54.272383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae09db-80a4-426d-97b5-7ef0100130d1 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:54.310394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0e2bb-1bdd-4214-8c85-9498c25b92f6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:54.312653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c23d-e3d2-4525-897a-24f0eb8c6954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:54.313276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c23d-e3d2-4525-897a-24f0eb8c6954 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:54.313555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c23d-e3d2-4525-897a-24f0eb8c6954 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:54.313824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c23d-e3d2-4525-897a-24f0eb8c6954 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:54.314508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2c23d-e3d2-4525-897a-24f0eb8c6954 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:54.315870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2c23d-e3d2-4525-897a-24f0eb8c6954 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:54.333596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 457/885] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:15:54 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:15:54.334812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c23d-e3d2-4525-897a-24f0eb8c6954 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:54.366662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46b503-5124-40b9-bf7a-1ef5525089a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:54.367301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46b503-5124-40b9-bf7a-1ef5525089a7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:54.367578 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46b503-5124-40b9-bf7a-1ef5525089a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:54.367850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46b503-5124-40b9-bf7a-1ef5525089a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:54.368516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46b503-5124-40b9-bf7a-1ef5525089a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:54.368818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46b503-5124-40b9-bf7a-1ef5525089a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:54.370239 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46b503-5124-40b9-bf7a-1ef5525089a7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:54.395530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 429/886] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:54.406408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46b503-5124-40b9-bf7a-1ef5525089a7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:54.479919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c23d-e3d2-4525-897a-24f0eb8c6954 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:54.490791 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:54.525172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ab307-1869-47c7-b143-36d5c4a62f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:54.526240 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ab307-1869-47c7-b143-36d5c4a62f8f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:54.526565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ab307-1869-47c7-b143-36d5c4a62f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:54.526857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ab307-1869-47c7-b143-36d5c4a62f8f None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:54.528224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ab307-1869-47c7-b143-36d5c4a62f8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:54.528224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ab307-1869-47c7-b143-36d5c4a62f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:54.529698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ab307-1869-47c7-b143-36d5c4a62f8f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:54.535440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 458/887] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Sep 12 23:15:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:54.542617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46b503-5124-40b9-bf7a-1ef5525089a7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:54.587603 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a100f6a-db30-4b52-af44-edae072ee965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:54.588250 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a100f6a-db30-4b52-af44-edae072ee965 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:54.588528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a100f6a-db30-4b52-af44-edae072ee965 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:54.588802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a100f6a-db30-4b52-af44-edae072ee965 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:54.597893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a100f6a-db30-4b52-af44-edae072ee965 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:54.599414 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a100f6a-db30-4b52-af44-edae072ee965 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9a100f6a-db30-4b52-af44-edae072ee965 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:54.613381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:54.614419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:54.615371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:54.615371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:54.615371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:54.615371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:54.615371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:54.615371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:54.615371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:54.615371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:54.615371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:15:54.615371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:54.618517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 430/888] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Sep 12 23:15:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:54.620811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ab307-1869-47c7-b143-36d5c4a62f8f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:54.633386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:54.735250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ab307-1869-47c7-b143-36d5c4a62f8f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:54.770769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009082cc-e689-4194-962f-2b8007c341ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:54.771381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009082cc-e689-4194-962f-2b8007c341ca None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:54.771658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009082cc-e689-4194-962f-2b8007c341ca None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:54.771932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009082cc-e689-4194-962f-2b8007c341ca None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:54.772675 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009082cc-e689-4194-962f-2b8007c341ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:54.772977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009082cc-e689-4194-962f-2b8007c341ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:54.774441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009082cc-e689-4194-962f-2b8007c341ca None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:54.798269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 459/889] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Sep 12 23:15:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:54.799674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a100f6a-db30-4b52-af44-edae072ee965 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:54.907632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a100f6a-db30-4b52-af44-edae072ee965 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:54.922014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:54.947564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9264d-87e9-4446-b400-68b15d3dc273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:54.948572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9264d-87e9-4446-b400-68b15d3dc273 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:54.949053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9264d-87e9-4446-b400-68b15d3dc273 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:54.949524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9264d-87e9-4446-b400-68b15d3dc273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:55.025648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9264d-87e9-4446-b400-68b15d3dc273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:55.027536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9264d-87e9-4446-b400-68b15d3dc273 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:55.144911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 431/890] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:15:54 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:15:55.150280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009082cc-e689-4194-962f-2b8007c341ca None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:55.225730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064bf88-4546-4421-9691-0fdfb977a730 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:55.226031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064bf88-4546-4421-9691-0fdfb977a730 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:55.226272 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064bf88-4546-4421-9691-0fdfb977a730 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:55.226664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:55.227815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 432/891] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:15:55.234842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2f1fb-3dac-4277-8481-d53a42b49324 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:55.235498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2f1fb-3dac-4277-8481-d53a42b49324 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:55.235977 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2f1fb-3dac-4277-8481-d53a42b49324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:55.255171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bae2f1fb-3dac-4277-8481-d53a42b49324 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:55.256693 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bae2f1fb-3dac-4277-8481-d53a42b49324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:55.265322 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:55.267495 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009082cc-e689-4194-962f-2b8007c341ca None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:55.312975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be44ae4-292c-478f-91ae-f6737a12b418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:55.313526 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be44ae4-292c-478f-91ae-f6737a12b418 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:55.313797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be44ae4-292c-478f-91ae-f6737a12b418 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:55.314063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be44ae4-292c-478f-91ae-f6737a12b418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:55.327078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be44ae4-292c-478f-91ae-f6737a12b418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:55.329198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be44ae4-292c-478f-91ae-f6737a12b418 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:55.342749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 433/892] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-3be44ae4-292c-478f-91ae-f6737a12b418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:55.345360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:55.346365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:55.347362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:55.347362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:55.347362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:55.347362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 460/893] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:55.352075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2f1fb-3dac-4277-8481-d53a42b49324 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:55.470449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2f1fb-3dac-4277-8481-d53a42b49324 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:55.508437 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c70d6-06fa-48cb-b58c-c7868162bfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:55.509940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c70d6-06fa-48cb-b58c-c7868162bfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:55.510493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c70d6-06fa-48cb-b58c-c7868162bfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:55.510981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c70d6-06fa-48cb-b58c-c7868162bfb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:55.511825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c70d6-06fa-48cb-b58c-c7868162bfb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:55.512326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c70d6-06fa-48cb-b58c-c7868162bfb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:55.513879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c70d6-06fa-48cb-b58c-c7868162bfb8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:55.527049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 434/894] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:55.535464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be44ae4-292c-478f-91ae-f6737a12b418 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:55.626518 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c70d6-06fa-48cb-b58c-c7868162bfb8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:55.629445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:55.645887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be44ae4-292c-478f-91ae-f6737a12b418 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:55.674812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:55.689416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27da2be-8844-4df4-9774-d6ca21bef042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:55.690353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27da2be-8844-4df4-9774-d6ca21bef042 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:55.691184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27da2be-8844-4df4-9774-d6ca21bef042 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:55.691694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27da2be-8844-4df4-9774-d6ca21bef042 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:55.699884 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27da2be-8844-4df4-9774-d6ca21bef042 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:55.701442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27da2be-8844-4df4-9774-d6ca21bef042 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-e27da2be-8844-4df4-9774-d6ca21bef042 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:15:55.714249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:55.715175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:55.716053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:15:55.716053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:15:55.716053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:15:55.716053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:15:55.716053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:15:55.716053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:15:55.716053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:15:55.716053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:55.716053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 461/895] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:55.721673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27da2be-8844-4df4-9774-d6ca21bef042 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:55.753241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c70d6-06fa-48cb-b58c-c7868162bfb8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:55.796380 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787e65d-9f5a-4feb-913c-b3f7e6ec9418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:55.797015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787e65d-9f5a-4feb-913c-b3f7e6ec9418 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:55.797293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787e65d-9f5a-4feb-913c-b3f7e6ec9418 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:55.797561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787e65d-9f5a-4feb-913c-b3f7e6ec9418 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:55.798135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787e65d-9f5a-4feb-913c-b3f7e6ec9418 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:55.799556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787e65d-9f5a-4feb-913c-b3f7e6ec9418 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1787e65d-9f5a-4feb-913c-b3f7e6ec9418 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:55.808474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:55.809524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:55.810402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 435/896] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:15:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:55.822491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787e65d-9f5a-4feb-913c-b3f7e6ec9418 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:55.838608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27da2be-8844-4df4-9774-d6ca21bef042 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:55.875957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895fb7f-7e7c-4394-89f8-815b0a8fcceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:55.876657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895fb7f-7e7c-4394-89f8-815b0a8fcceb None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:55.876878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895fb7f-7e7c-4394-89f8-815b0a8fcceb None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:55.877151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895fb7f-7e7c-4394-89f8-815b0a8fcceb None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:55.877896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895fb7f-7e7c-4394-89f8-815b0a8fcceb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:55.878209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895fb7f-7e7c-4394-89f8-815b0a8fcceb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:55.879708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895fb7f-7e7c-4394-89f8-815b0a8fcceb None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:55.897596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 462/897] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:15:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:55.898946 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895fb7f-7e7c-4394-89f8-815b0a8fcceb None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:55.918118 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:55.943905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:55.975162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787e65d-9f5a-4feb-913c-b3f7e6ec9418 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:56.009078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895fb7f-7e7c-4394-89f8-815b0a8fcceb None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:56.018907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e08b0-75bc-41cf-8176-92716e767041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:56.020160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e08b0-75bc-41cf-8176-92716e767041 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:56.020624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e08b0-75bc-41cf-8176-92716e767041 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:56.021051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e08b0-75bc-41cf-8176-92716e767041 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:56.022209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e08b0-75bc-41cf-8176-92716e767041 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:56.022969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e08b0-75bc-41cf-8176-92716e767041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:56.024840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e08b0-75bc-41cf-8176-92716e767041 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:56.035892 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 436/898] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:15:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:56.037683 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e08b0-75bc-41cf-8176-92716e767041 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:56.053356 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa141127-e8af-4c30-92c6-0afde39ab14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:56.054087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141127-e8af-4c30-92c6-0afde39ab14f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:56.054614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141127-e8af-4c30-92c6-0afde39ab14f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:56.054893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141127-e8af-4c30-92c6-0afde39ab14f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:56.055615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa141127-e8af-4c30-92c6-0afde39ab14f None admin] RBAC: Adding query filter params (role.id=cc4e7138f6854039a5bf03f9538bb90d, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=f66201e006624a69811e7c613702125e) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:56.055938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa141127-e8af-4c30-92c6-0afde39ab14f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:56.057346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa141127-e8af-4c30-92c6-0afde39ab14f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:56.070554 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 463/899] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:15:55 2022] GET /identity/v3/role_assignments?user.id=f66201e006624a69811e7c613702125e&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=cc4e7138f6854039a5bf03f9538bb90d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:56.160222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e08b0-75bc-41cf-8176-92716e767041 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:56.193672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:56.200488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee14283-499a-4b10-a63f-5b0a310e8b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:56.201584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee14283-499a-4b10-a63f-5b0a310e8b62 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:56.202126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee14283-499a-4b10-a63f-5b0a310e8b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:56.203253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee14283-499a-4b10-a63f-5b0a310e8b62 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:56.204117 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee14283-499a-4b10-a63f-5b0a310e8b62 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:56.204630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee14283-499a-4b10-a63f-5b0a310e8b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:56.206278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee14283-499a-4b10-a63f-5b0a310e8b62 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:56.212627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 437/900] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:15:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:56.219540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa141127-e8af-4c30-92c6-0afde39ab14f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:56.330686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa141127-e8af-4c30-92c6-0afde39ab14f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:56.332781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:56.368608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a00cb-7481-4cb6-ae2b-4cbb33895678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:56.369219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a00cb-7481-4cb6-ae2b-4cbb33895678 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:56.369495 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a00cb-7481-4cb6-ae2b-4cbb33895678 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:56.369761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a00cb-7481-4cb6-ae2b-4cbb33895678 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:56.370569 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a00cb-7481-4cb6-ae2b-4cbb33895678 None admin] RBAC: Adding query filter params (interface=public, service_id=5d017d9a434f4f3dbc8f488f2fd1dc56, region_id=RegionOne) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:56.370877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a00cb-7481-4cb6-ae2b-4cbb33895678 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:56.372301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a00cb-7481-4cb6-ae2b-4cbb33895678 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:56.378128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 464/901] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Sep 12 23:15:56 2022] GET /identity/v3/endpoints?service_id=5d017d9a434f4f3dbc8f488f2fd1dc56&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:56.384293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee14283-499a-4b10-a63f-5b0a310e8b62 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:56.491870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee14283-499a-4b10-a63f-5b0a310e8b62 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:56.527708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a0bf1-fdc9-4fc7-9cd0-6d4be613b7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:56.529026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a0bf1-fdc9-4fc7-9cd0-6d4be613b7ec None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:56.529452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a0bf1-fdc9-4fc7-9cd0-6d4be613b7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:56.529878 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a0bf1-fdc9-4fc7-9cd0-6d4be613b7ec None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:56.531174 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a0bf1-fdc9-4fc7-9cd0-6d4be613b7ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:56.532696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a0bf1-fdc9-4fc7-9cd0-6d4be613b7ec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:56.539270 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 438/902] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Sep 12 23:15:56 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:15:56.758964 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a5cde-7a39-4c68-94af-410bdbb836e6 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:56.759459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a5cde-7a39-4c68-94af-410bdbb836e6 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:56.759459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a5cde-7a39-4c68-94af-410bdbb836e6 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:56.760986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 465/903] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:56.766783 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b941384-5e09-4151-94c3-1faaf4787b78 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:56.767064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b941384-5e09-4151-94c3-1faaf4787b78 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:56.767330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b941384-5e09-4151-94c3-1faaf4787b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:56.786757 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0b941384-5e09-4151-94c3-1faaf4787b78 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:56.787931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0b941384-5e09-4151-94c3-1faaf4787b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:56.836188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9ab9b-ea92-4394-9ce8-1210ee41be2d None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:56.836467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9ab9b-ea92-4394-9ce8-1210ee41be2d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:56.836743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9ab9b-ea92-4394-9ce8-1210ee41be2d None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:56.838221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 466/904] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:56.843548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21eb7b-2507-4f8e-8cfb-413f89ad515b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:56.843806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21eb7b-2507-4f8e-8cfb-413f89ad515b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:56.844088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21eb7b-2507-4f8e-8cfb-413f89ad515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:56.845587 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:56.863880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-4c21eb7b-2507-4f8e-8cfb-413f89ad515b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:56.864871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 439/905] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:56.865095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4c21eb7b-2507-4f8e-8cfb-413f89ad515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:56.941772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 467/906] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:57.135079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b941384-5e09-4151-94c3-1faaf4787b78 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:57.228186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21eb7b-2507-4f8e-8cfb-413f89ad515b None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:57.237909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b941384-5e09-4151-94c3-1faaf4787b78 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:57.274988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8566376-270e-42ae-a3db-cbabf8bf8afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:57.275736 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8566376-270e-42ae-a3db-cbabf8bf8afb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:57.276008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8566376-270e-42ae-a3db-cbabf8bf8afb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:57.276280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8566376-270e-42ae-a3db-cbabf8bf8afb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:57.276854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8566376-270e-42ae-a3db-cbabf8bf8afb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:57.278329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8566376-270e-42ae-a3db-cbabf8bf8afb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d8566376-270e-42ae-a3db-cbabf8bf8afb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:57.288806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:57.289928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:57.291454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 440/907] 10.222.0.33 () {56 vars in 1132 bytes} [Mon Sep 12 23:15:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:57.296069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8566376-270e-42ae-a3db-cbabf8bf8afb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:57.336117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:57.342205 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21eb7b-2507-4f8e-8cfb-413f89ad515b None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:57.356905 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:57.392287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cb023-15d9-456b-b55b-cba2cecc3515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:57.393139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb023-15d9-456b-b55b-cba2cecc3515 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:57.393581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb023-15d9-456b-b55b-cba2cecc3515 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:57.394006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb023-15d9-456b-b55b-cba2cecc3515 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:57.394915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cb023-15d9-456b-b55b-cba2cecc3515 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:57.396572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cb023-15d9-456b-b55b-cba2cecc3515 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:57.414731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 468/908] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:15:57 2022] POST /identity/v3/services => generated 241 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:15:57.422232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8566376-270e-42ae-a3db-cbabf8bf8afb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:57.473794 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbfab0-46db-4d0d-ba79-1723847391bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:57.474862 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbfab0-46db-4d0d-ba79-1723847391bc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:57.475417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbfab0-46db-4d0d-ba79-1723847391bc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:57.475945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbfab0-46db-4d0d-ba79-1723847391bc None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:57.476822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbfab0-46db-4d0d-ba79-1723847391bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:57.477336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbfab0-46db-4d0d-ba79-1723847391bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:57.479034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbfab0-46db-4d0d-ba79-1723847391bc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:57.485594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 441/909] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Sep 12 23:15:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:57.491087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cb023-15d9-456b-b55b-cba2cecc3515 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:57.613063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cb023-15d9-456b-b55b-cba2cecc3515 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:57.649467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61114d7e-754e-4e9a-a6f0-517840e0c71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:57.650470 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114d7e-754e-4e9a-a6f0-517840e0c71b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:57.650966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114d7e-754e-4e9a-a6f0-517840e0c71b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:57.651443 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114d7e-754e-4e9a-a6f0-517840e0c71b None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:57.652286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61114d7e-754e-4e9a-a6f0-517840e0c71b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:57.652785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61114d7e-754e-4e9a-a6f0-517840e0c71b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:57.654343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61114d7e-754e-4e9a-a6f0-517840e0c71b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:57.661027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 469/910] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Sep 12 23:15:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:15:57.666876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbfab0-46db-4d0d-ba79-1723847391bc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:57.773118 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbfab0-46db-4d0d-ba79-1723847391bc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:57.786893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:57.810238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656eeb2-b079-41b3-abae-c4867579b6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:57.810875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656eeb2-b079-41b3-abae-c4867579b6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:57.811151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656eeb2-b079-41b3-abae-c4867579b6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:57.811419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656eeb2-b079-41b3-abae-c4867579b6a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:57.812218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656eeb2-b079-41b3-abae-c4867579b6a3 None admin] RBAC: Adding query filter params (interface=public, service_id=96edf3e4b67949f6b38b0c77c74e9f1c, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:57.812524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656eeb2-b079-41b3-abae-c4867579b6a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:57.813896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656eeb2-b079-41b3-abae-c4867579b6a3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:57.821918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 442/911] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Sep 12 23:15:57 2022] GET /identity/v3/endpoints?service_id=96edf3e4b67949f6b38b0c77c74e9f1c&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:57.828178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61114d7e-754e-4e9a-a6f0-517840e0c71b None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:57.850890 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:57.941332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61114d7e-754e-4e9a-a6f0-517840e0c71b None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:57.976968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022056c7-7050-483b-9492-4585d0f541c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:57.977570 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022056c7-7050-483b-9492-4585d0f541c8 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:57.977841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022056c7-7050-483b-9492-4585d0f541c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:57.978107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022056c7-7050-483b-9492-4585d0f541c8 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:57.978738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022056c7-7050-483b-9492-4585d0f541c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:57.980091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022056c7-7050-483b-9492-4585d0f541c8 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:57.986799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 470/912] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Sep 12 23:15:57 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:15:58.446243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c27e2d-358f-4be5-ad26-4fe50f123d04 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:58.446935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c27e2d-358f-4be5-ad26-4fe50f123d04 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:58.447405 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c27e2d-358f-4be5-ad26-4fe50f123d04 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:58.449475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 443/913] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:58.456945 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b44902-e018-46c8-833a-0e767748bcfb None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:58.457507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b44902-e018-46c8-833a-0e767748bcfb None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:58.457985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b44902-e018-46c8-833a-0e767748bcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:58.480841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c4b44902-e018-46c8-833a-0e767748bcfb None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:58.482906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c4b44902-e018-46c8-833a-0e767748bcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:58.555175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 471/914] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:15:58.830449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c27e2d-358f-4be5-ad26-4fe50f123d04 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:58.872758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f5f34-50ba-47fe-995e-dbd07a771f80 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:58.873389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f5f34-50ba-47fe-995e-dbd07a771f80 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:58.873389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f5f34-50ba-47fe-995e-dbd07a771f80 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:58.878692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 472/915] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:58.880011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e2ac5-25b8-4451-8455-72cc4da38407 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:58.880292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e2ac5-25b8-4451-8455-72cc4da38407 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:58.880562 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e2ac5-25b8-4451-8455-72cc4da38407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:58.899359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-1b4e2ac5-25b8-4451-8455-72cc4da38407 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:58.900574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-1b4e2ac5-25b8-4451-8455-72cc4da38407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:58.911970 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:58.963921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c27e2d-358f-4be5-ad26-4fe50f123d04 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:58.990533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 473/916] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:59.004436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31400c7b-fda5-42b2-a539-296bae8b7daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:59.005122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31400c7b-fda5-42b2-a539-296bae8b7daa None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:59.005399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31400c7b-fda5-42b2-a539-296bae8b7daa None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:59.005666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31400c7b-fda5-42b2-a539-296bae8b7daa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:59.017148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31400c7b-fda5-42b2-a539-296bae8b7daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-31400c7b-fda5-42b2-a539-296bae8b7daa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:15:59.022038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:59.023317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:59.024582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 444/917] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Sep 12 23:15:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:59.029686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e2ac5-25b8-4451-8455-72cc4da38407 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:59.137322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e2ac5-25b8-4451-8455-72cc4da38407 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:59.175496 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f8440-2320-4e59-afa3-eee32194bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:59.176103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f8440-2320-4e59-afa3-eee32194bc45 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:59.176377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f8440-2320-4e59-afa3-eee32194bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:59.176642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f8440-2320-4e59-afa3-eee32194bc45 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:59.177450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f8440-2320-4e59-afa3-eee32194bc45 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:59.177792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f8440-2320-4e59-afa3-eee32194bc45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:59.179180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f8440-2320-4e59-afa3-eee32194bc45 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:59.188829 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 474/918] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Sep 12 23:15:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:59.194442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31400c7b-fda5-42b2-a539-296bae8b7daa None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:59.232499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:59.289479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f8440-2320-4e59-afa3-eee32194bc45 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:59.299395 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:59.306742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31400c7b-fda5-42b2-a539-296bae8b7daa None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:59.344943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d89ce-e4c3-42f4-b713-8d27bc6cefb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:59.345932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d89ce-e4c3-42f4-b713-8d27bc6cefb0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:59.346264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d89ce-e4c3-42f4-b713-8d27bc6cefb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:59.346567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d89ce-e4c3-42f4-b713-8d27bc6cefb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:59.363313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d89ce-e4c3-42f4-b713-8d27bc6cefb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:59.365573 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d89ce-e4c3-42f4-b713-8d27bc6cefb0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ac8d89ce-e4c3-42f4-b713-8d27bc6cefb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:15:59.382227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:59.384172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:15:59.385827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:15:59.385827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:15:59.385827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:59.385827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 445/919] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:15:59.392800 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d89ce-e4c3-42f4-b713-8d27bc6cefb0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:59.421974 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f8440-2320-4e59-afa3-eee32194bc45 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:59.460450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ce491-e5c6-4f80-9838-c80d66b27f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:59.461526 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ce491-e5c6-4f80-9838-c80d66b27f47 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:59.462143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ce491-e5c6-4f80-9838-c80d66b27f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:59.462666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ce491-e5c6-4f80-9838-c80d66b27f47 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:59.463456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ce491-e5c6-4f80-9838-c80d66b27f47 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:59.465115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ce491-e5c6-4f80-9838-c80d66b27f47 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-999ce491-e5c6-4f80-9838-c80d66b27f47 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:59.475691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:59.476713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:15:59.477565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:15:59.485607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 475/920] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:15:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:59.486239 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:59.487665 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ce491-e5c6-4f80-9838-c80d66b27f47 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:59.498487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d89ce-e4c3-42f4-b713-8d27bc6cefb0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:59.537498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf31763-0782-4d9c-8415-a609b9c52262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:59.538141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf31763-0782-4d9c-8415-a609b9c52262 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:59.538453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf31763-0782-4d9c-8415-a609b9c52262 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:59.538725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf31763-0782-4d9c-8415-a609b9c52262 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:59.539365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf31763-0782-4d9c-8415-a609b9c52262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:59.539660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf31763-0782-4d9c-8415-a609b9c52262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:59.541469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf31763-0782-4d9c-8415-a609b9c52262 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:59.558051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 446/921] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:59.559106 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf31763-0782-4d9c-8415-a609b9c52262 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:59.579720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:59.624832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ce491-e5c6-4f80-9838-c80d66b27f47 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:59.667012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d63a87-13c8-4574-8530-86b7c24381e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:59.667531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d63a87-13c8-4574-8530-86b7c24381e5 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:59.667807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d63a87-13c8-4574-8530-86b7c24381e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:59.668077 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d63a87-13c8-4574-8530-86b7c24381e5 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:59.668706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d63a87-13c8-4574-8530-86b7c24381e5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:59.669009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d63a87-13c8-4574-8530-86b7c24381e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:59.670396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d63a87-13c8-4574-8530-86b7c24381e5 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:59.676239 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 476/922] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:15:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:59.677380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ef54f-5685-4c40-9ed6-3a7fdd27dc21 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:59.677660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ef54f-5685-4c40-9ed6-3a7fdd27dc21 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:59.677931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ef54f-5685-4c40-9ed6-3a7fdd27dc21 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:59.681362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf31763-0782-4d9c-8415-a609b9c52262 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:59.683309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 477/923] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:15:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:15:59.684087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ef54f-5685-4c40-9ed6-3a7fdd27dc21 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:59.721700 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7afb3-89d7-44ad-9185-2d1f3396c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:59.722329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7afb3-89d7-44ad-9185-2d1f3396c230 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:59.722658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7afb3-89d7-44ad-9185-2d1f3396c230 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:59.722924 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7afb3-89d7-44ad-9185-2d1f3396c230 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:59.730122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7afb3-89d7-44ad-9185-2d1f3396c230 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:59.731605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7afb3-89d7-44ad-9185-2d1f3396c230 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-8ed7afb3-89d7-44ad-9185-2d1f3396c230 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:15:59.743451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:15:59.744411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:15:59.745347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:15:59.745347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:15:59.745347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:15:59.745347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:15:59.745347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:15:59.745347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:15:59.745347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:15:59.745347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:15:59.745347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:15:59.745347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:15:59.745347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 447/924] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Sep 12 23:15:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:15:59.746586 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5727-c72f-444a-9801-5fd374b8543a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:59.746586 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5727-c72f-444a-9801-5fd374b8543a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:59.746586 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5727-c72f-444a-9801-5fd374b8543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:59.770008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2b8f5727-c72f-444a-9801-5fd374b8543a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:15:59.771245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2b8f5727-c72f-444a-9801-5fd374b8543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:15:59.773835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:59.801693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ef54f-5685-4c40-9ed6-3a7fdd27dc21 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:59.836778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a3bb-5e17-403a-953c-d9cfad811036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:59.837408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a3bb-5e17-403a-953c-d9cfad811036 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:59.837658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a3bb-5e17-403a-953c-d9cfad811036 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:15:59.837928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a3bb-5e17-403a-953c-d9cfad811036 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:15:59.838588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765a3bb-5e17-403a-953c-d9cfad811036 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:15:59.838988 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765a3bb-5e17-403a-953c-d9cfad811036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:15:59.840396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765a3bb-5e17-403a-953c-d9cfad811036 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:15:59.841902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:15:59.847185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 478/925] 10.222.0.33 () {56 vars in 1114 bytes} [Mon Sep 12 23:15:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:15:59.848011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a3bb-5e17-403a-953c-d9cfad811036 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:59.853363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 448/926] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:15:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:15:59.854066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f5727-c72f-444a-9801-5fd374b8543a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:15:59.960388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f5727-c72f-444a-9801-5fd374b8543a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:59.973862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a3bb-5e17-403a-953c-d9cfad811036 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:15:59.998051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7371-3708-4150-b00c-7ec3e4a42865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:15:59.999173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7371-3708-4150-b00c-7ec3e4a42865 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:15:59.999650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7371-3708-4150-b00c-7ec3e4a42865 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:00.000114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7371-3708-4150-b00c-7ec3e4a42865 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:00.000998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d7371-3708-4150-b00c-7ec3e4a42865 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:00.002585 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d7371-3708-4150-b00c-7ec3e4a42865 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:00.011520 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:00.013961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d54628-8902-49fb-b47d-4d3f08254d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:00.014281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d54628-8902-49fb-b47d-4d3f08254d78 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:00.015238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d54628-8902-49fb-b47d-4d3f08254d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:00.015834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d54628-8902-49fb-b47d-4d3f08254d78 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:00.016978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d54628-8902-49fb-b47d-4d3f08254d78 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:00.017541 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d54628-8902-49fb-b47d-4d3f08254d78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:00.019478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d54628-8902-49fb-b47d-4d3f08254d78 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:00.029120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 449/927] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:15:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:16:00.051808 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 479/928] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Sep 12 23:15:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:00.057321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7371-3708-4150-b00c-7ec3e4a42865 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:00.123640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d54628-8902-49fb-b47d-4d3f08254d78 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:00.197674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7371-3708-4150-b00c-7ec3e4a42865 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:00.200181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:00.247202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb1c51-1b7d-4cde-aab2-69caf4f88800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:00.247847 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb1c51-1b7d-4cde-aab2-69caf4f88800 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:00.248129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb1c51-1b7d-4cde-aab2-69caf4f88800 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:00.248404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb1c51-1b7d-4cde-aab2-69caf4f88800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:00.261616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb1c51-1b7d-4cde-aab2-69caf4f88800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:00.262986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d54628-8902-49fb-b47d-4d3f08254d78 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:00.263103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb1c51-1b7d-4cde-aab2-69caf4f88800 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-55bb1c51-1b7d-4cde-aab2-69caf4f88800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:16:00.280941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:00.282121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:16:00.283346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:16:00.283346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:00.283346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:00.285213 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 450/929] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:00.286705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95c2f-6a6e-4674-b720-a3814c3b0793 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:00.287174 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95c2f-6a6e-4674-b720-a3814c3b0793 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:00.287451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95c2f-6a6e-4674-b720-a3814c3b0793 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:00.288829 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 451/930] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:00.293832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95c2f-6a6e-4674-b720-a3814c3b0793 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:00.304075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d38dd1-e2e2-40d3-a94b-f24f886e916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:00.304760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d38dd1-e2e2-40d3-a94b-f24f886e916b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:00.305166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d38dd1-e2e2-40d3-a94b-f24f886e916b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:00.305442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d38dd1-e2e2-40d3-a94b-f24f886e916b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:00.306024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d38dd1-e2e2-40d3-a94b-f24f886e916b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:00.307556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d38dd1-e2e2-40d3-a94b-f24f886e916b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-c4d38dd1-e2e2-40d3-a94b-f24f886e916b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:00.318224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:00.319248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:00.320078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 480/931] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Sep 12 23:16:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:00.320896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad37496-b86b-4ef5-b4ba-3f3323f1d220 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:00.320896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad37496-b86b-4ef5-b4ba-3f3323f1d220 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:00.321509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad37496-b86b-4ef5-b4ba-3f3323f1d220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:00.340033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-4ad37496-b86b-4ef5-b4ba-3f3323f1d220 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:00.341254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4ad37496-b86b-4ef5-b4ba-3f3323f1d220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:00.347751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:00.417556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 481/932] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:00.418838 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad37496-b86b-4ef5-b4ba-3f3323f1d220 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:00.434758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95c2f-6a6e-4674-b720-a3814c3b0793 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:00.479604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714a2d8-38ab-4884-bd92-ae6ffd3f9357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:00.480867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714a2d8-38ab-4884-bd92-ae6ffd3f9357 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:00.481704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:00.482533 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714a2d8-38ab-4884-bd92-ae6ffd3f9357 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:00.483014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714a2d8-38ab-4884-bd92-ae6ffd3f9357 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:00.484682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714a2d8-38ab-4884-bd92-ae6ffd3f9357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:00.485253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714a2d8-38ab-4884-bd92-ae6ffd3f9357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:00.487590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714a2d8-38ab-4884-bd92-ae6ffd3f9357 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:00.505580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 452/933] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:00.518437 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714a2d8-38ab-4884-bd92-ae6ffd3f9357 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:00.543683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad37496-b86b-4ef5-b4ba-3f3323f1d220 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:00.593507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e82919-aa30-4c38-b7b3-d6f118beae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:00.594321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e82919-aa30-4c38-b7b3-d6f118beae3f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:00.594639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e82919-aa30-4c38-b7b3-d6f118beae3f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:00.594908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e82919-aa30-4c38-b7b3-d6f118beae3f None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:00.595795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e82919-aa30-4c38-b7b3-d6f118beae3f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:00.596095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e82919-aa30-4c38-b7b3-d6f118beae3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:00.598153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e82919-aa30-4c38-b7b3-d6f118beae3f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:00.603445 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 482/934] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Sep 12 23:16:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:00.608969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e82919-aa30-4c38-b7b3-d6f118beae3f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:00.641721 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714a2d8-38ab-4884-bd92-ae6ffd3f9357 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:00.643355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:00.681351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ca648-273f-4794-8ea9-f4342014af2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:00.682221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ca648-273f-4794-8ea9-f4342014af2d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:00.682699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ca648-273f-4794-8ea9-f4342014af2d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:00.683106 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ca648-273f-4794-8ea9-f4342014af2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:00.692547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ca648-273f-4794-8ea9-f4342014af2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:00.694332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ca648-273f-4794-8ea9-f4342014af2d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fe8ca648-273f-4794-8ea9-f4342014af2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:16:00.707854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:00.708770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:00.709664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:16:00.709664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:16:00.709664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:16:00.709664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:16:00.709664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:16:00.709664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:16:00.709664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:16:00.709664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:00.709664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 453/935] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:00.714244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ca648-273f-4794-8ea9-f4342014af2d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:00.718976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e82919-aa30-4c38-b7b3-d6f118beae3f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:00.736889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:00.760328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f68411-f4df-44b0-b04a-31a613c65a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:00.760850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f68411-f4df-44b0-b04a-31a613c65a1f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:00.761126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f68411-f4df-44b0-b04a-31a613c65a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:00.761398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f68411-f4df-44b0-b04a-31a613c65a1f None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:00.762030 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f68411-f4df-44b0-b04a-31a613c65a1f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:00.762339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f68411-f4df-44b0-b04a-31a613c65a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:00.763733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f68411-f4df-44b0-b04a-31a613c65a1f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:00.769095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 483/936] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Sep 12 23:16:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:00.774485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f68411-f4df-44b0-b04a-31a613c65a1f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:00.822918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ca648-273f-4794-8ea9-f4342014af2d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:00.859466 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c3cdb-44ad-4cdd-9d95-46722ae0a88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:00.860125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c3cdb-44ad-4cdd-9d95-46722ae0a88f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:00.860373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c3cdb-44ad-4cdd-9d95-46722ae0a88f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:00.860648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c3cdb-44ad-4cdd-9d95-46722ae0a88f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:00.861233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c3cdb-44ad-4cdd-9d95-46722ae0a88f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:00.862709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c3cdb-44ad-4cdd-9d95-46722ae0a88f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-693c3cdb-44ad-4cdd-9d95-46722ae0a88f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:00.871622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:00.872561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:00.873445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 454/937] 10.222.0.33 () {56 vars in 1132 bytes} [Mon Sep 12 23:16:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:00.875275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c3cdb-44ad-4cdd-9d95-46722ae0a88f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:00.891029 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f68411-f4df-44b0-b04a-31a613c65a1f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:00.908778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:00.930461 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c355a-9939-4ef7-b72c-0d114f176622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:00.931126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c355a-9939-4ef7-b72c-0d114f176622 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:00.931408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c355a-9939-4ef7-b72c-0d114f176622 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:00.931687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c355a-9939-4ef7-b72c-0d114f176622 None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:00.932376 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c355a-9939-4ef7-b72c-0d114f176622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:00.932678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c355a-9939-4ef7-b72c-0d114f176622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:00.934104 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c355a-9939-4ef7-b72c-0d114f176622 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:00.951584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 484/938] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:00.951584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c355a-9939-4ef7-b72c-0d114f176622 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:00.989014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c3cdb-44ad-4cdd-9d95-46722ae0a88f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:00.991442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:01.028279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0804e-7028-4c07-aabe-8ee47576eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:01.028838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0804e-7028-4c07-aabe-8ee47576eee0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:01.029113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0804e-7028-4c07-aabe-8ee47576eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:01.029380 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0804e-7028-4c07-aabe-8ee47576eee0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:01.030076 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0804e-7028-4c07-aabe-8ee47576eee0 None admin] RBAC: Adding query filter params (interface=public, service_id=e6916cca33b84ccca278e452cae733f6, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:01.030972 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0804e-7028-4c07-aabe-8ee47576eee0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:01.032334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0804e-7028-4c07-aabe-8ee47576eee0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:01.042077 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 455/939] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Sep 12 23:16:00 2022] GET /identity/v3/endpoints?service_id=e6916cca33b84ccca278e452cae733f6&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:01.042077 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0804e-7028-4c07-aabe-8ee47576eee0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:01.062812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c355a-9939-4ef7-b72c-0d114f176622 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:01.098736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f255f-77dd-4dce-b940-a76d5a5f8e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:01.099345 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f255f-77dd-4dce-b940-a76d5a5f8e32 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:01.099622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f255f-77dd-4dce-b940-a76d5a5f8e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:01.099963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f255f-77dd-4dce-b940-a76d5a5f8e32 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:01.100516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f255f-77dd-4dce-b940-a76d5a5f8e32 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:01.100819 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f255f-77dd-4dce-b940-a76d5a5f8e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:01.102168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f255f-77dd-4dce-b940-a76d5a5f8e32 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:01.111728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 485/940] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Sep 12 23:16:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:01.111728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f255f-77dd-4dce-b940-a76d5a5f8e32 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:01.141942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:01.153616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0804e-7028-4c07-aabe-8ee47576eee0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:01.192273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef817de-d3c2-4dd7-8846-1aa5193145ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:01.193336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef817de-d3c2-4dd7-8846-1aa5193145ac None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:01.193636 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef817de-d3c2-4dd7-8846-1aa5193145ac None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:01.193918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef817de-d3c2-4dd7-8846-1aa5193145ac None admin] PATH_INFO: `/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/f66201e006624a69811e7c613702125e/roles/cc4e7138f6854039a5bf03f9538bb90d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:01.196768 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef817de-d3c2-4dd7-8846-1aa5193145ac None admin] RBAC: Authorizing `identity:create_grant(project_id=fd655924cf9a4736ba38740ade63ec52, user_id=f66201e006624a69811e7c613702125e, role_id=cc4e7138f6854039a5bf03f9538bb90d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:01.198528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef817de-d3c2-4dd7-8846-1aa5193145ac None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:01.215661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 456/941] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:16:01 2022] PUT /identity/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/f66201e006624a69811e7c613702125e/roles/cc4e7138f6854039a5bf03f9538bb90d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:16:01.216783 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef817de-d3c2-4dd7-8846-1aa5193145ac None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:01.232165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f255f-77dd-4dce-b940-a76d5a5f8e32 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:01.234650 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:01.288887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3b71f-3e7c-40f6-8edf-f55089dccd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:01.289932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3b71f-3e7c-40f6-8edf-f55089dccd79 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:01.290411 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3b71f-3e7c-40f6-8edf-f55089dccd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:01.291258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3b71f-3e7c-40f6-8edf-f55089dccd79 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:01.291890 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3b71f-3e7c-40f6-8edf-f55089dccd79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:01.293326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3b71f-3e7c-40f6-8edf-f55089dccd79 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:01.306606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 486/942] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Sep 12 23:16:01 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:16:01.359225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef817de-d3c2-4dd7-8846-1aa5193145ac None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:01.422812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3386a8d-8d05-4d03-8152-8f073a9acd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:01.423505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3386a8d-8d05-4d03-8152-8f073a9acd11 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:01.423856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3386a8d-8d05-4d03-8152-8f073a9acd11 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:01.424132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3386a8d-8d05-4d03-8152-8f073a9acd11 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:01.424784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3386a8d-8d05-4d03-8152-8f073a9acd11 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:01.425091 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3386a8d-8d05-4d03-8152-8f073a9acd11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:01.426584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3386a8d-8d05-4d03-8152-8f073a9acd11 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:01.432321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 457/943] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Sep 12 23:16:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:01.438828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3b71f-3e7c-40f6-8edf-f55089dccd79 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:01.555994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3b71f-3e7c-40f6-8edf-f55089dccd79 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:01.591937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a9d0c-ca45-4135-ae8f-d534e15adf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:01.592546 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a9d0c-ca45-4135-ae8f-d534e15adf0d None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:01.592887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a9d0c-ca45-4135-ae8f-d534e15adf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:01.593163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a9d0c-ca45-4135-ae8f-d534e15adf0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:01.593831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a9d0c-ca45-4135-ae8f-d534e15adf0d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:01.595229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a9d0c-ca45-4135-ae8f-d534e15adf0d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:01.625149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 487/944] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:16:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:16:02.362995 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cfba6-218f-45b0-a797-21542628860f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:02.363967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cfba6-218f-45b0-a797-21542628860f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:02.364478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cfba6-218f-45b0-a797-21542628860f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:02.366223 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 458/945] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:02.371853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e35e4-b243-43b5-b48e-0c4217f7bc73 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:02.372631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e35e4-b243-43b5-b48e-0c4217f7bc73 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:02.373115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e35e4-b243-43b5-b48e-0c4217f7bc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:02.403193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b28e35e4-b243-43b5-b48e-0c4217f7bc73 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:02.404667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b28e35e4-b243-43b5-b48e-0c4217f7bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:02.422698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:02.481588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 488/946] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:16:02.753549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cfba6-218f-45b0-a797-21542628860f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:02.769902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:02.864310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cfba6-218f-45b0-a797-21542628860f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:02.900157 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffc2e8-de7c-4058-a6b4-5b3ffb4432b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:02.901118 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffc2e8-de7c-4058-a6b4-5b3ffb4432b6 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:02.901599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffc2e8-de7c-4058-a6b4-5b3ffb4432b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:02.902090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffc2e8-de7c-4058-a6b4-5b3ffb4432b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:02.902985 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffc2e8-de7c-4058-a6b4-5b3ffb4432b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:02.904624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffc2e8-de7c-4058-a6b4-5b3ffb4432b6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:02.907556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: WARNING keystone.server.flask.common [None req-fbffc2e8-de7c-4058-a6b4-5b3ffb4432b6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 12 23:16:02.927565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.sql.core [None req-fbffc2e8-de7c-4058-a6b4-5b3ffb4432b6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 12 23:16:02.927565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 12 23:16:02.927565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [parameters: {'id': 'e2aba784e98f4252ae67d5958463ab1a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 12 23:16:02.927565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81386) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fbffc2e8-de7c-4058-a6b4-5b3ffb4432b6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e2aba784e98f4252ae67d5958463ab1a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e2aba784e98f4252ae67d5958463ab1a. Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 23:16:02.946291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 12 23:16:02.947165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application yield resource Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.rollback() Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.force_reraise() Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise self.value Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application session.commit() Sep 12 23:16:02.948126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._prepare_impl() Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.flush() Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._flush(objects) Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application compat.raise_( Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application flush_context.execute() Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 12 23:16:02.949009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rec.execute(self) Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 12 23:16:02.949890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 23:16:02.952665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [parameters: {'id': 'e2aba784e98f4252ae67d5958463ab1a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:02.953544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:02.954769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:02.956874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:02.956874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 12 23:16:02.956874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 12 23:16:02.956874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:02.956874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:02.956874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 12 23:16:02.956874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 12 23:16:02.956874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e2aba784e98f4252ae67d5958463ab1a. Sep 12 23:16:02.956874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:02.959780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 459/947] 10.222.0.33 () {60 vars in 1140 bytes} [Mon Sep 12 23:16:02 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:02.966416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e35e4-b243-43b5-b48e-0c4217f7bc73 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:03.071582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e35e4-b243-43b5-b48e-0c4217f7bc73 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:03.107507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5769c7-bf57-4f82-a39c-e99e4c3d5b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:03.108649 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5769c7-bf57-4f82-a39c-e99e4c3d5b81 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:03.108944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5769c7-bf57-4f82-a39c-e99e4c3d5b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:03.109218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5769c7-bf57-4f82-a39c-e99e4c3d5b81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:03.116387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5769c7-bf57-4f82-a39c-e99e4c3d5b81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:03.117850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5769c7-bf57-4f82-a39c-e99e4c3d5b81 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-3e5769c7-bf57-4f82-a39c-e99e4c3d5b81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:16:03.129864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:03.130804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:03.131663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:16:03.131663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:16:03.131663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:16:03.131663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:16:03.131663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:16:03.131663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:16:03.131663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:16:03.131663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:03.134568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 489/948] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:16:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:03.137458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffc2e8-de7c-4058-a6b4-5b3ffb4432b6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:03.212606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:03.250727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffc2e8-de7c-4058-a6b4-5b3ffb4432b6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:03.289861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd787cf-b158-4fe1-aad9-2cc42b2a0671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:03.291133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd787cf-b158-4fe1-aad9-2cc42b2a0671 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:03.291670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd787cf-b158-4fe1-aad9-2cc42b2a0671 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:03.292136 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd787cf-b158-4fe1-aad9-2cc42b2a0671 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:03.292988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd787cf-b158-4fe1-aad9-2cc42b2a0671 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:03.293507 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd787cf-b158-4fe1-aad9-2cc42b2a0671 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:03.295398 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd787cf-b158-4fe1-aad9-2cc42b2a0671 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:03.316887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 460/949] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:16:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:03.520304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4363e93-85f4-42d2-9320-0b8a429c331b None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:03.520862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4363e93-85f4-42d2-9320-0b8a429c331b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:03.520862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4363e93-85f4-42d2-9320-0b8a429c331b None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:03.522516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 490/950] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:03.528396 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f25b6-71db-442c-bfee-baea6718588f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:03.528914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f25b6-71db-442c-bfee-baea6718588f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:03.529106 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f25b6-71db-442c-bfee-baea6718588f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:03.550034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ca9f25b6-71db-442c-bfee-baea6718588f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:03.551611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ca9f25b6-71db-442c-bfee-baea6718588f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:03.623727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 461/951] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:03.635846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ebc6-9102-44ef-8b93-39f6ff136c80 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:03.636099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ebc6-9102-44ef-8b93-39f6ff136c80 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:03.636322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ebc6-9102-44ef-8b93-39f6ff136c80 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:03.637876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 491/952] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:03.643885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e8992-1f74-4339-b5ed-97d9717261e2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:03.644174 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e8992-1f74-4339-b5ed-97d9717261e2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:03.644477 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e8992-1f74-4339-b5ed-97d9717261e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:03.662986 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6c4e8992-1f74-4339-b5ed-97d9717261e2 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:03.664159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6c4e8992-1f74-4339-b5ed-97d9717261e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:03.726314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:03.739102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 462/953] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:03.891536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f865003-7587-4b20-9e80-57b08933a27c None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:03.891730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f865003-7587-4b20-9e80-57b08933a27c None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:03.891991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f865003-7587-4b20-9e80-57b08933a27c None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:03.893457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 492/954] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:16:03.898810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8893888-d8c3-43d8-af88-2a96202d03be None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:03.899326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8893888-d8c3-43d8-af88-2a96202d03be None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:03.899795 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8893888-d8c3-43d8-af88-2a96202d03be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:03.905653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f865003-7587-4b20-9e80-57b08933a27c None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:03.918733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:03.922119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a8893888-d8c3-43d8-af88-2a96202d03be None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:03.923398 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a8893888-d8c3-43d8-af88-2a96202d03be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:04.016045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 463/955] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:04.024935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8893888-d8c3-43d8-af88-2a96202d03be None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:04.025714 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f865003-7587-4b20-9e80-57b08933a27c None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:04.074074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf98ca-1f48-4cbc-a61b-c19afa0903ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:04.075307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf98ca-1f48-4cbc-a61b-c19afa0903ba None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:04.076214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf98ca-1f48-4cbc-a61b-c19afa0903ba None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:04.076831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf98ca-1f48-4cbc-a61b-c19afa0903ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:04.091753 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf98ca-1f48-4cbc-a61b-c19afa0903ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-97cf98ca-1f48-4cbc-a61b-c19afa0903ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:16:04.098509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:04.099667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:04.100549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:04.100549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:04.100549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:04.100549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:04.100549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:16:04.100549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:16:04.100549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:16:04.100549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:16:04.100549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:16:04.100549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:16:04.100549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:16:04.100549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:04.108395 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 493/956] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Sep 12 23:16:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:04.109584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf98ca-1f48-4cbc-a61b-c19afa0903ba None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:04.147818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8893888-d8c3-43d8-af88-2a96202d03be None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:04.177293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:04.187782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:04.199354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f281727-8ce6-4703-8049-e72e393d1dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:04.200672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f281727-8ce6-4703-8049-e72e393d1dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:04.201131 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f281727-8ce6-4703-8049-e72e393d1dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:04.201552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f281727-8ce6-4703-8049-e72e393d1dd6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:04.202989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f281727-8ce6-4703-8049-e72e393d1dd6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:04.204911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f281727-8ce6-4703-8049-e72e393d1dd6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9f281727-8ce6-4703-8049-e72e393d1dd6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:04.217349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:04.219467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:16:04.220335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:04.221835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 464/957] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Sep 12 23:16:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:04.225760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f281727-8ce6-4703-8049-e72e393d1dd6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:04.231439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf98ca-1f48-4cbc-a61b-c19afa0903ba None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:04.269075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966635e6-5cc6-48ff-b6ad-4fb47effb6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:04.269642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966635e6-5cc6-48ff-b6ad-4fb47effb6ad None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:04.269909 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966635e6-5cc6-48ff-b6ad-4fb47effb6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:04.270178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966635e6-5cc6-48ff-b6ad-4fb47effb6ad None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:04.270882 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966635e6-5cc6-48ff-b6ad-4fb47effb6ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:04.271183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966635e6-5cc6-48ff-b6ad-4fb47effb6ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:04.272610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966635e6-5cc6-48ff-b6ad-4fb47effb6ad None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:04.289758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 494/958] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Sep 12 23:16:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:04.291724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966635e6-5cc6-48ff-b6ad-4fb47effb6ad None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:04.354192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f281727-8ce6-4703-8049-e72e393d1dd6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:04.394696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e50b5d-5d93-4b34-8ba8-5567c967e36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:04.395431 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e50b5d-5d93-4b34-8ba8-5567c967e36b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:04.395704 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e50b5d-5d93-4b34-8ba8-5567c967e36b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:04.395975 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e50b5d-5d93-4b34-8ba8-5567c967e36b None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:04.396609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e50b5d-5d93-4b34-8ba8-5567c967e36b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:04.396908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e50b5d-5d93-4b34-8ba8-5567c967e36b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:04.398342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e50b5d-5d93-4b34-8ba8-5567c967e36b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:04.403131 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 465/959] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Sep 12 23:16:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:04.403761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966635e6-5cc6-48ff-b6ad-4fb47effb6ad None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:04.404299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e50b5d-5d93-4b34-8ba8-5567c967e36b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:04.441200 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:04.448498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf526-b59c-4680-ad9e-e2a03b6b8b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:04.449438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf526-b59c-4680-ad9e-e2a03b6b8b76 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:04.449890 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf526-b59c-4680-ad9e-e2a03b6b8b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:04.450131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf526-b59c-4680-ad9e-e2a03b6b8b76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:04.455360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:04.462107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bf526-b59c-4680-ad9e-e2a03b6b8b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:04.463719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bf526-b59c-4680-ad9e-e2a03b6b8b76 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-738bf526-b59c-4680-ad9e-e2a03b6b8b76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:16:04.478590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:04.479510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:16:04.480377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:16:04.480377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:04.480377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:04.480377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 495/960] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:04.480377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf526-b59c-4680-ad9e-e2a03b6b8b76 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:04.516063 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e50b5d-5d93-4b34-8ba8-5567c967e36b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:04.554001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b98e57-51d4-47eb-a175-c54a8faef636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:04.554664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b98e57-51d4-47eb-a175-c54a8faef636 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:04.554936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b98e57-51d4-47eb-a175-c54a8faef636 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:04.555207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b98e57-51d4-47eb-a175-c54a8faef636 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:04.555786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b98e57-51d4-47eb-a175-c54a8faef636 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:04.557350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b98e57-51d4-47eb-a175-c54a8faef636 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-35b98e57-51d4-47eb-a175-c54a8faef636 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:04.567443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:04.568449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:16:04.569289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:04.573562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 466/961] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:16:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:04.574569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b98e57-51d4-47eb-a175-c54a8faef636 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:04.583522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf526-b59c-4680-ad9e-e2a03b6b8b76 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:04.618294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1c0ce-19aa-4271-9fd5-3c1785c797f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:04.618926 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1c0ce-19aa-4271-9fd5-3c1785c797f2 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:04.619199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1c0ce-19aa-4271-9fd5-3c1785c797f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:04.619826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1c0ce-19aa-4271-9fd5-3c1785c797f2 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:04.620460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1c0ce-19aa-4271-9fd5-3c1785c797f2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:04.620755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1c0ce-19aa-4271-9fd5-3c1785c797f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:04.622429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1c0ce-19aa-4271-9fd5-3c1785c797f2 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:04.627734 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 496/962] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Sep 12 23:16:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:04.628535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1c0ce-19aa-4271-9fd5-3c1785c797f2 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:04.679418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:04.684549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b98e57-51d4-47eb-a175-c54a8faef636 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:04.699228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:04.723314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15e86a-b058-4e7c-8de4-b55a6ce82d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:04.723917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15e86a-b058-4e7c-8de4-b55a6ce82d2d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:04.724192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15e86a-b058-4e7c-8de4-b55a6ce82d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:04.724459 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15e86a-b058-4e7c-8de4-b55a6ce82d2d None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:04.725207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15e86a-b058-4e7c-8de4-b55a6ce82d2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:04.725512 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15e86a-b058-4e7c-8de4-b55a6ce82d2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:04.726907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15e86a-b058-4e7c-8de4-b55a6ce82d2d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:04.739508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 467/963] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:04.740368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15e86a-b058-4e7c-8de4-b55a6ce82d2d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:04.746591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1c0ce-19aa-4271-9fd5-3c1785c797f2 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:04.783728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a69575-4071-42e8-886e-9695de2637a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:04.784328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a69575-4071-42e8-886e-9695de2637a4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:04.784603 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a69575-4071-42e8-886e-9695de2637a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:04.784869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a69575-4071-42e8-886e-9695de2637a4 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:04.785488 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a69575-4071-42e8-886e-9695de2637a4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:04.785789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a69575-4071-42e8-886e-9695de2637a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:04.787171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a69575-4071-42e8-886e-9695de2637a4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:04.794459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 497/964] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:16:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:04.794459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a69575-4071-42e8-886e-9695de2637a4 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:04.849310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15e86a-b058-4e7c-8de4-b55a6ce82d2d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:04.882839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74ea03-cf25-44aa-8299-cfee62b28aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:04.883452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74ea03-cf25-44aa-8299-cfee62b28aea None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:04.883738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74ea03-cf25-44aa-8299-cfee62b28aea None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:04.884010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74ea03-cf25-44aa-8299-cfee62b28aea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:04.884675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74ea03-cf25-44aa-8299-cfee62b28aea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:04.886043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74ea03-cf25-44aa-8299-cfee62b28aea None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:04.903396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a69575-4071-42e8-886e-9695de2637a4 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:04.907454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 468/965] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:16:04 2022] POST /identity/v3/endpoints => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:16:04.907979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74ea03-cf25-44aa-8299-cfee62b28aea None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:04.927441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:04.944114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:04.977958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4c369-c372-458f-bae3-8a1c306089b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:04.979147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4c369-c372-458f-bae3-8a1c306089b2 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:04.979424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4c369-c372-458f-bae3-8a1c306089b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:04.979692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4c369-c372-458f-bae3-8a1c306089b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:04.990784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4c369-c372-458f-bae3-8a1c306089b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:04.992387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4c369-c372-458f-bae3-8a1c306089b2 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-5be4c369-c372-458f-bae3-8a1c306089b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:16:05.006591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:05.007614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:05.009028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:05.009028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:05.009028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:16:05.009028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:16:05.009028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:16:05.009028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:16:05.009028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:16:05.009028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:16:05.009028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:16:05.009028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:05.009028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 498/966] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Sep 12 23:16:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:05.013436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4c369-c372-458f-bae3-8a1c306089b2 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:05.051423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74ea03-cf25-44aa-8299-cfee62b28aea None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:05.102847 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32209c1e-65b3-41b9-915c-594bae4aab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:05.104278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32209c1e-65b3-41b9-915c-594bae4aab31 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:05.104566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32209c1e-65b3-41b9-915c-594bae4aab31 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:05.104845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32209c1e-65b3-41b9-915c-594bae4aab31 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:05.105484 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32209c1e-65b3-41b9-915c-594bae4aab31 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:05.105821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32209c1e-65b3-41b9-915c-594bae4aab31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:05.107918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32209c1e-65b3-41b9-915c-594bae4aab31 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:05.114867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 469/967] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:16:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:05.136034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4c369-c372-458f-bae3-8a1c306089b2 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:05.177112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b13aae-23e2-433d-9b94-c28096744217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:05.177750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b13aae-23e2-433d-9b94-c28096744217 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:05.178027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b13aae-23e2-433d-9b94-c28096744217 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:05.178295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b13aae-23e2-433d-9b94-c28096744217 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:05.179365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b13aae-23e2-433d-9b94-c28096744217 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:05.179365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b13aae-23e2-433d-9b94-c28096744217 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:05.180870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b13aae-23e2-433d-9b94-c28096744217 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:05.202439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 499/968] 10.222.0.33 () {56 vars in 1149 bytes} [Mon Sep 12 23:16:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:05.208055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32209c1e-65b3-41b9-915c-594bae4aab31 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:05.316797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:05.325888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32209c1e-65b3-41b9-915c-594bae4aab31 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:05.363829 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93927375-ead6-4e71-a7b4-4ba848d8d9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:05.364442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93927375-ead6-4e71-a7b4-4ba848d8d9bd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:05.364764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93927375-ead6-4e71-a7b4-4ba848d8d9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:05.365037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93927375-ead6-4e71-a7b4-4ba848d8d9bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:05.439958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93927375-ead6-4e71-a7b4-4ba848d8d9bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:05.441897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93927375-ead6-4e71-a7b4-4ba848d8d9bd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:05.543305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:05.554424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 470/969] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:16:05 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:16:05.560429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b13aae-23e2-433d-9b94-c28096744217 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:05.588365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:05.627450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1832e-c3e6-431c-bcec-c0b55ea08aab None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:05.628104 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1832e-c3e6-431c-bcec-c0b55ea08aab None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:05.628449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1832e-c3e6-431c-bcec-c0b55ea08aab None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:05.630124 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 471/970] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:16:05.635753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee984-e0e9-4633-913c-df193ab7cfd7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:05.636140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee984-e0e9-4633-913c-df193ab7cfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:05.636509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee984-e0e9-4633-913c-df193ab7cfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:05.661008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-003ee984-e0e9-4633-913c-df193ab7cfd7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:05.662650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-003ee984-e0e9-4633-913c-df193ab7cfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:05.679657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b13aae-23e2-433d-9b94-c28096744217 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:05.719591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1e0be-e674-4520-ac54-65abb1db8690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:05.720479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1e0be-e674-4520-ac54-65abb1db8690 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:05.720975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1e0be-e674-4520-ac54-65abb1db8690 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:05.721448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1e0be-e674-4520-ac54-65abb1db8690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:05.732686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1e0be-e674-4520-ac54-65abb1db8690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:05.735167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1e0be-e674-4520-ac54-65abb1db8690 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-f0f1e0be-e674-4520-ac54-65abb1db8690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:16:05.751090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:05.752055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:16:05.752929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:16:05.752929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:05.752929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:05.758788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 472/971] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:05.758933 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 500/972] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:05.761202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ee984-e0e9-4633-913c-df193ab7cfd7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:05.866363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ee984-e0e9-4633-913c-df193ab7cfd7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:05.893011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:05.906828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc325f-0ce3-48c6-bbc2-165893ff3b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:05.907454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc325f-0ce3-48c6-bbc2-165893ff3b70 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:05.907732 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc325f-0ce3-48c6-bbc2-165893ff3b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:05.908005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc325f-0ce3-48c6-bbc2-165893ff3b70 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:05.908656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc325f-0ce3-48c6-bbc2-165893ff3b70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:05.908959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc325f-0ce3-48c6-bbc2-165893ff3b70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:05.910340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc325f-0ce3-48c6-bbc2-165893ff3b70 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:05.923623 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 473/973] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:05.929078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1e0be-e674-4520-ac54-65abb1db8690 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:06.014123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:06.035153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc325f-0ce3-48c6-bbc2-165893ff3b70 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:06.038834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1e0be-e674-4520-ac54-65abb1db8690 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:06.075005 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad0c29-5b40-4dbe-8888-60a9a89e97b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:06.075983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad0c29-5b40-4dbe-8888-60a9a89e97b4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:06.076610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad0c29-5b40-4dbe-8888-60a9a89e97b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:06.077738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad0c29-5b40-4dbe-8888-60a9a89e97b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:06.086307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad0c29-5b40-4dbe-8888-60a9a89e97b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:06.088304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad0c29-5b40-4dbe-8888-60a9a89e97b4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-4aad0c29-5b40-4dbe-8888-60a9a89e97b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:16:06.104242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:06.105173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:06.106049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:16:06.106049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:16:06.106049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:16:06.106049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:16:06.106049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:16:06.106049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:16:06.106049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:16:06.106049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:06.109181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 501/974] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:16:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:06.114340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad0c29-5b40-4dbe-8888-60a9a89e97b4 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:06.156056 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc325f-0ce3-48c6-bbc2-165893ff3b70 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:06.197760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f137def-d991-4e60-a87b-51bd2b0d3f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:06.198420 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f137def-d991-4e60-a87b-51bd2b0d3f4e None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:06.198701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f137def-d991-4e60-a87b-51bd2b0d3f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:06.198969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f137def-d991-4e60-a87b-51bd2b0d3f4e None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:06.199901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f137def-d991-4e60-a87b-51bd2b0d3f4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:06.201499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f137def-d991-4e60-a87b-51bd2b0d3f4e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:06.220037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.sql.core [None req-0f137def-d991-4e60-a87b-51bd2b0d3f4e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 12 23:16:06.220037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 12 23:16:06.220037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [parameters: {'user_id': '69ca5ce340914dd185f96142f82a3259', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 12 23:16:06.220037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81386) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0f137def-d991-4e60-a87b-51bd2b0d3f4e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Sep 12 23:16:06.229534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 23:16:06.230490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application yield resource Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.rollback() Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.force_reraise() Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise self.value Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application session.commit() Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 12 23:16:06.231445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._prepare_impl() Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.flush() Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._flush(objects) Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application compat.raise_( Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application flush_context.execute() Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rec.execute(self) Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 12 23:16:06.232363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 23:16:06.233879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 23:16:06.240875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [parameters: {'user_id': '69ca5ce340914dd185f96142f82a3259', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:06.242992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 12 23:16:06.244962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 12 23:16:06.247409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 12 23:16:06.247409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 12 23:16:06.247409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 12 23:16:06.247409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 12 23:16:06.247409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 12 23:16:06.247409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:06.247409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 474/975] 10.222.0.33 () {60 vars in 1131 bytes} [Mon Sep 12 23:16:06 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:06.247409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f137def-d991-4e60-a87b-51bd2b0d3f4e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:06.248606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad0c29-5b40-4dbe-8888-60a9a89e97b4 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:06.286155 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cc523-e915-4d78-ba09-c5f347d0fa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:06.287293 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cc523-e915-4d78-ba09-c5f347d0fa7d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:06.287775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cc523-e915-4d78-ba09-c5f347d0fa7d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:06.288326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cc523-e915-4d78-ba09-c5f347d0fa7d None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:06.289287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cc523-e915-4d78-ba09-c5f347d0fa7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:06.289802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cc523-e915-4d78-ba09-c5f347d0fa7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:06.291733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cc523-e915-4d78-ba09-c5f347d0fa7d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:06.294638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:06.300281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:06.313529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 502/976] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:16:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:06.316143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cc523-e915-4d78-ba09-c5f347d0fa7d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:06.371683 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f137def-d991-4e60-a87b-51bd2b0d3f4e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:06.428966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fbe20-69cb-48b5-96db-2a478989e7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:06.430499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fbe20-69cb-48b5-96db-2a478989e7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:06.430984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fbe20-69cb-48b5-96db-2a478989e7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:06.431451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fbe20-69cb-48b5-96db-2a478989e7a0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:06.438872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cc523-e915-4d78-ba09-c5f347d0fa7d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:06.442508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fbe20-69cb-48b5-96db-2a478989e7a0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:06.444416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fbe20-69cb-48b5-96db-2a478989e7a0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b81fbe20-69cb-48b5-96db-2a478989e7a0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:16:06.458966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:06.459933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:06.460860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:06.460860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:06.460860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:16:06.460860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:16:06.460860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:16:06.460860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:16:06.460860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:16:06.460860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:16:06.460860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:16:06.460860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:06.468687 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 475/977] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:16:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:06.470372 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fbe20-69cb-48b5-96db-2a478989e7a0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:06.481856 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc93eef-4b57-44fc-bbe3-2306597a0383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:06.482547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc93eef-4b57-44fc-bbe3-2306597a0383 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:06.482825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc93eef-4b57-44fc-bbe3-2306597a0383 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:06.483640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc93eef-4b57-44fc-bbe3-2306597a0383 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:06.484377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc93eef-4b57-44fc-bbe3-2306597a0383 None admin] RBAC: Adding query filter params (role.id=cc4e7138f6854039a5bf03f9538bb90d, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=f66201e006624a69811e7c613702125e) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:06.484676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc93eef-4b57-44fc-bbe3-2306597a0383 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:06.486150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc93eef-4b57-44fc-bbe3-2306597a0383 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:06.497690 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 503/978] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:16:06 2022] GET /identity/v3/role_assignments?user.id=f66201e006624a69811e7c613702125e&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=cc4e7138f6854039a5bf03f9538bb90d => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:06.589825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fbe20-69cb-48b5-96db-2a478989e7a0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:06.593836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:06.630945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d40dc-e45f-40db-af82-63dfc7e6e656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:06.631575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d40dc-e45f-40db-af82-63dfc7e6e656 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:06.631857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d40dc-e45f-40db-af82-63dfc7e6e656 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:06.632134 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d40dc-e45f-40db-af82-63dfc7e6e656 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:06.632861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d40dc-e45f-40db-af82-63dfc7e6e656 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:06.633166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d40dc-e45f-40db-af82-63dfc7e6e656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:06.634672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d40dc-e45f-40db-af82-63dfc7e6e656 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:06.677665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 476/979] 10.222.0.33 () {56 vars in 1101 bytes} [Mon Sep 12 23:16:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:07.193272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851197-81b2-44fa-a9f6-6b3ce9ab59be None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:07.193792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851197-81b2-44fa-a9f6-6b3ce9ab59be None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:07.193792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851197-81b2-44fa-a9f6-6b3ce9ab59be None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:07.195176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 504/980] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:07.200479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1bc67-5313-405e-b817-58c1c9aaab5e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:07.200767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1bc67-5313-405e-b817-58c1c9aaab5e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:07.201038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1bc67-5313-405e-b817-58c1c9aaab5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:07.220615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f1d1bc67-5313-405e-b817-58c1c9aaab5e None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:07.222131 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f1d1bc67-5313-405e-b817-58c1c9aaab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:07.291550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 477/981] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:07.451131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1f774-6b3a-421b-8e2d-8bdc15861d02 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:07.451418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1f774-6b3a-421b-8e2d-8bdc15861d02 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:07.451591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1f774-6b3a-421b-8e2d-8bdc15861d02 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:07.453786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 505/982] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:07.460140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2b71-b024-4340-8a8c-37c52229d4bb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:07.460435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2b71-b024-4340-8a8c-37c52229d4bb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:07.460708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2b71-b024-4340-8a8c-37c52229d4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:07.479132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c41c2b71-b024-4340-8a8c-37c52229d4bb None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:07.480301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c41c2b71-b024-4340-8a8c-37c52229d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:07.547897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 478/983] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:07.569243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1f774-6b3a-421b-8e2d-8bdc15861d02 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:07.630851 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:07.675108 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1f774-6b3a-421b-8e2d-8bdc15861d02 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:07.708486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305656a-c3ad-4338-9acf-16904fa9177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:07.709034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305656a-c3ad-4338-9acf-16904fa9177c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:07.709309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305656a-c3ad-4338-9acf-16904fa9177c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:07.709581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305656a-c3ad-4338-9acf-16904fa9177c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:07.710152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305656a-c3ad-4338-9acf-16904fa9177c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:07.711576 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305656a-c3ad-4338-9acf-16904fa9177c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-7305656a-c3ad-4338-9acf-16904fa9177c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:07.721214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:07.722180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:16:07.723058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:07.726690 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 506/984] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Sep 12 23:16:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:07.728354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c2b71-b024-4340-8a8c-37c52229d4bb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:07.753613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:07.814093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305656a-c3ad-4338-9acf-16904fa9177c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:07.833865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c2b71-b024-4340-8a8c-37c52229d4bb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:07.869698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0594bdc-83f4-41bc-84fd-eafb98470b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:07.870312 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0594bdc-83f4-41bc-84fd-eafb98470b97 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:07.870622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0594bdc-83f4-41bc-84fd-eafb98470b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:07.870899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0594bdc-83f4-41bc-84fd-eafb98470b97 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:07.871529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0594bdc-83f4-41bc-84fd-eafb98470b97 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:07.871834 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0594bdc-83f4-41bc-84fd-eafb98470b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:07.873342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0594bdc-83f4-41bc-84fd-eafb98470b97 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:07.878766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 479/985] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Sep 12 23:16:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:07.884869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0594bdc-83f4-41bc-84fd-eafb98470b97 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:07.925541 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305656a-c3ad-4338-9acf-16904fa9177c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:07.949826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:07.962528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b88cab-5282-4f8d-bed8-6a03e954b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:07.963069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b88cab-5282-4f8d-bed8-6a03e954b8f8 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:07.963349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b88cab-5282-4f8d-bed8-6a03e954b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:07.963622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b88cab-5282-4f8d-bed8-6a03e954b8f8 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:07.964283 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b88cab-5282-4f8d-bed8-6a03e954b8f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:07.965648 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b88cab-5282-4f8d-bed8-6a03e954b8f8 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:07.976827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:07.982637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 507/986] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:16:07 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:16:07.997048 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0594bdc-83f4-41bc-84fd-eafb98470b97 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:08.044869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35905957-f305-4c52-9882-4e9cb0b1328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:08.045572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35905957-f305-4c52-9882-4e9cb0b1328c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:08.045855 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35905957-f305-4c52-9882-4e9cb0b1328c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:08.046127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35905957-f305-4c52-9882-4e9cb0b1328c None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:08.046832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35905957-f305-4c52-9882-4e9cb0b1328c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:08.047136 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35905957-f305-4c52-9882-4e9cb0b1328c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:08.048559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35905957-f305-4c52-9882-4e9cb0b1328c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:08.059088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 480/987] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Sep 12 23:16:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:08.060252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b88cab-5282-4f8d-bed8-6a03e954b8f8 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:08.174065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b88cab-5282-4f8d-bed8-6a03e954b8f8 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:08.210322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847008dc-4214-41d7-98e0-b2df79accfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:08.210993 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847008dc-4214-41d7-98e0-b2df79accfcd None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:08.211233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847008dc-4214-41d7-98e0-b2df79accfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:08.211503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847008dc-4214-41d7-98e0-b2df79accfcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:08.212211 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847008dc-4214-41d7-98e0-b2df79accfcd None admin] RBAC: Adding query filter params (interface=admin, service_id=e6916cca33b84ccca278e452cae733f6, region_id=RegionOne) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:08.212519 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847008dc-4214-41d7-98e0-b2df79accfcd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:08.213928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847008dc-4214-41d7-98e0-b2df79accfcd None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:08.219300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 508/988] 10.222.0.33 () {56 vars in 1249 bytes} [Mon Sep 12 23:16:08 2022] GET /identity/v3/endpoints?service_id=e6916cca33b84ccca278e452cae733f6&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:08.225298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35905957-f305-4c52-9882-4e9cb0b1328c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:08.327812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35905957-f305-4c52-9882-4e9cb0b1328c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:08.362069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d731b-c277-440f-9227-b35bab254f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:08.362711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d731b-c277-440f-9227-b35bab254f05 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:08.362992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d731b-c277-440f-9227-b35bab254f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:08.363264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d731b-c277-440f-9227-b35bab254f05 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:08.363869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d731b-c277-440f-9227-b35bab254f05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:08.365234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d731b-c277-440f-9227-b35bab254f05 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:08.380425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 481/989] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Sep 12 23:16:08 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:16:08.735624 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e0ffd-7f36-44d5-99b0-86114996b393 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:08.735959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e0ffd-7f36-44d5-99b0-86114996b393 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:08.736182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e0ffd-7f36-44d5-99b0-86114996b393 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:08.737637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 509/990] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:08.742684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b516-3328-4eea-9891-ba692775b098 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:08.743146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b516-3328-4eea-9891-ba692775b098 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:08.743225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b516-3328-4eea-9891-ba692775b098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:08.761553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-14a9b516-3328-4eea-9891-ba692775b098 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:08.762768 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-14a9b516-3328-4eea-9891-ba692775b098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:08.765690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:08.834478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 482/991] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:09.101056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e0ffd-7f36-44d5-99b0-86114996b393 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:09.152688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:09.207155 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e0ffd-7f36-44d5-99b0-86114996b393 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:09.241431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4920709-7095-4db2-80a8-851b19631f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:09.242061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4920709-7095-4db2-80a8-851b19631f7c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:09.242322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4920709-7095-4db2-80a8-851b19631f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:09.242618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4920709-7095-4db2-80a8-851b19631f7c None admin] PATH_INFO: `/v3/services/image` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:09.243211 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4920709-7095-4db2-80a8-851b19631f7c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:09.244570 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4920709-7095-4db2-80a8-851b19631f7c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-d4920709-7095-4db2-80a8-851b19631f7c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:09.253530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:09.254830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:16:09.255671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:09.258473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 510/992] 10.222.0.33 () {56 vars in 1105 bytes} [Mon Sep 12 23:16:09 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:09.260744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b516-3328-4eea-9891-ba692775b098 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:09.363739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b516-3328-4eea-9891-ba692775b098 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:09.405448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e1f32-0d61-4a31-b6ee-d457085ced29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:09.406051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e1f32-0d61-4a31-b6ee-d457085ced29 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:09.406330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e1f32-0d61-4a31-b6ee-d457085ced29 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:09.406630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e1f32-0d61-4a31-b6ee-d457085ced29 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:09.407252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e1f32-0d61-4a31-b6ee-d457085ced29 None admin] RBAC: Adding query filter params (name=image) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:09.407553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e1f32-0d61-4a31-b6ee-d457085ced29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:09.408921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e1f32-0d61-4a31-b6ee-d457085ced29 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:09.413970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 483/993] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:09.419732 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4920709-7095-4db2-80a8-851b19631f7c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:09.523243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4920709-7095-4db2-80a8-851b19631f7c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:09.536300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:09.559082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390efd3-20c5-40fa-b6fe-0bcb9eaf0ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:09.559706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390efd3-20c5-40fa-b6fe-0bcb9eaf0ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:09.559982 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390efd3-20c5-40fa-b6fe-0bcb9eaf0ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:09.560247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390efd3-20c5-40fa-b6fe-0bcb9eaf0ff4 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:09.560865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390efd3-20c5-40fa-b6fe-0bcb9eaf0ff4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:09.561789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390efd3-20c5-40fa-b6fe-0bcb9eaf0ff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:09.563165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390efd3-20c5-40fa-b6fe-0bcb9eaf0ff4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:09.574428 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 511/994] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:10.177432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75392b51-dcfa-48df-aa0a-3d6fa202a8d8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:10.177967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75392b51-dcfa-48df-aa0a-3d6fa202a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:10.177967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75392b51-dcfa-48df-aa0a-3d6fa202a8d8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:10.179640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 484/995] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:10.184930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8a2e6-99e8-46fd-a91b-20234c1acc4a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:10.185219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8a2e6-99e8-46fd-a91b-20234c1acc4a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:10.185497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8a2e6-99e8-46fd-a91b-20234c1acc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:10.204638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f4c8a2e6-99e8-46fd-a91b-20234c1acc4a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:10.205826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f4c8a2e6-99e8-46fd-a91b-20234c1acc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:10.273581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 512/996] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:10.547047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75392b51-dcfa-48df-aa0a-3d6fa202a8d8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:10.550943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:10.552728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0fe79-e48d-4e56-8469-aea2c49b9287 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:10.553014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0fe79-e48d-4e56-8469-aea2c49b9287 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:10.553289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0fe79-e48d-4e56-8469-aea2c49b9287 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:10.554678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 513/997] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:16:10.560079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9da07-1e43-444f-950d-5e68f80af220 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:10.560594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9da07-1e43-444f-950d-5e68f80af220 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:10.560871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9da07-1e43-444f-950d-5e68f80af220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:10.582029 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-54b9da07-1e43-444f-950d-5e68f80af220 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:10.583268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-54b9da07-1e43-444f-950d-5e68f80af220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:10.652001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 514/998] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:16:10.666394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75392b51-dcfa-48df-aa0a-3d6fa202a8d8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:10.702849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014222cc-529a-4ad1-b6d1-20262e3f8968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:10.703476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014222cc-529a-4ad1-b6d1-20262e3f8968 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:10.703752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014222cc-529a-4ad1-b6d1-20262e3f8968 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:10.704020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014222cc-529a-4ad1-b6d1-20262e3f8968 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:10.704594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014222cc-529a-4ad1-b6d1-20262e3f8968 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:10.705949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014222cc-529a-4ad1-b6d1-20262e3f8968 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-014222cc-529a-4ad1-b6d1-20262e3f8968 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:10.715029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:10.715991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:10.721999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 485/999] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:16:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:10.722823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9da07-1e43-444f-950d-5e68f80af220 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:10.758646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:10.827365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9da07-1e43-444f-950d-5e68f80af220 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:10.863821 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22957674-2971-4198-8ced-7572db30b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:10.864423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22957674-2971-4198-8ced-7572db30b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:10.864698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22957674-2971-4198-8ced-7572db30b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:10.864965 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22957674-2971-4198-8ced-7572db30b5a7 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:10.865594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22957674-2971-4198-8ced-7572db30b5a7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:10.865892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22957674-2971-4198-8ced-7572db30b5a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:10.867281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22957674-2971-4198-8ced-7572db30b5a7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:10.872238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 515/1000] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:16:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:10.878471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014222cc-529a-4ad1-b6d1-20262e3f8968 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:10.928009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22957674-2971-4198-8ced-7572db30b5a7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:10.950445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:10.993530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014222cc-529a-4ad1-b6d1-20262e3f8968 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:11.026617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c5770-5f88-4a15-aa2b-fb5b59b341c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:11.027227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c5770-5f88-4a15-aa2b-fb5b59b341c5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:11.027526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c5770-5f88-4a15-aa2b-fb5b59b341c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:11.027791 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c5770-5f88-4a15-aa2b-fb5b59b341c5 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:11.028412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c5770-5f88-4a15-aa2b-fb5b59b341c5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:11.028707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c5770-5f88-4a15-aa2b-fb5b59b341c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:11.030653 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c5770-5f88-4a15-aa2b-fb5b59b341c5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:11.034759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:11.039935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 486/1001] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:16:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:11.042617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c5770-5f88-4a15-aa2b-fb5b59b341c5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:11.043183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22957674-2971-4198-8ced-7572db30b5a7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:11.081826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448dc2e2-baf5-4ef5-81cf-d5aa202051b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:11.082362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448dc2e2-baf5-4ef5-81cf-d5aa202051b3 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:11.082674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448dc2e2-baf5-4ef5-81cf-d5aa202051b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:11.082947 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448dc2e2-baf5-4ef5-81cf-d5aa202051b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:11.083556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448dc2e2-baf5-4ef5-81cf-d5aa202051b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:11.084908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448dc2e2-baf5-4ef5-81cf-d5aa202051b3 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-448dc2e2-baf5-4ef5-81cf-d5aa202051b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:11.095074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:11.096188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:16:11.097019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:11.101458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 516/1002] 10.222.0.33 () {56 vars in 1126 bytes} [Mon Sep 12 23:16:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:11.102477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448dc2e2-baf5-4ef5-81cf-d5aa202051b3 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:11.153401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c5770-5f88-4a15-aa2b-fb5b59b341c5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:11.185364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:11.191142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd2442-048f-45da-bbad-13e9fefe96a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:11.191756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd2442-048f-45da-bbad-13e9fefe96a3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:11.192032 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd2442-048f-45da-bbad-13e9fefe96a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:11.192301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd2442-048f-45da-bbad-13e9fefe96a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:11.193114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd2442-048f-45da-bbad-13e9fefe96a3 None admin] RBAC: Adding query filter params (interface=public, service_id=56c84eb78f804d73a70545b13ba715b6, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:11.194183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd2442-048f-45da-bbad-13e9fefe96a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:11.195599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd2442-048f-45da-bbad-13e9fefe96a3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:11.201268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 487/1003] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Sep 12 23:16:11 2022] GET /identity/v3/endpoints?service_id=56c84eb78f804d73a70545b13ba715b6&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:11.207678 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd2442-048f-45da-bbad-13e9fefe96a3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:11.213608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448dc2e2-baf5-4ef5-81cf-d5aa202051b3 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:11.252422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1859a-b47c-4679-b399-2628bc22ce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:11.253050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1859a-b47c-4679-b399-2628bc22ce9f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:11.253341 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1859a-b47c-4679-b399-2628bc22ce9f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:11.253624 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1859a-b47c-4679-b399-2628bc22ce9f None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:11.254262 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1859a-b47c-4679-b399-2628bc22ce9f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:11.254591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1859a-b47c-4679-b399-2628bc22ce9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:11.255959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1859a-b47c-4679-b399-2628bc22ce9f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:11.265475 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 517/1004] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Sep 12 23:16:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:11.266482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1859a-b47c-4679-b399-2628bc22ce9f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:11.296324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:11.320875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd2442-048f-45da-bbad-13e9fefe96a3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:11.354599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0f55-ab03-4f24-b703-3e5d8ffaf1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:11.355146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0f55-ab03-4f24-b703-3e5d8ffaf1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:11.355412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0f55-ab03-4f24-b703-3e5d8ffaf1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:11.355683 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0f55-ab03-4f24-b703-3e5d8ffaf1c2 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:11.356281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a0f55-ab03-4f24-b703-3e5d8ffaf1c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:11.357648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a0f55-ab03-4f24-b703-3e5d8ffaf1c2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:11.365650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 488/1005] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Sep 12 23:16:11 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:16:11.389733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1859a-b47c-4679-b399-2628bc22ce9f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:11.429082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c9f8f-5353-4c37-9b9c-b9a9c339c27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:11.429766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c9f8f-5353-4c37-9b9c-b9a9c339c27b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:11.430043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c9f8f-5353-4c37-9b9c-b9a9c339c27b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:11.430312 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c9f8f-5353-4c37-9b9c-b9a9c339c27b None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:11.431080 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c9f8f-5353-4c37-9b9c-b9a9c339c27b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:11.431383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c9f8f-5353-4c37-9b9c-b9a9c339c27b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:11.432860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c9f8f-5353-4c37-9b9c-b9a9c339c27b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:11.444242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 518/1006] 10.222.0.33 () {56 vars in 1122 bytes} [Mon Sep 12 23:16:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:11.445898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0f55-ab03-4f24-b703-3e5d8ffaf1c2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:11.513114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:11.559580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0f55-ab03-4f24-b703-3e5d8ffaf1c2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:11.596531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df226d-c787-467c-9171-6dbe032e82eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:11.597144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df226d-c787-467c-9171-6dbe032e82eb None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:11.597423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df226d-c787-467c-9171-6dbe032e82eb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:11.597695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df226d-c787-467c-9171-6dbe032e82eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:11.598372 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df226d-c787-467c-9171-6dbe032e82eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:11.599771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df226d-c787-467c-9171-6dbe032e82eb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:11.622556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 489/1007] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:16:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:16:11.785080 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e0c4a-7a15-42e4-8332-862106ca746c None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:11.785433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e0c4a-7a15-42e4-8332-862106ca746c None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:11.785629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e0c4a-7a15-42e4-8332-862106ca746c None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:11.787134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 519/1008] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:11.792629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ece9a-d781-4913-9fae-94fbad80c192 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:11.792928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ece9a-d781-4913-9fae-94fbad80c192 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:11.793199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ece9a-d781-4913-9fae-94fbad80c192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:11.812182 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-839ece9a-d781-4913-9fae-94fbad80c192 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:11.813380 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-839ece9a-d781-4913-9fae-94fbad80c192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:11.916133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 490/1009] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:11 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:12.192808 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e0c4a-7a15-42e4-8332-862106ca746c None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:12.286066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:12.299088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e0c4a-7a15-42e4-8332-862106ca746c None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:12.334016 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998f450-d9d4-48fd-bda8-d379053cc58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:12.334639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998f450-d9d4-48fd-bda8-d379053cc58d None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:12.334915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998f450-d9d4-48fd-bda8-d379053cc58d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:12.335180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998f450-d9d4-48fd-bda8-d379053cc58d None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:12.335830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998f450-d9d4-48fd-bda8-d379053cc58d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:12.337172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998f450-d9d4-48fd-bda8-d379053cc58d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:12.353483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 520/1010] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:16:12 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:16:13.581379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4772232-3636-46f8-9873-20d38865efb8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:13.581924 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4772232-3636-46f8-9873-20d38865efb8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:13.581924 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4772232-3636-46f8-9873-20d38865efb8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:13.583443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 491/1011] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:13.588410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612d1ea-c26e-4c73-bc6a-49b552355297 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:13.588792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612d1ea-c26e-4c73-bc6a-49b552355297 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:13.588970 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612d1ea-c26e-4c73-bc6a-49b552355297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:13.607969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-6612d1ea-c26e-4c73-bc6a-49b552355297 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:13.609206 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6612d1ea-c26e-4c73-bc6a-49b552355297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:13.684322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 521/1012] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:13 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:13.833502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff65b1-ab50-4852-9bee-d8b2423a14aa None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:13.833841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff65b1-ab50-4852-9bee-d8b2423a14aa None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:13.834050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff65b1-ab50-4852-9bee-d8b2423a14aa None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:13.835544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 492/1013] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:13.840494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b13683-646c-47ef-a537-e275890a7330 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:13.840777 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b13683-646c-47ef-a537-e275890a7330 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:13.841046 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b13683-646c-47ef-a537-e275890a7330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:13.860072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-85b13683-646c-47ef-a537-e275890a7330 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:13.861244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-85b13683-646c-47ef-a537-e275890a7330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:13.926291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 522/1014] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:13 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:13.956333 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff65b1-ab50-4852-9bee-d8b2423a14aa None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:14.004492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:14.061902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff65b1-ab50-4852-9bee-d8b2423a14aa None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:14.096924 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c785-0da6-45c8-a9e3-79928ca07336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:14.097584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c785-0da6-45c8-a9e3-79928ca07336 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:14.097861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c785-0da6-45c8-a9e3-79928ca07336 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:14.098131 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c785-0da6-45c8-a9e3-79928ca07336 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:14.098740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c785-0da6-45c8-a9e3-79928ca07336 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:14.100106 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c785-0da6-45c8-a9e3-79928ca07336 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5cf0c785-0da6-45c8-a9e3-79928ca07336 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:14.108840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:14.109811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:16:14.110676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:14.114689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 493/1015] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:16:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:14.115911 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b13683-646c-47ef-a537-e275890a7330 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:14.126975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:14.193591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c785-0da6-45c8-a9e3-79928ca07336 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:14.223958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b13683-646c-47ef-a537-e275890a7330 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:14.261536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b8905-27ae-4bf8-b15c-ecdddf39b256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:14.262145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b8905-27ae-4bf8-b15c-ecdddf39b256 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:14.262447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b8905-27ae-4bf8-b15c-ecdddf39b256 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:14.262724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b8905-27ae-4bf8-b15c-ecdddf39b256 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:14.263351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b8905-27ae-4bf8-b15c-ecdddf39b256 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:14.263651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b8905-27ae-4bf8-b15c-ecdddf39b256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:14.265711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b8905-27ae-4bf8-b15c-ecdddf39b256 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:14.270818 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 523/1016] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:16:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:14.276349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b8905-27ae-4bf8-b15c-ecdddf39b256 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:14.301713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c785-0da6-45c8-a9e3-79928ca07336 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:14.312585 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:14.337250 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43c8dc-bb9e-4be6-9a8f-3e81eb0812e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:14.337889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43c8dc-bb9e-4be6-9a8f-3e81eb0812e9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:14.338166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43c8dc-bb9e-4be6-9a8f-3e81eb0812e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:14.338465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43c8dc-bb9e-4be6-9a8f-3e81eb0812e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:14.339570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43c8dc-bb9e-4be6-9a8f-3e81eb0812e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:14.341015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43c8dc-bb9e-4be6-9a8f-3e81eb0812e9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:14.343398 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 494/1017] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:14.348949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43c8dc-bb9e-4be6-9a8f-3e81eb0812e9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:14.358792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:14.395621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b8905-27ae-4bf8-b15c-ecdddf39b256 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:14.432836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7789b75-8554-4451-ac03-ae605cb936e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:14.433455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7789b75-8554-4451-ac03-ae605cb936e7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:14.433730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7789b75-8554-4451-ac03-ae605cb936e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:14.433997 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7789b75-8554-4451-ac03-ae605cb936e7 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:14.435292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7789b75-8554-4451-ac03-ae605cb936e7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:14.435597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7789b75-8554-4451-ac03-ae605cb936e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:14.437618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7789b75-8554-4451-ac03-ae605cb936e7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:14.448618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 524/1018] 10.222.0.33 () {56 vars in 1112 bytes} [Mon Sep 12 23:16:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:14.449829 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7789b75-8554-4451-ac03-ae605cb936e7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:14.465157 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43c8dc-bb9e-4be6-9a8f-3e81eb0812e9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:14.504736 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28156ac-d82e-49da-9038-87508571294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:14.505263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28156ac-d82e-49da-9038-87508571294c None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:14.505544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28156ac-d82e-49da-9038-87508571294c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:14.505818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28156ac-d82e-49da-9038-87508571294c None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:14.506495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28156ac-d82e-49da-9038-87508571294c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:14.507936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28156ac-d82e-49da-9038-87508571294c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:14.546431 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 495/1019] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:16:14 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:16:14.562952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7789b75-8554-4451-ac03-ae605cb936e7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:14.565682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08078064-9d8d-4e11-9e77-db5a9dd7a614 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:14.566762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08078064-9d8d-4e11-9e77-db5a9dd7a614 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:14.567057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08078064-9d8d-4e11-9e77-db5a9dd7a614 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:14.568684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 496/1020] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:14.574551 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c531a3-7001-4b40-9d19-1863ab982c40 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:14.574837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c531a3-7001-4b40-9d19-1863ab982c40 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:14.575112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c531a3-7001-4b40-9d19-1863ab982c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:14.594103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b0c531a3-7001-4b40-9d19-1863ab982c40 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:14.595383 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b0c531a3-7001-4b40-9d19-1863ab982c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:14.604942 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c0095-01ed-4e11-8a7a-d8632617c883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:14.606219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c0095-01ed-4e11-8a7a-d8632617c883 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:14.606670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c0095-01ed-4e11-8a7a-d8632617c883 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:14.607085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c0095-01ed-4e11-8a7a-d8632617c883 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:14.608075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c0095-01ed-4e11-8a7a-d8632617c883 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:14.609660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c0095-01ed-4e11-8a7a-d8632617c883 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:14.616324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:14.622482 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:14.637902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 525/1021] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:16:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:16:14.702263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 497/1022] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:16:14.970026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c0095-01ed-4e11-8a7a-d8632617c883 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:15.072251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c0095-01ed-4e11-8a7a-d8632617c883 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:15.108022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c365591-9ff9-4df1-96ea-c401c06b5eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:15.108666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c365591-9ff9-4df1-96ea-c401c06b5eca None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:15.108946 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c365591-9ff9-4df1-96ea-c401c06b5eca None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:15.109221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c365591-9ff9-4df1-96ea-c401c06b5eca None admin] PATH_INFO: `/v3/services/image` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:15.109805 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c365591-9ff9-4df1-96ea-c401c06b5eca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:15.111210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c365591-9ff9-4df1-96ea-c401c06b5eca None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-4c365591-9ff9-4df1-96ea-c401c06b5eca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:15.120116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:15.121385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:15.122225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 526/1023] 10.222.0.33 () {56 vars in 1105 bytes} [Mon Sep 12 23:16:14 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:15.127445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c531a3-7001-4b40-9d19-1863ab982c40 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:15.229356 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c531a3-7001-4b40-9d19-1863ab982c40 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:15.268960 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2b13d-60a1-4f18-80fc-1ac82216d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:15.269580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b13d-60a1-4f18-80fc-1ac82216d576 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:15.269861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b13d-60a1-4f18-80fc-1ac82216d576 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:15.270140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b13d-60a1-4f18-80fc-1ac82216d576 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:15.270797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2b13d-60a1-4f18-80fc-1ac82216d576 None admin] RBAC: Adding query filter params (name=image) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:15.271106 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2b13d-60a1-4f18-80fc-1ac82216d576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:15.272479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2b13d-60a1-4f18-80fc-1ac82216d576 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:15.282714 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 498/1024] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:15.284368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c365591-9ff9-4df1-96ea-c401c06b5eca None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:15.344583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:15.401248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c365591-9ff9-4df1-96ea-c401c06b5eca None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:15.437294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c014fe-61ac-45cf-93c9-1a020691e1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:15.437896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c014fe-61ac-45cf-93c9-1a020691e1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:15.438174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c014fe-61ac-45cf-93c9-1a020691e1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:15.438465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c014fe-61ac-45cf-93c9-1a020691e1d3 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:15.439098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c014fe-61ac-45cf-93c9-1a020691e1d3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:15.439432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c014fe-61ac-45cf-93c9-1a020691e1d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:15.440755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c014fe-61ac-45cf-93c9-1a020691e1d3 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:15.450535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 527/1025] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:15.452120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2b13d-60a1-4f18-80fc-1ac82216d576 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:15.476720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:15.563813 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2b13d-60a1-4f18-80fc-1ac82216d576 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:15.598522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aa267-b24c-42bb-8b77-9b85177f3491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:15.599148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aa267-b24c-42bb-8b77-9b85177f3491 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:15.599395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aa267-b24c-42bb-8b77-9b85177f3491 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:15.599669 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aa267-b24c-42bb-8b77-9b85177f3491 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:15.600363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aa267-b24c-42bb-8b77-9b85177f3491 None admin] RBAC: Adding query filter params (interface=public, service_id=0b307683e60a4e0b80c744f62fb40009, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:15.600670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aa267-b24c-42bb-8b77-9b85177f3491 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:15.602035 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aa267-b24c-42bb-8b77-9b85177f3491 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:15.607180 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 499/1026] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Sep 12 23:16:15 2022] GET /identity/v3/endpoints?service_id=0b307683e60a4e0b80c744f62fb40009&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:15.612998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c014fe-61ac-45cf-93c9-1a020691e1d3 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:15.721020 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c014fe-61ac-45cf-93c9-1a020691e1d3 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:15.741473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:15.756290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815079-f285-4bef-8b8b-203292141c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:15.756900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815079-f285-4bef-8b8b-203292141c5a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:15.757178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815079-f285-4bef-8b8b-203292141c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:15.757453 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815079-f285-4bef-8b8b-203292141c5a None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:15.758056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1815079-f285-4bef-8b8b-203292141c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:15.759454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1815079-f285-4bef-8b8b-203292141c5a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:15.774468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 528/1027] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Sep 12 23:16:15 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:16:16.770967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db201a2-b3c7-4e7a-a0d7-f7d47b4fe71b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:16.771488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db201a2-b3c7-4e7a-a0d7-f7d47b4fe71b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:16.771488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db201a2-b3c7-4e7a-a0d7-f7d47b4fe71b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:16.772882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 500/1028] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:16.778032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5880dab-55e3-4014-983a-691c3900aab5 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:16.778495 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5880dab-55e3-4014-983a-691c3900aab5 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:16.778577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5880dab-55e3-4014-983a-691c3900aab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:16.797220 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-a5880dab-55e3-4014-983a-691c3900aab5 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:16.798411 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a5880dab-55e3-4014-983a-691c3900aab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:16.870370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 529/1029] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:16.939148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5b8c5-3ceb-4e01-8b8e-ce3b1b508d95 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:16.939471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5b8c5-3ceb-4e01-8b8e-ce3b1b508d95 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:16.939693 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5b8c5-3ceb-4e01-8b8e-ce3b1b508d95 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:16.941247 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 501/1030] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:16.946438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc54eb-792b-4c36-9144-4255cceae1ee None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:16.946728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc54eb-792b-4c36-9144-4255cceae1ee None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:16.947001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc54eb-792b-4c36-9144-4255cceae1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:16.965794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-05cc54eb-792b-4c36-9144-4255cceae1ee None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:16.967014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-05cc54eb-792b-4c36-9144-4255cceae1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:17.036167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 530/1031] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:17.139806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5b8c5-3ceb-4e01-8b8e-ce3b1b508d95 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:17.224954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:17.243378 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5b8c5-3ceb-4e01-8b8e-ce3b1b508d95 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:17.277345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6116d7-4eb4-4434-a51e-7c6b694a2efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:17.277973 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6116d7-4eb4-4434-a51e-7c6b694a2efe None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:17.278248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6116d7-4eb4-4434-a51e-7c6b694a2efe None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:17.278546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6116d7-4eb4-4434-a51e-7c6b694a2efe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:17.279683 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6116d7-4eb4-4434-a51e-7c6b694a2efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:17.281142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6116d7-4eb4-4434-a51e-7c6b694a2efe None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:17.282949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 502/1032] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:17.288396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc54eb-792b-4c36-9144-4255cceae1ee None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:17.306270 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6116d7-4eb4-4434-a51e-7c6b694a2efe None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:17.337111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:17.406622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc54eb-792b-4c36-9144-4255cceae1ee None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:17.416129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6116d7-4eb4-4434-a51e-7c6b694a2efe None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:17.445226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fc160-b8c4-459c-8f9d-24f5cc22a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:17.445835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fc160-b8c4-459c-8f9d-24f5cc22a1f5 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:17.446108 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fc160-b8c4-459c-8f9d-24f5cc22a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:17.446373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fc160-b8c4-459c-8f9d-24f5cc22a1f5 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:17.447207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fc160-b8c4-459c-8f9d-24f5cc22a1f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:17.448636 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fc160-b8c4-459c-8f9d-24f5cc22a1f5 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:17.455811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46390cb2-9f4b-40c5-b4d4-f43c4a9fefe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:17.456453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46390cb2-9f4b-40c5-b4d4-f43c4a9fefe4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:17.456734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46390cb2-9f4b-40c5-b4d4-f43c4a9fefe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:17.457008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46390cb2-9f4b-40c5-b4d4-f43c4a9fefe4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:17.470462 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46390cb2-9f4b-40c5-b4d4-f43c4a9fefe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:16:17.474308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 531/1033] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:16:17 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-46390cb2-9f4b-40c5-b4d4-f43c4a9fefe4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:16:17.484909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:17.485921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:17.487365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:17.487365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:17.487365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:17.487365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:17.487365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:16:17.487365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:16:17.487365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:16:17.487365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:16:17.487365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:16:17.487365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:16:17.487365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:16:17.487365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:17.488469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 503/1034] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Sep 12 23:16:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:17.492345 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fc160-b8c4-459c-8f9d-24f5cc22a1f5 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:17.603080 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:17.607190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fc160-b8c4-459c-8f9d-24f5cc22a1f5 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:17.645237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3344e3-3823-4c7a-b2ab-9577904ef1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:17.645794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3344e3-3823-4c7a-b2ab-9577904ef1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:17.646078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3344e3-3823-4c7a-b2ab-9577904ef1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:17.646352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3344e3-3823-4c7a-b2ab-9577904ef1f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:17.647053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3344e3-3823-4c7a-b2ab-9577904ef1f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:17.647873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3344e3-3823-4c7a-b2ab-9577904ef1f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:17.649175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3344e3-3823-4c7a-b2ab-9577904ef1f3 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:17.658791 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 532/1035] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Sep 12 23:16:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:17.664868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46390cb2-9f4b-40c5-b4d4-f43c4a9fefe4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:17.682018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:17.770369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46390cb2-9f4b-40c5-b4d4-f43c4a9fefe4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:17.805610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06dd54-c458-41cf-b9b3-a70b3ee7e9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:17.806249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06dd54-c458-41cf-b9b3-a70b3ee7e9ab None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:17.806539 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06dd54-c458-41cf-b9b3-a70b3ee7e9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:17.806805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06dd54-c458-41cf-b9b3-a70b3ee7e9ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:17.818573 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06dd54-c458-41cf-b9b3-a70b3ee7e9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:17.820092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06dd54-c458-41cf-b9b3-a70b3ee7e9ab None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6a06dd54-c458-41cf-b9b3-a70b3ee7e9ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:16:17.837011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:17.838022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:16:17.844583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:16:17.844583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:17.844583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:17.844583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 504/1036] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:17.846608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3344e3-3823-4c7a-b2ab-9577904ef1f3 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:17.937272 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d7fe0-6c79-4014-843b-4a864902bce8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:17.937568 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d7fe0-6c79-4014-843b-4a864902bce8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:17.937748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d7fe0-6c79-4014-843b-4a864902bce8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:17.939245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 505/1037] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:16:17.943918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a030-b52f-40ae-9111-0355f640051d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:17.944199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a030-b52f-40ae-9111-0355f640051d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:17.944492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a030-b52f-40ae-9111-0355f640051d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:17.947477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3344e3-3823-4c7a-b2ab-9577904ef1f3 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:17.962810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2306a030-b52f-40ae-9111-0355f640051d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:17.963999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2306a030-b52f-40ae-9111-0355f640051d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:17.983247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab548812-f3fb-4f90-90a6-e54da3622a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:17.983858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab548812-f3fb-4f90-90a6-e54da3622a66 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:17.984135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab548812-f3fb-4f90-90a6-e54da3622a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:17.984403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab548812-f3fb-4f90-90a6-e54da3622a66 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:17.985040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab548812-f3fb-4f90-90a6-e54da3622a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:17.985381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab548812-f3fb-4f90-90a6-e54da3622a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:17.986730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab548812-f3fb-4f90-90a6-e54da3622a66 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:17.999746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 533/1038] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:18.005046 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab548812-f3fb-4f90-90a6-e54da3622a66 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:18.026212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:18.033691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:18.039145 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 506/1039] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:16:18.111660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab548812-f3fb-4f90-90a6-e54da3622a66 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:18.145408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f04a98-e64e-48ca-bc6c-be71fd3848ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:18.146090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f04a98-e64e-48ca-bc6c-be71fd3848ab None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:18.146373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f04a98-e64e-48ca-bc6c-be71fd3848ab None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:18.146667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f04a98-e64e-48ca-bc6c-be71fd3848ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:18.153589 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f04a98-e64e-48ca-bc6c-be71fd3848ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:18.155119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f04a98-e64e-48ca-bc6c-be71fd3848ab None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-b9f04a98-e64e-48ca-bc6c-be71fd3848ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:16:18.166978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:18.167891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:18.169309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:18.169309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:18.169309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:16:18.169309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:16:18.169309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:16:18.169309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:16:18.169309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:16:18.169309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:16:18.169309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:16:18.169309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:18.169309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 534/1040] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Sep 12 23:16:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:18.173887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306a030-b52f-40ae-9111-0355f640051d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:18.279052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306a030-b52f-40ae-9111-0355f640051d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:18.308513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f04a98-e64e-48ca-bc6c-be71fd3848ab None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:18.316954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab9d56-8585-4535-a4ef-7df60d2caceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:18.317581 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab9d56-8585-4535-a4ef-7df60d2caceb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:18.317858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab9d56-8585-4535-a4ef-7df60d2caceb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:18.318126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab9d56-8585-4535-a4ef-7df60d2caceb None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:18.318903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab9d56-8585-4535-a4ef-7df60d2caceb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:18.319206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab9d56-8585-4535-a4ef-7df60d2caceb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:18.320640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab9d56-8585-4535-a4ef-7df60d2caceb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:18.339537 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 507/1041] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Sep 12 23:16:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:18.345849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab9d56-8585-4535-a4ef-7df60d2caceb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:18.400286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:18.409840 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:18.430667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f04a98-e64e-48ca-bc6c-be71fd3848ab None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:18.454081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab9d56-8585-4535-a4ef-7df60d2caceb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:18.468296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4326e6d-b591-4b8c-b413-4abae5da53cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:18.469100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4326e6d-b591-4b8c-b413-4abae5da53cc None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:18.469377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4326e6d-b591-4b8c-b413-4abae5da53cc None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:18.469985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4326e6d-b591-4b8c-b413-4abae5da53cc None admin] PATH_INFO: `/v3/services/image` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:18.470616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4326e6d-b591-4b8c-b413-4abae5da53cc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:18.472122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4326e6d-b591-4b8c-b413-4abae5da53cc None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-b4326e6d-b591-4b8c-b413-4abae5da53cc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:18.480642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:18.481812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:18.482769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 535/1042] 10.222.0.33 () {56 vars in 1105 bytes} [Mon Sep 12 23:16:18 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:18.488026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4326e6d-b591-4b8c-b413-4abae5da53cc None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:18.495478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facab6a7-b7d9-412a-83f5-8ea73eb66210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:18.496085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facab6a7-b7d9-412a-83f5-8ea73eb66210 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:18.496361 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facab6a7-b7d9-412a-83f5-8ea73eb66210 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:18.496629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facab6a7-b7d9-412a-83f5-8ea73eb66210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:18.565382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facab6a7-b7d9-412a-83f5-8ea73eb66210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:18.566770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facab6a7-b7d9-412a-83f5-8ea73eb66210 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:18.600933 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4326e6d-b591-4b8c-b413-4abae5da53cc None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:18.617590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:18.639876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e804d89-f81b-4222-9a0f-5ba5f40901de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:18.640486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e804d89-f81b-4222-9a0f-5ba5f40901de None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:18.640758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e804d89-f81b-4222-9a0f-5ba5f40901de None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:18.641025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e804d89-f81b-4222-9a0f-5ba5f40901de None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:18.641652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e804d89-f81b-4222-9a0f-5ba5f40901de None admin] RBAC: Adding query filter params (name=image) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:18.641950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e804d89-f81b-4222-9a0f-5ba5f40901de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:18.643330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e804d89-f81b-4222-9a0f-5ba5f40901de None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:18.648289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 536/1043] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:18.653834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e804d89-f81b-4222-9a0f-5ba5f40901de None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:18.667334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:18.679664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 508/1044] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:16:18 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 23:16:18.684760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facab6a7-b7d9-412a-83f5-8ea73eb66210 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:18.763650 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e804d89-f81b-4222-9a0f-5ba5f40901de None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:18.787144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facab6a7-b7d9-412a-83f5-8ea73eb66210 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:18.800454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf5821-0412-485d-9c20-8e1d40cad559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:18.801059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf5821-0412-485d-9c20-8e1d40cad559 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:18.801340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf5821-0412-485d-9c20-8e1d40cad559 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:18.801614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf5821-0412-485d-9c20-8e1d40cad559 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:18.802301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf5821-0412-485d-9c20-8e1d40cad559 None admin] RBAC: Adding query filter params (type=image) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:18.802642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf5821-0412-485d-9c20-8e1d40cad559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:18.804002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf5821-0412-485d-9c20-8e1d40cad559 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:18.809203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 537/1045] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:18.814856 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf5821-0412-485d-9c20-8e1d40cad559 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:18.828043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaad18-ab15-4420-8ba6-087a1714b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:18.829766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaad18-ab15-4420-8ba6-087a1714b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:18.830314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaad18-ab15-4420-8ba6-087a1714b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:18.830762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaad18-ab15-4420-8ba6-087a1714b5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:18.843470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaad18-ab15-4420-8ba6-087a1714b5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:18.844919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaad18-ab15-4420-8ba6-087a1714b5e7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9deaad18-ab15-4420-8ba6-087a1714b5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:16:18.859527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:18.860491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:16:18.861411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:16:18.861411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:18.861411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:18.862727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 509/1046] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:18.866454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaad18-ab15-4420-8ba6-087a1714b5e7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:18.870348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:18.898977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:18.927684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf5821-0412-485d-9c20-8e1d40cad559 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:18.966955 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d664d32-89f1-4381-adf2-ac84c2454b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:18.967555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d664d32-89f1-4381-adf2-ac84c2454b8d None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:18.968092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d664d32-89f1-4381-adf2-ac84c2454b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:18.968369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d664d32-89f1-4381-adf2-ac84c2454b8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:18.969594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d664d32-89f1-4381-adf2-ac84c2454b8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:18.971246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d664d32-89f1-4381-adf2-ac84c2454b8d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:18.977187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaad18-ab15-4420-8ba6-087a1714b5e7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:19.006412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 538/1047] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:16:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:16:19.035065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412a42b-ad20-4a25-bd56-589ad9ea4370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:19.035823 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412a42b-ad20-4a25-bd56-589ad9ea4370 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:19.036173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412a42b-ad20-4a25-bd56-589ad9ea4370 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:19.036517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412a42b-ad20-4a25-bd56-589ad9ea4370 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:19.037270 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412a42b-ad20-4a25-bd56-589ad9ea4370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:19.037642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412a42b-ad20-4a25-bd56-589ad9ea4370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:19.039179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412a42b-ad20-4a25-bd56-589ad9ea4370 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:19.058643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 510/1048] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:19.060059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d664d32-89f1-4381-adf2-ac84c2454b8d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:19.172465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d664d32-89f1-4381-adf2-ac84c2454b8d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:19.204377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:19.212537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7d343-d334-45bb-8185-bfd203fc5d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:19.213637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7d343-d334-45bb-8185-bfd203fc5d0a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:19.213915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7d343-d334-45bb-8185-bfd203fc5d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:19.214185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7d343-d334-45bb-8185-bfd203fc5d0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:19.221758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7d343-d334-45bb-8185-bfd203fc5d0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:19.223227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7d343-d334-45bb-8185-bfd203fc5d0a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-c3e7d343-d334-45bb-8185-bfd203fc5d0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:16:19.234972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:19.235944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:19.236859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:16:19.236859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:16:19.236859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:16:19.236859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:16:19.236859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:16:19.236859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:16:19.236859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:16:19.236859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:19.236859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 539/1049] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:16:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:19.241866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412a42b-ad20-4a25-bd56-589ad9ea4370 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:19.306490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:19.351482 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412a42b-ad20-4a25-bd56-589ad9ea4370 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:19.393775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691dc5-f81d-4cd7-86b9-1164805ddb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:19.394407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691dc5-f81d-4cd7-86b9-1164805ddb88 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:19.394706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691dc5-f81d-4cd7-86b9-1164805ddb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:19.394976 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691dc5-f81d-4cd7-86b9-1164805ddb88 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:19.395667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691dc5-f81d-4cd7-86b9-1164805ddb88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:19.395970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691dc5-f81d-4cd7-86b9-1164805ddb88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:19.397400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691dc5-f81d-4cd7-86b9-1164805ddb88 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:19.409889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 511/1050] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:19.415660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7d343-d334-45bb-8185-bfd203fc5d0a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:19.517034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7d343-d334-45bb-8185-bfd203fc5d0a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:19.551781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d84f86-df2a-4bca-9f3a-5b80c30c8416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:19.553324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d84f86-df2a-4bca-9f3a-5b80c30c8416 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:19.553606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d84f86-df2a-4bca-9f3a-5b80c30c8416 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:19.553879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d84f86-df2a-4bca-9f3a-5b80c30c8416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:19.554626 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d84f86-df2a-4bca-9f3a-5b80c30c8416 None admin] RBAC: Adding query filter params (role.id=cc4e7138f6854039a5bf03f9538bb90d, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=67b0698294e94845ae0dbdfb87059755) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:19.554932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d84f86-df2a-4bca-9f3a-5b80c30c8416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:19.556350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d84f86-df2a-4bca-9f3a-5b80c30c8416 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:19.570409 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 540/1051] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:16:19 2022] GET /identity/v3/role_assignments?user.id=67b0698294e94845ae0dbdfb87059755&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=cc4e7138f6854039a5bf03f9538bb90d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:19.723315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ba359-eda1-458e-bb61-d2a215e82d50 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:19.723669 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ba359-eda1-458e-bb61-d2a215e82d50 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:19.723871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ba359-eda1-458e-bb61-d2a215e82d50 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:19.725251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 512/1052] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:19.731070 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace321c-f265-4593-8dbe-21f81e291714 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:19.731463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace321c-f265-4593-8dbe-21f81e291714 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:19.731812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace321c-f265-4593-8dbe-21f81e291714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:19.751331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-9ace321c-f265-4593-8dbe-21f81e291714 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:19.752530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9ace321c-f265-4593-8dbe-21f81e291714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:19.804797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:19.824180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 541/1053] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:20.092821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ba359-eda1-458e-bb61-d2a215e82d50 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:20.196447 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ba359-eda1-458e-bb61-d2a215e82d50 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:20.216787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:20.233648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd555890-4031-431d-8374-d10230966c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:20.234290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd555890-4031-431d-8374-d10230966c08 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:20.234597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd555890-4031-431d-8374-d10230966c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:20.234867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd555890-4031-431d-8374-d10230966c08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:20.245821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd555890-4031-431d-8374-d10230966c08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fd555890-4031-431d-8374-d10230966c08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:16:20.251005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:20.251944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:20.253390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 513/1054] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:16:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:20.258090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace321c-f265-4593-8dbe-21f81e291714 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:20.360965 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace321c-f265-4593-8dbe-21f81e291714 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:20.401571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ce17-4b12-4b2c-b125-097feb1dc2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:20.402181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ce17-4b12-4b2c-b125-097feb1dc2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:20.402491 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ce17-4b12-4b2c-b125-097feb1dc2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:20.402765 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ce17-4b12-4b2c-b125-097feb1dc2d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:20.403425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5ce17-4b12-4b2c-b125-097feb1dc2d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:20.403723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5ce17-4b12-4b2c-b125-097feb1dc2d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:20.405647 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5ce17-4b12-4b2c-b125-097feb1dc2d9 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:20.419144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 542/1055] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:16:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:20.420282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd555890-4031-431d-8374-d10230966c08 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:20.523948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd555890-4031-431d-8374-d10230966c08 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:20.556682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5678a0-5d6d-4f1e-a17b-6cf175d09d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:20.557307 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5678a0-5d6d-4f1e-a17b-6cf175d09d4a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:20.557585 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5678a0-5d6d-4f1e-a17b-6cf175d09d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:20.557859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5678a0-5d6d-4f1e-a17b-6cf175d09d4a None admin] PATH_INFO: `/v3/users/b4343e918eb64726b2bf9f78fe1619d4` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:20.571405 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5678a0-5d6d-4f1e-a17b-6cf175d09d4a None admin] RBAC: Authorizing `identity:get_user(user_id=b4343e918eb64726b2bf9f78fe1619d4)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:20.572849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5678a0-5d6d-4f1e-a17b-6cf175d09d4a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:20.574634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 514/1056] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:16:20 2022] GET /identity/v3/users/b4343e918eb64726b2bf9f78fe1619d4 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:20.580873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ce17-4b12-4b2c-b125-097feb1dc2d9 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:20.627631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:20.682027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ce17-4b12-4b2c-b125-097feb1dc2d9 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:20.716075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929cb4e-baa9-4f96-81eb-1a5942ac7350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:20.716848 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929cb4e-baa9-4f96-81eb-1a5942ac7350 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:20.717227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929cb4e-baa9-4f96-81eb-1a5942ac7350 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:20.717598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929cb4e-baa9-4f96-81eb-1a5942ac7350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:20.786798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929cb4e-baa9-4f96-81eb-1a5942ac7350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:20.788423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929cb4e-baa9-4f96-81eb-1a5942ac7350 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:20.834769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:20.894611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 543/1057] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:16:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:16:20.896884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5678a0-5d6d-4f1e-a17b-6cf175d09d4a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:20.939831 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:21.001789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5678a0-5d6d-4f1e-a17b-6cf175d09d4a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:21.037293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0eb37f-1c6c-4420-b3e4-139691bb6f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:21.037934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eb37f-1c6c-4420-b3e4-139691bb6f99 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:21.038216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eb37f-1c6c-4420-b3e4-139691bb6f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:21.038521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eb37f-1c6c-4420-b3e4-139691bb6f99 None admin] PATH_INFO: `/v3/projects/19f3267023f84fa7b03bc06f543e8276` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:21.039645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0eb37f-1c6c-4420-b3e4-139691bb6f99 None admin] RBAC: Authorizing `identity:get_project(project_id=19f3267023f84fa7b03bc06f543e8276)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:21.041406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0eb37f-1c6c-4420-b3e4-139691bb6f99 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:21.043254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 515/1058] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:16:20 2022] GET /identity/v3/projects/19f3267023f84fa7b03bc06f543e8276 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:21.049779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929cb4e-baa9-4f96-81eb-1a5942ac7350 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:21.156919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929cb4e-baa9-4f96-81eb-1a5942ac7350 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:21.191049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0dfe4-b2a5-414e-925b-5c8612cc1d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:21.191653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0dfe4-b2a5-414e-925b-5c8612cc1d39 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:21.191930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0dfe4-b2a5-414e-925b-5c8612cc1d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:21.192198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0dfe4-b2a5-414e-925b-5c8612cc1d39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:21.192921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0dfe4-b2a5-414e-925b-5c8612cc1d39 None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=19f3267023f84fa7b03bc06f543e8276, user.id=b4343e918eb64726b2bf9f78fe1619d4) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:21.193226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0dfe4-b2a5-414e-925b-5c8612cc1d39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:21.194674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0dfe4-b2a5-414e-925b-5c8612cc1d39 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:21.206602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 544/1059] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:16:21 2022] GET /identity/v3/role_assignments?user.id=b4343e918eb64726b2bf9f78fe1619d4&scope.project.id=19f3267023f84fa7b03bc06f543e8276&role.id=6413aac4240a46ba816472c29e305973 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:21.206802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69121054-2a1b-4701-a902-caca8a633f0f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:21.206802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69121054-2a1b-4701-a902-caca8a633f0f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:21.206802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69121054-2a1b-4701-a902-caca8a633f0f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:21.206802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 516/1060] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:21.210226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76a7f9-14c0-4792-a7b3-3dc9c924f773 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:21.210543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76a7f9-14c0-4792-a7b3-3dc9c924f773 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:21.210814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76a7f9-14c0-4792-a7b3-3dc9c924f773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:21.230075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cb76a7f9-14c0-4792-a7b3-3dc9c924f773 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:21.231362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cb76a7f9-14c0-4792-a7b3-3dc9c924f773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:21.235664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:21.309191 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 545/1061] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:21.582700 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69121054-2a1b-4701-a902-caca8a633f0f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:21.696590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69121054-2a1b-4701-a902-caca8a633f0f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:21.704292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:21.717042 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337eb53-36e2-4bfc-bb00-c63d18553983 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:21.717320 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337eb53-36e2-4bfc-bb00-c63d18553983 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:21.717605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337eb53-36e2-4bfc-bb00-c63d18553983 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:21.719102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 546/1062] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:21.723684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a85a-2862-4856-a30f-f65721eb089d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:21.723978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a85a-2862-4856-a30f-f65721eb089d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:21.724250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a85a-2862-4856-a30f-f65721eb089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:21.733647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb781b-a455-4f38-9863-c4c9fdd66b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:21.734256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb781b-a455-4f38-9863-c4c9fdd66b28 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:21.734594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb781b-a455-4f38-9863-c4c9fdd66b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:21.734833 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb781b-a455-4f38-9863-c4c9fdd66b28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:21.743358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b193a85a-2862-4856-a30f-f65721eb089d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:21.744540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b193a85a-2862-4856-a30f-f65721eb089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:21.803723 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb781b-a455-4f38-9863-c4c9fdd66b28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:21.805184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb781b-a455-4f38-9863-c4c9fdd66b28 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:21.816635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 547/1063] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:16:21.907492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 517/1064] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:16:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:16:21.913225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193a85a-2862-4856-a30f-f65721eb089d None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:21.983439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:22.015117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193a85a-2862-4856-a30f-f65721eb089d None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:22.050146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be8f88-fdde-4c35-80c7-17b9b31e701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:22.050806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be8f88-fdde-4c35-80c7-17b9b31e701d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:22.051082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be8f88-fdde-4c35-80c7-17b9b31e701d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:22.051351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be8f88-fdde-4c35-80c7-17b9b31e701d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:22.062125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be8f88-fdde-4c35-80c7-17b9b31e701d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:22.063590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be8f88-fdde-4c35-80c7-17b9b31e701d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-d3be8f88-fdde-4c35-80c7-17b9b31e701d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:16:22.079170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:22.080181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:16:22.081094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:16:22.081094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:22.081094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:22.082738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 548/1065] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:22.086573 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb781b-a455-4f38-9863-c4c9fdd66b28 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:22.086748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be8f88-fdde-4c35-80c7-17b9b31e701d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:22.096045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:22.190501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb781b-a455-4f38-9863-c4c9fdd66b28 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:22.192841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be8f88-fdde-4c35-80c7-17b9b31e701d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:22.216863 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:22.226843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de599d-3ada-4d51-8620-451958598604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:22.227566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de599d-3ada-4d51-8620-451958598604 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:22.227919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de599d-3ada-4d51-8620-451958598604 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:22.228189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de599d-3ada-4d51-8620-451958598604 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:22.230504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3811925-ddfc-42bc-8533-8854ccfa56b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:22.231487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3811925-ddfc-42bc-8533-8854ccfa56b6 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:22.231766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3811925-ddfc-42bc-8533-8854ccfa56b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:22.232038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3811925-ddfc-42bc-8533-8854ccfa56b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:22.232717 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3811925-ddfc-42bc-8533-8854ccfa56b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:22.233169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3811925-ddfc-42bc-8533-8854ccfa56b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:22.234704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3811925-ddfc-42bc-8533-8854ccfa56b6 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:22.239439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de599d-3ada-4d51-8620-451958598604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e8de599d-3ada-4d51-8620-451958598604 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:16:22.245169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:22.246061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:22.247245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:22.247245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:22.247245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:22.247245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:22.247245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:16:22.247245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:16:22.247245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:16:22.247245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:16:22.247245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:16:22.247245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:16:22.247245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:16:22.247245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:22.250746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 518/1066] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Sep 12 23:16:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:22.251967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 549/1067] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:22.252924 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de599d-3ada-4d51-8620-451958598604 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:22.326108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:22.365948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de599d-3ada-4d51-8620-451958598604 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:22.408726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860233c2-56f8-4fec-af68-1b4f41d46280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:22.409463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860233c2-56f8-4fec-af68-1b4f41d46280 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:22.409638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860233c2-56f8-4fec-af68-1b4f41d46280 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:22.409966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860233c2-56f8-4fec-af68-1b4f41d46280 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:22.410592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860233c2-56f8-4fec-af68-1b4f41d46280 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:22.410893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860233c2-56f8-4fec-af68-1b4f41d46280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:22.412282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860233c2-56f8-4fec-af68-1b4f41d46280 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:22.426226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 519/1068] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Sep 12 23:16:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:22.427511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3811925-ddfc-42bc-8533-8854ccfa56b6 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:22.537751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3811925-ddfc-42bc-8533-8854ccfa56b6 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:22.575895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df91fa-2764-4ac0-bbbc-3924194b648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:22.577100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df91fa-2764-4ac0-bbbc-3924194b648a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:22.577373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df91fa-2764-4ac0-bbbc-3924194b648a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:22.577642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df91fa-2764-4ac0-bbbc-3924194b648a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:22.590842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df91fa-2764-4ac0-bbbc-3924194b648a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:22.592886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df91fa-2764-4ac0-bbbc-3924194b648a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-65df91fa-2764-4ac0-bbbc-3924194b648a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:16:22.608980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:22.610103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:16:22.611019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:16:22.611019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:22.611019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:22.611019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 550/1069] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:22.615836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860233c2-56f8-4fec-af68-1b4f41d46280 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:22.713808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860233c2-56f8-4fec-af68-1b4f41d46280 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:22.740517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:22.748752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133152f2-24f4-4bff-b98b-b3e9732b8e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:22.749352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133152f2-24f4-4bff-b98b-b3e9732b8e27 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:22.749627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133152f2-24f4-4bff-b98b-b3e9732b8e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:22.749895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133152f2-24f4-4bff-b98b-b3e9732b8e27 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:22.750559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133152f2-24f4-4bff-b98b-b3e9732b8e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:22.750859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133152f2-24f4-4bff-b98b-b3e9732b8e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:22.752215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133152f2-24f4-4bff-b98b-b3e9732b8e27 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:22.768232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 520/1070] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:22.769490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df91fa-2764-4ac0-bbbc-3924194b648a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:22.806050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:22.871911 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df91fa-2764-4ac0-bbbc-3924194b648a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:22.903735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc54346-b0d2-4076-a2e5-2d3f4906def7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:22.904871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc54346-b0d2-4076-a2e5-2d3f4906def7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:22.905147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc54346-b0d2-4076-a2e5-2d3f4906def7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:22.905416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc54346-b0d2-4076-a2e5-2d3f4906def7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:22.912794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc54346-b0d2-4076-a2e5-2d3f4906def7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:22.914226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc54346-b0d2-4076-a2e5-2d3f4906def7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-2dc54346-b0d2-4076-a2e5-2d3f4906def7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:16:22.925846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:22.926971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:22.928260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:22.928260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:22.928260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:16:22.928260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:16:22.928260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:16:22.928260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:16:22.928260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:16:22.928260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:16:22.928260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:16:22.928260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:22.928260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 551/1071] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Sep 12 23:16:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:22.932662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133152f2-24f4-4bff-b98b-b3e9732b8e27 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:23.032758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133152f2-24f4-4bff-b98b-b3e9732b8e27 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:23.067361 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace9db-db9d-4612-9ee8-a51bd743947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:23.067890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace9db-db9d-4612-9ee8-a51bd743947c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:23.068166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace9db-db9d-4612-9ee8-a51bd743947c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:23.068434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace9db-db9d-4612-9ee8-a51bd743947c None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:23.069146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace9db-db9d-4612-9ee8-a51bd743947c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:23.069443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace9db-db9d-4612-9ee8-a51bd743947c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:23.070901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace9db-db9d-4612-9ee8-a51bd743947c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:23.088071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 521/1072] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Sep 12 23:16:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:23.095051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc54346-b0d2-4076-a2e5-2d3f4906def7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:23.187441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:23.194440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc54346-b0d2-4076-a2e5-2d3f4906def7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:23.227528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86a238-333e-48d8-b395-e3ab81126a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:23.228150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86a238-333e-48d8-b395-e3ab81126a87 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:23.228430 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86a238-333e-48d8-b395-e3ab81126a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:23.228701 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86a238-333e-48d8-b395-e3ab81126a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:23.239705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86a238-333e-48d8-b395-e3ab81126a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:23.241183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86a238-333e-48d8-b395-e3ab81126a87 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-2d86a238-333e-48d8-b395-e3ab81126a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:16:23.257235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:23.258322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:16:23.259255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:16:23.259255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:23.259255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:23.259255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 552/1073] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:23.265254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace9db-db9d-4612-9ee8-a51bd743947c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:23.312792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:23.366698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace9db-db9d-4612-9ee8-a51bd743947c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:23.368150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056501b6-c771-49f2-898e-d57597688ba6 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:23.368437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056501b6-c771-49f2-898e-d57597688ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:23.368709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056501b6-c771-49f2-898e-d57597688ba6 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:23.370038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 553/1074] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:23.376093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757402c-74ee-491f-b6b5-ffd8a604c440 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:23.376375 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757402c-74ee-491f-b6b5-ffd8a604c440 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:23.376657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757402c-74ee-491f-b6b5-ffd8a604c440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:23.396593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b757402c-74ee-491f-b6b5-ffd8a604c440 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:23.397782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b757402c-74ee-491f-b6b5-ffd8a604c440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:23.405838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f1112-2161-448d-8f76-0cab8955c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:23.406472 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f1112-2161-448d-8f76-0cab8955c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:23.406749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f1112-2161-448d-8f76-0cab8955c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:23.407017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f1112-2161-448d-8f76-0cab8955c1e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:23.407650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f1112-2161-448d-8f76-0cab8955c1e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:23.407950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f1112-2161-448d-8f76-0cab8955c1e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:23.409301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f1112-2161-448d-8f76-0cab8955c1e5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:23.420868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 522/1075] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:23.426566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f1112-2161-448d-8f76-0cab8955c1e5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:23.467796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 554/1076] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:16:23.526829 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f1112-2161-448d-8f76-0cab8955c1e5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:23.534031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:23.561110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c88879-6de9-4f05-8456-e95f1379e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:23.561727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88879-6de9-4f05-8456-e95f1379e2ed None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:23.562004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88879-6de9-4f05-8456-e95f1379e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:23.562275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88879-6de9-4f05-8456-e95f1379e2ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:23.568748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c88879-6de9-4f05-8456-e95f1379e2ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:23.570196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c88879-6de9-4f05-8456-e95f1379e2ed None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f4c88879-6de9-4f05-8456-e95f1379e2ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:16:23.581461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:23.582429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:23.583325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:16:23.583325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:16:23.583325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:16:23.583325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:16:23.583325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:16:23.583325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:16:23.583325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:16:23.583325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:23.583325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 523/1077] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:23.589421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757402c-74ee-491f-b6b5-ffd8a604c440 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:23.666067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:23.690091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757402c-74ee-491f-b6b5-ffd8a604c440 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:23.723513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65bcef-bb16-4dde-ae41-aefcdc8241f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:23.724106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65bcef-bb16-4dde-ae41-aefcdc8241f7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:23.724406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65bcef-bb16-4dde-ae41-aefcdc8241f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:23.724671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65bcef-bb16-4dde-ae41-aefcdc8241f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:23.725345 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65bcef-bb16-4dde-ae41-aefcdc8241f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:23.725642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65bcef-bb16-4dde-ae41-aefcdc8241f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:23.727092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65bcef-bb16-4dde-ae41-aefcdc8241f7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:23.736088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c88879-6de9-4f05-8456-e95f1379e2ed None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:23.742425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 555/1078] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:23.744574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65bcef-bb16-4dde-ae41-aefcdc8241f7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:23.840986 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c88879-6de9-4f05-8456-e95f1379e2ed None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:23.845663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65bcef-bb16-4dde-ae41-aefcdc8241f7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:23.875332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9343f-1784-4581-8259-af779d0caae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:23.875962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9343f-1784-4581-8259-af779d0caae3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:23.876242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9343f-1784-4581-8259-af779d0caae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:23.876511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9343f-1784-4581-8259-af779d0caae3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:23.879418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1e9cd-37b0-499f-bd32-369eedbdca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:23.880075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1e9cd-37b0-499f-bd32-369eedbdca2f None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:23.880359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1e9cd-37b0-499f-bd32-369eedbdca2f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:23.880633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1e9cd-37b0-499f-bd32-369eedbdca2f None admin] PATH_INFO: `/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/67b0698294e94845ae0dbdfb87059755/roles/cc4e7138f6854039a5bf03f9538bb90d` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:23.882819 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1e9cd-37b0-499f-bd32-369eedbdca2f None admin] RBAC: Authorizing `identity:create_grant(project_id=fd655924cf9a4736ba38740ade63ec52, user_id=67b0698294e94845ae0dbdfb87059755, role_id=cc4e7138f6854039a5bf03f9538bb90d)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:23.884258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1e9cd-37b0-499f-bd32-369eedbdca2f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:23.887115 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9343f-1784-4581-8259-af779d0caae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:16:23.887268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-cec9343f-1784-4581-8259-af779d0caae3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:16:23.892779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:23.894141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:23.895339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 524/1079] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:16:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:23.900027 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9343f-1784-4581-8259-af779d0caae3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:23.903047 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 556/1080] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:16:23 2022] PUT /identity/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/67b0698294e94845ae0dbdfb87059755/roles/cc4e7138f6854039a5bf03f9538bb90d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:16:23.930948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:24.009542 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9343f-1784-4581-8259-af779d0caae3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:24.047402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71eb3d-aed6-4d8c-9952-e7d2f846254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:24.048020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71eb3d-aed6-4d8c-9952-e7d2f846254f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:24.048294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71eb3d-aed6-4d8c-9952-e7d2f846254f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:24.048561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71eb3d-aed6-4d8c-9952-e7d2f846254f None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:24.049227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71eb3d-aed6-4d8c-9952-e7d2f846254f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:24.049522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71eb3d-aed6-4d8c-9952-e7d2f846254f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:24.050937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71eb3d-aed6-4d8c-9952-e7d2f846254f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:24.060337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 525/1081] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:16:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:24.067106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1e9cd-37b0-499f-bd32-369eedbdca2f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:24.168654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1e9cd-37b0-499f-bd32-369eedbdca2f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:24.201751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b052cf8-02f6-44c7-b4b3-39c73c2883b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:24.202361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b052cf8-02f6-44c7-b4b3-39c73c2883b3 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:24.202668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b052cf8-02f6-44c7-b4b3-39c73c2883b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:24.202943 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b052cf8-02f6-44c7-b4b3-39c73c2883b3 None admin] PATH_INFO: `/v3/users/b4343e918eb64726b2bf9f78fe1619d4` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:24.204053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b052cf8-02f6-44c7-b4b3-39c73c2883b3 None admin] RBAC: Authorizing `identity:get_user(user_id=b4343e918eb64726b2bf9f78fe1619d4)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:24.205486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b052cf8-02f6-44c7-b4b3-39c73c2883b3 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:24.207089 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 557/1082] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:16:24 2022] GET /identity/v3/users/b4343e918eb64726b2bf9f78fe1619d4 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:24.212877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71eb3d-aed6-4d8c-9952-e7d2f846254f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:24.300796 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:24.317464 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71eb3d-aed6-4d8c-9952-e7d2f846254f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:24.353826 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118450-e01d-477e-82c0-99140237e794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:24.354486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118450-e01d-477e-82c0-99140237e794 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:24.354764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118450-e01d-477e-82c0-99140237e794 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:24.355031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118450-e01d-477e-82c0-99140237e794 None admin] PATH_INFO: `/v3/projects/19f3267023f84fa7b03bc06f543e8276` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:24.356123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7118450-e01d-477e-82c0-99140237e794 None admin] RBAC: Authorizing `identity:get_project(project_id=19f3267023f84fa7b03bc06f543e8276)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:24.357672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7118450-e01d-477e-82c0-99140237e794 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:24.359555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 526/1083] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:16:24 2022] GET /identity/v3/projects/19f3267023f84fa7b03bc06f543e8276 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:24.365492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b052cf8-02f6-44c7-b4b3-39c73c2883b3 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:24.428357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:24.467892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b052cf8-02f6-44c7-b4b3-39c73c2883b3 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:24.500402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0ad4-16c6-4441-8ed3-06430b42a822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:24.501041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0ad4-16c6-4441-8ed3-06430b42a822 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:24.501312 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0ad4-16c6-4441-8ed3-06430b42a822 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:24.501577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0ad4-16c6-4441-8ed3-06430b42a822 None admin] PATH_INFO: `/v3/projects/19f3267023f84fa7b03bc06f543e8276/users/b4343e918eb64726b2bf9f78fe1619d4/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:24.503449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f0ad4-16c6-4441-8ed3-06430b42a822 None admin] RBAC: Authorizing `identity:create_grant(project_id=19f3267023f84fa7b03bc06f543e8276, user_id=b4343e918eb64726b2bf9f78fe1619d4, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:24.504871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f0ad4-16c6-4441-8ed3-06430b42a822 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:24.517956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 558/1084] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:16:24 2022] PUT /identity/v3/projects/19f3267023f84fa7b03bc06f543e8276/users/b4343e918eb64726b2bf9f78fe1619d4/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:16:26.058146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da51dda-2b8d-4667-949a-38fdac082eda None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:26.058810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da51dda-2b8d-4667-949a-38fdac082eda None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:26.058810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da51dda-2b8d-4667-949a-38fdac082eda None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:26.060068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 527/1085] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:26.066257 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5edd0-3853-4542-b3fb-003332a44b6b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:26.066720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5edd0-3853-4542-b3fb-003332a44b6b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:26.066820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5edd0-3853-4542-b3fb-003332a44b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:26.084902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cbb5edd0-3853-4542-b3fb-003332a44b6b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:26.086079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cbb5edd0-3853-4542-b3fb-003332a44b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:26.152689 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 559/1086] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:26.420984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da51dda-2b8d-4667-949a-38fdac082eda None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:26.522606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da51dda-2b8d-4667-949a-38fdac082eda None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:26.559616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966665fb-eba2-4002-acb7-bc7daa22c3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:26.560272 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966665fb-eba2-4002-acb7-bc7daa22c3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:26.561073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966665fb-eba2-4002-acb7-bc7daa22c3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:26.561351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966665fb-eba2-4002-acb7-bc7daa22c3f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:26.572728 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966665fb-eba2-4002-acb7-bc7daa22c3f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-966665fb-eba2-4002-acb7-bc7daa22c3f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:16:26.578170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:26.579401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:26.580767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 528/1087] 10.222.0.33 () {56 vars in 1120 bytes} [Mon Sep 12 23:16:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:26.585232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5edd0-3853-4542-b3fb-003332a44b6b None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:26.639927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:26.657179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2edd-891b-45e4-bb9a-5a43624b5fca None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:26.657458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2edd-891b-45e4-bb9a-5a43624b5fca None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:26.657729 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2edd-891b-45e4-bb9a-5a43624b5fca None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:26.659670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 529/1088] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:26.664556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e700a-2512-4cc8-8316-de3a441862d4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:26.664834 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e700a-2512-4cc8-8316-de3a441862d4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:26.665100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e700a-2512-4cc8-8316-de3a441862d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:26.683128 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d38e700a-2512-4cc8-8316-de3a441862d4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:26.684316 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d38e700a-2512-4cc8-8316-de3a441862d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:26.686793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5edd0-3853-4542-b3fb-003332a44b6b None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:26.695543 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:26.723411 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df0eee-4615-4fa0-9048-c831e6b3eeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:26.724012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0eee-4615-4fa0-9048-c831e6b3eeae None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:26.724291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0eee-4615-4fa0-9048-c831e6b3eeae None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:26.724562 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0eee-4615-4fa0-9048-c831e6b3eeae None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:26.725222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df0eee-4615-4fa0-9048-c831e6b3eeae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:26.725526 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df0eee-4615-4fa0-9048-c831e6b3eeae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:26.726937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df0eee-4615-4fa0-9048-c831e6b3eeae None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:26.734939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 560/1089] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Sep 12 23:16:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:26.740735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df0eee-4615-4fa0-9048-c831e6b3eeae None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:26.753945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 530/1090] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:16:26.840209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df0eee-4615-4fa0-9048-c831e6b3eeae None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:26.855750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:26.874883 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013afca2-82e4-45ca-a928-05144d67007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:26.875505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013afca2-82e4-45ca-a928-05144d67007e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:26.875781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013afca2-82e4-45ca-a928-05144d67007e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:26.876052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013afca2-82e4-45ca-a928-05144d67007e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:26.886310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013afca2-82e4-45ca-a928-05144d67007e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:26.887768 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013afca2-82e4-45ca-a928-05144d67007e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-013afca2-82e4-45ca-a928-05144d67007e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:16:26.901651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:26.902779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:16:26.903666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:16:26.903666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:26.903666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:26.903666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 561/1091] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:26.908521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e700a-2512-4cc8-8316-de3a441862d4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:27.008196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e700a-2512-4cc8-8316-de3a441862d4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:27.023756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013afca2-82e4-45ca-a928-05144d67007e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:27.046260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0df49c-533c-4daf-ad35-39debbceea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:27.046917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0df49c-533c-4daf-ad35-39debbceea9b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:27.047206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0df49c-533c-4daf-ad35-39debbceea9b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:27.047478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0df49c-533c-4daf-ad35-39debbceea9b None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:27.048123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0df49c-533c-4daf-ad35-39debbceea9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:27.048428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0df49c-533c-4daf-ad35-39debbceea9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:27.049809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0df49c-533c-4daf-ad35-39debbceea9b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:27.061674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 531/1092] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:27.067300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0df49c-533c-4daf-ad35-39debbceea9b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:27.076178 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:27.126359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013afca2-82e4-45ca-a928-05144d67007e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:27.159862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26fbee-48c8-45fa-857f-acc62a57d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:27.160411 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26fbee-48c8-45fa-857f-acc62a57d264 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:27.160691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26fbee-48c8-45fa-857f-acc62a57d264 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:27.160963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26fbee-48c8-45fa-857f-acc62a57d264 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:27.166767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0df49c-533c-4daf-ad35-39debbceea9b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:27.172896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26fbee-48c8-45fa-857f-acc62a57d264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-fa26fbee-48c8-45fa-857f-acc62a57d264 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:16:27.177686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:27.178643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:27.179676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 562/1093] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:16:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:27.184700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26fbee-48c8-45fa-857f-acc62a57d264 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:27.201903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f5f32-37b2-4da2-ac2f-4ff3a4fe151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:27.202569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f5f32-37b2-4da2-ac2f-4ff3a4fe151c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:27.202857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f5f32-37b2-4da2-ac2f-4ff3a4fe151c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:27.203127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f5f32-37b2-4da2-ac2f-4ff3a4fe151c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:27.210553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f5f32-37b2-4da2-ac2f-4ff3a4fe151c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:27.211986 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f5f32-37b2-4da2-ac2f-4ff3a4fe151c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:27.212722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d76f5f32-37b2-4da2-ac2f-4ff3a4fe151c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:16:27.223879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:27.224958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:27.225992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:27.225992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:27.225992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:16:27.225992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:16:27.225992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:16:27.225992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:16:27.225992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:16:27.225992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:16:27.225992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:16:27.225992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:27.225992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 532/1094] 10.222.0.33 () {56 vars in 1093 bytes} [Mon Sep 12 23:16:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:27.230846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f5f32-37b2-4da2-ac2f-4ff3a4fe151c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:27.286820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26fbee-48c8-45fa-857f-acc62a57d264 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:27.296566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:27.320846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f54648-1516-4e2b-903e-c67f7a82a509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:27.321442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f54648-1516-4e2b-903e-c67f7a82a509 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:27.321715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f54648-1516-4e2b-903e-c67f7a82a509 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:27.321984 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f54648-1516-4e2b-903e-c67f7a82a509 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:27.322661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f54648-1516-4e2b-903e-c67f7a82a509 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:27.322964 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f54648-1516-4e2b-903e-c67f7a82a509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:27.324333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f54648-1516-4e2b-903e-c67f7a82a509 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:27.332143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f5f32-37b2-4da2-ac2f-4ff3a4fe151c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:27.333549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 563/1095] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:16:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:27.339128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f54648-1516-4e2b-903e-c67f7a82a509 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:27.365681 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8a4d6-92e4-427e-835d-bf3d0b267761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:27.366287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8a4d6-92e4-427e-835d-bf3d0b267761 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:27.366600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8a4d6-92e4-427e-835d-bf3d0b267761 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:27.366876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8a4d6-92e4-427e-835d-bf3d0b267761 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:27.367599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8a4d6-92e4-427e-835d-bf3d0b267761 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:27.367909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8a4d6-92e4-427e-835d-bf3d0b267761 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:27.369338 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8a4d6-92e4-427e-835d-bf3d0b267761 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:27.396538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 533/1096] 10.222.0.33 () {56 vars in 1133 bytes} [Mon Sep 12 23:16:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:27.402497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8a4d6-92e4-427e-835d-bf3d0b267761 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:27.431261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:27.442343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f54648-1516-4e2b-903e-c67f7a82a509 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:27.476305 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea791bd-2ae0-47e4-a0e8-35ec284f3c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:27.476929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea791bd-2ae0-47e4-a0e8-35ec284f3c49 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:27.477203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea791bd-2ae0-47e4-a0e8-35ec284f3c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:27.477476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea791bd-2ae0-47e4-a0e8-35ec284f3c49 None admin] PATH_INFO: `/v3/users/b4343e918eb64726b2bf9f78fe1619d4` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:27.478622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea791bd-2ae0-47e4-a0e8-35ec284f3c49 None admin] RBAC: Authorizing `identity:get_user(user_id=b4343e918eb64726b2bf9f78fe1619d4)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:27.480042 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea791bd-2ae0-47e4-a0e8-35ec284f3c49 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:27.481788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 564/1097] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:16:27 2022] GET /identity/v3/users/b4343e918eb64726b2bf9f78fe1619d4 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:27.487297 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea791bd-2ae0-47e4-a0e8-35ec284f3c49 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:27.505322 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8a4d6-92e4-427e-835d-bf3d0b267761 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:27.528329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:27.541300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dae45-de97-47dd-9e45-a3c5e3f03886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:27.542080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dae45-de97-47dd-9e45-a3c5e3f03886 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:27.542360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dae45-de97-47dd-9e45-a3c5e3f03886 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:27.542661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dae45-de97-47dd-9e45-a3c5e3f03886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:27.588187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea791bd-2ae0-47e4-a0e8-35ec284f3c49 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:27.609962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dae45-de97-47dd-9e45-a3c5e3f03886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:27.611449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dae45-de97-47dd-9e45-a3c5e3f03886 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:27.623077 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19397dd-ce9b-4c89-a09c-a4b366c0e956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:27.624061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19397dd-ce9b-4c89-a09c-a4b366c0e956 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:27.624348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19397dd-ce9b-4c89-a09c-a4b366c0e956 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:27.624615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19397dd-ce9b-4c89-a09c-a4b366c0e956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:27.651466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:27.693277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19397dd-ce9b-4c89-a09c-a4b366c0e956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:27.694803 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19397dd-ce9b-4c89-a09c-a4b366c0e956 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:27.710321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 534/1098] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:16:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 23:16:27.716164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dae45-de97-47dd-9e45-a3c5e3f03886 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:27.740807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:27.793635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 565/1099] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:16:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 23:16:27.800103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19397dd-ce9b-4c89-a09c-a4b366c0e956 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:27.815146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dae45-de97-47dd-9e45-a3c5e3f03886 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:27.849127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc177c-32fc-4905-8c39-b68a93ed9c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:27.849816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc177c-32fc-4905-8c39-b68a93ed9c49 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:27.850101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc177c-32fc-4905-8c39-b68a93ed9c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:27.850387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc177c-32fc-4905-8c39-b68a93ed9c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:27.855028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:27.861314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc177c-32fc-4905-8c39-b68a93ed9c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:27.862791 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc177c-32fc-4905-8c39-b68a93ed9c49 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-13cc177c-32fc-4905-8c39-b68a93ed9c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:16:27.877395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:27.878523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:16:27.879433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:16:27.879433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:16:27.879433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:27.879433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 535/1100] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:27.884198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc177c-32fc-4905-8c39-b68a93ed9c49 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:27.898727 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19397dd-ce9b-4c89-a09c-a4b366c0e956 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:27.933407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40387a2b-b1e2-4e50-a0fc-1bf20ed51154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:27.934029 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40387a2b-b1e2-4e50-a0fc-1bf20ed51154 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:27.934304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40387a2b-b1e2-4e50-a0fc-1bf20ed51154 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:27.934596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40387a2b-b1e2-4e50-a0fc-1bf20ed51154 None admin] PATH_INFO: `/v3/projects/19f3267023f84fa7b03bc06f543e8276` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:27.936378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40387a2b-b1e2-4e50-a0fc-1bf20ed51154 None admin] RBAC: Authorizing `identity:get_project(project_id=19f3267023f84fa7b03bc06f543e8276)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:27.937790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40387a2b-b1e2-4e50-a0fc-1bf20ed51154 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:27.939413 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 566/1101] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:16:27 2022] GET /identity/v3/projects/19f3267023f84fa7b03bc06f543e8276 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:27.945350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40387a2b-b1e2-4e50-a0fc-1bf20ed51154 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:27.960259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:27.983794 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc177c-32fc-4905-8c39-b68a93ed9c49 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:28.016716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f8eb7-0281-4dde-a9bb-35007aa6ef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:28.017320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f8eb7-0281-4dde-a9bb-35007aa6ef71 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:28.017599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f8eb7-0281-4dde-a9bb-35007aa6ef71 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:28.017872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f8eb7-0281-4dde-a9bb-35007aa6ef71 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:28.018540 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f8eb7-0281-4dde-a9bb-35007aa6ef71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:28.018844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f8eb7-0281-4dde-a9bb-35007aa6ef71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:28.020209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f8eb7-0281-4dde-a9bb-35007aa6ef71 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:28.032164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 536/1102] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:28.037841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f8eb7-0281-4dde-a9bb-35007aa6ef71 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:28.046609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40387a2b-b1e2-4e50-a0fc-1bf20ed51154 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:28.072099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:28.083114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd142f-b1d5-44f9-b325-1ee21b9179c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:28.083823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd142f-b1d5-44f9-b325-1ee21b9179c7 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:28.084100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd142f-b1d5-44f9-b325-1ee21b9179c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:28.084367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd142f-b1d5-44f9-b325-1ee21b9179c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:28.085081 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd142f-b1d5-44f9-b325-1ee21b9179c7 None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=19f3267023f84fa7b03bc06f543e8276, user.id=b4343e918eb64726b2bf9f78fe1619d4) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:28.085382 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd142f-b1d5-44f9-b325-1ee21b9179c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:28.086828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd142f-b1d5-44f9-b325-1ee21b9179c7 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:28.093131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 567/1103] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:16:27 2022] GET /identity/v3/role_assignments?user.id=b4343e918eb64726b2bf9f78fe1619d4&scope.project.id=19f3267023f84fa7b03bc06f543e8276&role.id=6413aac4240a46ba816472c29e305973 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:16:28.141845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f8eb7-0281-4dde-a9bb-35007aa6ef71 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:28.178332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219053-f39d-41d3-bb07-4a162f6cf0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:28.179009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219053-f39d-41d3-bb07-4a162f6cf0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:28.179288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219053-f39d-41d3-bb07-4a162f6cf0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:28.179563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219053-f39d-41d3-bb07-4a162f6cf0a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:28.182685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:28.188933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77219053-f39d-41d3-bb07-4a162f6cf0a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:28.190870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77219053-f39d-41d3-bb07-4a162f6cf0a9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-77219053-f39d-41d3-bb07-4a162f6cf0a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:16:28.203296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:28.204350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:28.205260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:16:28.205260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:16:28.205260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:16:28.205260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:16:28.205260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:16:28.205260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:16:28.205260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:16:28.205260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:28.205260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 537/1104] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:16:28.210487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd142f-b1d5-44f9-b325-1ee21b9179c7 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:28.315088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd142f-b1d5-44f9-b325-1ee21b9179c7 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:28.348359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86999832-8f2e-4e08-8320-aaa8ce51333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:28.348962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86999832-8f2e-4e08-8320-aaa8ce51333a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:28.349242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86999832-8f2e-4e08-8320-aaa8ce51333a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:28.349516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86999832-8f2e-4e08-8320-aaa8ce51333a None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:28.350204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86999832-8f2e-4e08-8320-aaa8ce51333a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:28.350668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86999832-8f2e-4e08-8320-aaa8ce51333a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:28.352092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86999832-8f2e-4e08-8320-aaa8ce51333a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:28.364555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 568/1105] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:16:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:28.370345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219053-f39d-41d3-bb07-4a162f6cf0a9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:28.473705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219053-f39d-41d3-bb07-4a162f6cf0a9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:28.507651 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3abcf0-54bf-44dc-8a96-ddd263689929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:28.508251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3abcf0-54bf-44dc-8a96-ddd263689929 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:28.508527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3abcf0-54bf-44dc-8a96-ddd263689929 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:28.508794 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3abcf0-54bf-44dc-8a96-ddd263689929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:28.509508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3abcf0-54bf-44dc-8a96-ddd263689929 None admin] RBAC: Adding query filter params (role.id=cc4e7138f6854039a5bf03f9538bb90d, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=67b0698294e94845ae0dbdfb87059755) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:28.509813 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3abcf0-54bf-44dc-8a96-ddd263689929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:28.511279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3abcf0-54bf-44dc-8a96-ddd263689929 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:28.517135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 538/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:16:28 2022] GET /identity/v3/role_assignments?user.id=67b0698294e94845ae0dbdfb87059755&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=cc4e7138f6854039a5bf03f9538bb90d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:30.339274 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ba328-fd37-4473-bcd4-b1af10c25d82 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:30.339812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ba328-fd37-4473-bcd4-b1af10c25d82 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:30.339812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ba328-fd37-4473-bcd4-b1af10c25d82 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:30.341114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 569/1107] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:30.346694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c47b09-3b12-4b7d-8b9f-1b41872ada23 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:30.347127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c47b09-3b12-4b7d-8b9f-1b41872ada23 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:30.347245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c47b09-3b12-4b7d-8b9f-1b41872ada23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:30.365769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f4c47b09-3b12-4b7d-8b9f-1b41872ada23 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:30.367302 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f4c47b09-3b12-4b7d-8b9f-1b41872ada23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:30.427981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:30.441289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 539/1108] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:30.781308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ba328-fd37-4473-bcd4-b1af10c25d82 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:30.831265 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:30.881009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ba328-fd37-4473-bcd4-b1af10c25d82 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:30.914438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029a33d-69c0-4eb3-a643-64d68ae0ae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:30.915055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029a33d-69c0-4eb3-a643-64d68ae0ae88 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:30.915330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029a33d-69c0-4eb3-a643-64d68ae0ae88 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:30.915600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029a33d-69c0-4eb3-a643-64d68ae0ae88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:30.916954 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029a33d-69c0-4eb3-a643-64d68ae0ae88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:30.918412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029a33d-69c0-4eb3-a643-64d68ae0ae88 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:30.919983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 570/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:30.925756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c47b09-3b12-4b7d-8b9f-1b41872ada23 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:31.023383 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c47b09-3b12-4b7d-8b9f-1b41872ada23 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:31.056715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a465c-caf8-4748-ac86-697f7593663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:31.057248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a465c-caf8-4748-ac86-697f7593663d None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:31.057528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a465c-caf8-4748-ac86-697f7593663d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:31.057804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a465c-caf8-4748-ac86-697f7593663d None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:31.058486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a465c-caf8-4748-ac86-697f7593663d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:31.059917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a465c-caf8-4748-ac86-697f7593663d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:31.081696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 540/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:16:30 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:16:33.292237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e8a78-6022-4073-9f9a-c5ddf0549477 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:33.292796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e8a78-6022-4073-9f9a-c5ddf0549477 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:33.292796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e8a78-6022-4073-9f9a-c5ddf0549477 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:33.294087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 571/1111] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:33.299628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87cee6-5109-474a-bbb2-7d6a8983b327 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:33.300042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87cee6-5109-474a-bbb2-7d6a8983b327 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:33.300206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87cee6-5109-474a-bbb2-7d6a8983b327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:33.318669 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2a87cee6-5109-474a-bbb2-7d6a8983b327 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:33.319856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2a87cee6-5109-474a-bbb2-7d6a8983b327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:33.360936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:33.387629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 541/1112] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:33.657867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e8a78-6022-4073-9f9a-c5ddf0549477 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:33.756216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e8a78-6022-4073-9f9a-c5ddf0549477 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:33.773145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:33.791345 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ad04e-9abb-404d-862a-2626d8aeb531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:33.791958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ad04e-9abb-404d-862a-2626d8aeb531 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:33.792235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ad04e-9abb-404d-862a-2626d8aeb531 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:33.792509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ad04e-9abb-404d-862a-2626d8aeb531 None admin] PATH_INFO: `/v3/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:33.793871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ad04e-9abb-404d-862a-2626d8aeb531 None admin] RBAC: Authorizing `identity:get_role(role_id=ac7eb9c247e94edda4cd6ad66b5e6a9a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:33.795469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ad04e-9abb-404d-862a-2626d8aeb531 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:33.796767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 572/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:16:33 2022] GET /identity/v3/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:33.802458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87cee6-5109-474a-bbb2-7d6a8983b327 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:33.898504 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87cee6-5109-474a-bbb2-7d6a8983b327 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:33.932876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff3e81-d210-4c74-94e4-1deaacf24d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:33.933433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff3e81-d210-4c74-94e4-1deaacf24d5a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:33.933715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff3e81-d210-4c74-94e4-1deaacf24d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:33.933989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff3e81-d210-4c74-94e4-1deaacf24d5a None admin] PATH_INFO: `/v3/users/7e24abb1a6664e2ba1ba14417c1cf592` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:33.947265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff3e81-d210-4c74-94e4-1deaacf24d5a None admin] RBAC: Authorizing `identity:get_user(user_id=7e24abb1a6664e2ba1ba14417c1cf592)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:33.948713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff3e81-d210-4c74-94e4-1deaacf24d5a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:33.950274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 542/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:16:33 2022] GET /identity/v3/users/7e24abb1a6664e2ba1ba14417c1cf592 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:33.956669 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ad04e-9abb-404d-862a-2626d8aeb531 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:34.053197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ad04e-9abb-404d-862a-2626d8aeb531 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:34.086435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d741c9-7836-46e7-990e-f0b767821024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:34.087030 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d741c9-7836-46e7-990e-f0b767821024 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:34.087309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d741c9-7836-46e7-990e-f0b767821024 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:34.087580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d741c9-7836-46e7-990e-f0b767821024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:34.140326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:34.153114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d741c9-7836-46e7-990e-f0b767821024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:34.154614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d741c9-7836-46e7-990e-f0b767821024 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:34.248960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 573/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:16:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:16:34.255077 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff3e81-d210-4c74-94e4-1deaacf24d5a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:34.288375 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:34.355701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff3e81-d210-4c74-94e4-1deaacf24d5a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:34.392129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22481f8e-3979-454f-915e-29dddf8a10b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:34.392784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22481f8e-3979-454f-915e-29dddf8a10b0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:34.393057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22481f8e-3979-454f-915e-29dddf8a10b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:34.393323 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22481f8e-3979-454f-915e-29dddf8a10b0 None admin] PATH_INFO: `/v3/projects/19f3267023f84fa7b03bc06f543e8276` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:34.394441 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22481f8e-3979-454f-915e-29dddf8a10b0 None admin] RBAC: Authorizing `identity:get_project(project_id=19f3267023f84fa7b03bc06f543e8276)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:34.395858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22481f8e-3979-454f-915e-29dddf8a10b0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:34.397471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 543/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:16:34 2022] GET /identity/v3/projects/19f3267023f84fa7b03bc06f543e8276 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:34.403724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d741c9-7836-46e7-990e-f0b767821024 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:34.484722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:34.500516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d741c9-7836-46e7-990e-f0b767821024 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:34.533026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bccb4-5749-45f8-a089-f622a2b8ac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:34.533631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bccb4-5749-45f8-a089-f622a2b8ac80 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:34.533888 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bccb4-5749-45f8-a089-f622a2b8ac80 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:34.534157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bccb4-5749-45f8-a089-f622a2b8ac80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:34.534907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bccb4-5749-45f8-a089-f622a2b8ac80 None admin] RBAC: Adding query filter params (role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a, scope.project.id=19f3267023f84fa7b03bc06f543e8276, user.id=7e24abb1a6664e2ba1ba14417c1cf592) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:34.535211 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bccb4-5749-45f8-a089-f622a2b8ac80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:34.536618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bccb4-5749-45f8-a089-f622a2b8ac80 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:34.541951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 574/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:16:34 2022] GET /identity/v3/role_assignments?user.id=7e24abb1a6664e2ba1ba14417c1cf592&scope.project.id=19f3267023f84fa7b03bc06f543e8276&role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:36.642166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a61d5-41de-4c9d-a57a-2f7afcf2da7d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:36.642836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a61d5-41de-4c9d-a57a-2f7afcf2da7d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:36.642836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a61d5-41de-4c9d-a57a-2f7afcf2da7d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:36.643993 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 544/1118] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:36.649081 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e1047-8e9d-402f-bbcf-c8d8ec6f0895 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:36.649476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e1047-8e9d-402f-bbcf-c8d8ec6f0895 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:36.649633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e1047-8e9d-402f-bbcf-c8d8ec6f0895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:36.668419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e90e1047-8e9d-402f-bbcf-c8d8ec6f0895 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:36.669674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e90e1047-8e9d-402f-bbcf-c8d8ec6f0895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:36.734904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 575/1119] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:37.004772 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a61d5-41de-4c9d-a57a-2f7afcf2da7d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:37.104661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a61d5-41de-4c9d-a57a-2f7afcf2da7d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:37.106147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:37.140004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0d778-e6d7-47bf-9b02-d7d0d8dad23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:37.140628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0d778-e6d7-47bf-9b02-d7d0d8dad23f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:37.140908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0d778-e6d7-47bf-9b02-d7d0d8dad23f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:37.141179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0d778-e6d7-47bf-9b02-d7d0d8dad23f None admin] PATH_INFO: `/v3/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:37.142590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0d778-e6d7-47bf-9b02-d7d0d8dad23f None admin] RBAC: Authorizing `identity:get_role(role_id=ac7eb9c247e94edda4cd6ad66b5e6a9a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:37.143952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0d778-e6d7-47bf-9b02-d7d0d8dad23f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:37.145262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 545/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:16:37 2022] GET /identity/v3/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:37.151023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e1047-8e9d-402f-bbcf-c8d8ec6f0895 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:37.227298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:37.245949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e1047-8e9d-402f-bbcf-c8d8ec6f0895 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:37.278919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b7e46-47d1-4336-b96b-53b75e77f54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:37.279571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b7e46-47d1-4336-b96b-53b75e77f54b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:37.279846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b7e46-47d1-4336-b96b-53b75e77f54b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:37.280112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b7e46-47d1-4336-b96b-53b75e77f54b None admin] PATH_INFO: `/v3/users/7e24abb1a6664e2ba1ba14417c1cf592` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:37.281210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b7e46-47d1-4336-b96b-53b75e77f54b None admin] RBAC: Authorizing `identity:get_user(user_id=7e24abb1a6664e2ba1ba14417c1cf592)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:37.282646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b7e46-47d1-4336-b96b-53b75e77f54b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:37.284173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 576/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:16:37 2022] GET /identity/v3/users/7e24abb1a6664e2ba1ba14417c1cf592 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:37.289921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0d778-e6d7-47bf-9b02-d7d0d8dad23f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:37.390028 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0d778-e6d7-47bf-9b02-d7d0d8dad23f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:37.423760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2022d-70f7-4383-8b56-299a5fe91373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:37.424387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2022d-70f7-4383-8b56-299a5fe91373 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:37.424665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2022d-70f7-4383-8b56-299a5fe91373 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:37.424935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2022d-70f7-4383-8b56-299a5fe91373 None admin] PATH_INFO: `/v3/projects/19f3267023f84fa7b03bc06f543e8276` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:37.426033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2022d-70f7-4383-8b56-299a5fe91373 None admin] RBAC: Authorizing `identity:get_project(project_id=19f3267023f84fa7b03bc06f543e8276)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:37.427486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2022d-70f7-4383-8b56-299a5fe91373 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:37.429087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 546/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:16:37 2022] GET /identity/v3/projects/19f3267023f84fa7b03bc06f543e8276 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:37.435571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b7e46-47d1-4336-b96b-53b75e77f54b None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:37.534170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b7e46-47d1-4336-b96b-53b75e77f54b None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:37.566596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45ea48-2be3-414e-97c8-c9d79697a869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:37.567234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45ea48-2be3-414e-97c8-c9d79697a869 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:37.567512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45ea48-2be3-414e-97c8-c9d79697a869 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:37.567784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45ea48-2be3-414e-97c8-c9d79697a869 None admin] PATH_INFO: `/v3/projects/19f3267023f84fa7b03bc06f543e8276/users/7e24abb1a6664e2ba1ba14417c1cf592/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:37.569852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45ea48-2be3-414e-97c8-c9d79697a869 None admin] RBAC: Authorizing `identity:create_grant(project_id=19f3267023f84fa7b03bc06f543e8276, user_id=7e24abb1a6664e2ba1ba14417c1cf592, role_id=ac7eb9c247e94edda4cd6ad66b5e6a9a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:37.571299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45ea48-2be3-414e-97c8-c9d79697a869 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:37.584199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 577/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:16:37 2022] PUT /identity/v3/projects/19f3267023f84fa7b03bc06f543e8276/users/7e24abb1a6664e2ba1ba14417c1cf592/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:16:39.743378 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb2801-898e-42c1-9922-045a19d603b3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:39.743912 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb2801-898e-42c1-9922-045a19d603b3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:39.743912 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb2801-898e-42c1-9922-045a19d603b3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:39.745261 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 547/1124] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:39.751308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78419487-84e6-4f74-a2f8-ef0a65129c39 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:39.751732 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78419487-84e6-4f74-a2f8-ef0a65129c39 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:39.751838 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78419487-84e6-4f74-a2f8-ef0a65129c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:39.769743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-78419487-84e6-4f74-a2f8-ef0a65129c39 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:39.770949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-78419487-84e6-4f74-a2f8-ef0a65129c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:39.772874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:39.837331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 578/1125] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:40.109574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb2801-898e-42c1-9922-045a19d603b3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:40.149150 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:40.209034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb2801-898e-42c1-9922-045a19d603b3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:40.242279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c0d9d-2229-4c1e-95d3-798862d2eb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:40.242924 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c0d9d-2229-4c1e-95d3-798862d2eb3d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:40.243202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c0d9d-2229-4c1e-95d3-798862d2eb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:40.243472 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c0d9d-2229-4c1e-95d3-798862d2eb3d None admin] PATH_INFO: `/v3/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:40.244835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c0d9d-2229-4c1e-95d3-798862d2eb3d None admin] RBAC: Authorizing `identity:get_role(role_id=ac7eb9c247e94edda4cd6ad66b5e6a9a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:40.246208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c0d9d-2229-4c1e-95d3-798862d2eb3d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:40.248067 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 548/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:16:40 2022] GET /identity/v3/roles/ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:40.253794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78419487-84e6-4f74-a2f8-ef0a65129c39 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:40.349470 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78419487-84e6-4f74-a2f8-ef0a65129c39 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:40.384151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ed0f5-1634-44b5-a276-db2197218c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:40.384782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ed0f5-1634-44b5-a276-db2197218c12 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:40.385062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ed0f5-1634-44b5-a276-db2197218c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:40.385336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ed0f5-1634-44b5-a276-db2197218c12 None admin] PATH_INFO: `/v3/users/7e24abb1a6664e2ba1ba14417c1cf592` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:40.386470 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ed0f5-1634-44b5-a276-db2197218c12 None admin] RBAC: Authorizing `identity:get_user(user_id=7e24abb1a6664e2ba1ba14417c1cf592)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:40.387932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ed0f5-1634-44b5-a276-db2197218c12 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:40.389615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 579/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:16:40 2022] GET /identity/v3/users/7e24abb1a6664e2ba1ba14417c1cf592 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:40.395279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c0d9d-2229-4c1e-95d3-798862d2eb3d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:40.493007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c0d9d-2229-4c1e-95d3-798862d2eb3d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:40.500578 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:40.527274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc6796-8fd9-4cd2-9e4a-b7dc21c89412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:40.527865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc6796-8fd9-4cd2-9e4a-b7dc21c89412 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:40.528143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc6796-8fd9-4cd2-9e4a-b7dc21c89412 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:40.528412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc6796-8fd9-4cd2-9e4a-b7dc21c89412 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:40.594897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc6796-8fd9-4cd2-9e4a-b7dc21c89412 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:40.596339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc6796-8fd9-4cd2-9e4a-b7dc21c89412 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:40.691360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 549/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:16:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:16:40.697172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ed0f5-1634-44b5-a276-db2197218c12 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:40.706369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:40.796343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ed0f5-1634-44b5-a276-db2197218c12 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:40.829621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0856ac8-21b9-47bd-882a-2b4e5fead012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:40.830236 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0856ac8-21b9-47bd-882a-2b4e5fead012 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:40.830549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0856ac8-21b9-47bd-882a-2b4e5fead012 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:40.830825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0856ac8-21b9-47bd-882a-2b4e5fead012 None admin] PATH_INFO: `/v3/projects/19f3267023f84fa7b03bc06f543e8276` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:40.831935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0856ac8-21b9-47bd-882a-2b4e5fead012 None admin] RBAC: Authorizing `identity:get_project(project_id=19f3267023f84fa7b03bc06f543e8276)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:40.833365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0856ac8-21b9-47bd-882a-2b4e5fead012 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:40.835010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 580/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:16:40 2022] GET /identity/v3/projects/19f3267023f84fa7b03bc06f543e8276 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:40.841212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc6796-8fd9-4cd2-9e4a-b7dc21c89412 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:40.849325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:40.938210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc6796-8fd9-4cd2-9e4a-b7dc21c89412 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:40.971300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5382af-ac61-4a26-9037-13fe87c8edad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:40.971892 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5382af-ac61-4a26-9037-13fe87c8edad None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:40.972169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5382af-ac61-4a26-9037-13fe87c8edad None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:40.972436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5382af-ac61-4a26-9037-13fe87c8edad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:40.973145 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5382af-ac61-4a26-9037-13fe87c8edad None admin] RBAC: Adding query filter params (role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a, scope.project.id=19f3267023f84fa7b03bc06f543e8276, user.id=7e24abb1a6664e2ba1ba14417c1cf592) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:40.973448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5382af-ac61-4a26-9037-13fe87c8edad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:40.974915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5382af-ac61-4a26-9037-13fe87c8edad None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:40.980513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 550/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:16:40 2022] GET /identity/v3/role_assignments?user.id=7e24abb1a6664e2ba1ba14417c1cf592&scope.project.id=19f3267023f84fa7b03bc06f543e8276&role.id=ac7eb9c247e94edda4cd6ad66b5e6a9a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:43.134858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d027ce8-ddbc-46b3-87f1-e677e5206d22 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:43.135388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d027ce8-ddbc-46b3-87f1-e677e5206d22 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:43.135388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d027ce8-ddbc-46b3-87f1-e677e5206d22 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:43.136718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 581/1131] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:43.142435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d063e-21b9-41ae-9db1-b2d0617ffc4a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:43.142858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d063e-21b9-41ae-9db1-b2d0617ffc4a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:43.142984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d063e-21b9-41ae-9db1-b2d0617ffc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:43.160827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e27d063e-21b9-41ae-9db1-b2d0617ffc4a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:43.161997 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e27d063e-21b9-41ae-9db1-b2d0617ffc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:43.222755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:43.227443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 551/1132] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:43.491310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d027ce8-ddbc-46b3-87f1-e677e5206d22 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:43.565274 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:43.590313 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d027ce8-ddbc-46b3-87f1-e677e5206d22 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:43.622580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1a3fb-b820-4650-ad99-d42179ef8d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:43.623183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1a3fb-b820-4650-ad99-d42179ef8d83 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:43.623483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1a3fb-b820-4650-ad99-d42179ef8d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:43.623752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1a3fb-b820-4650-ad99-d42179ef8d83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:43.624846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1a3fb-b820-4650-ad99-d42179ef8d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:43.626265 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1a3fb-b820-4650-ad99-d42179ef8d83 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:43.627821 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 582/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:43.633645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d063e-21b9-41ae-9db1-b2d0617ffc4a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:43.732297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d063e-21b9-41ae-9db1-b2d0617ffc4a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:43.764996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408a402-6c52-4e91-979d-aaabe07d599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:43.765538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408a402-6c52-4e91-979d-aaabe07d599b None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:43.765819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408a402-6c52-4e91-979d-aaabe07d599b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:43.766087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408a402-6c52-4e91-979d-aaabe07d599b None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:43.766781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408a402-6c52-4e91-979d-aaabe07d599b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:43.768217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408a402-6c52-4e91-979d-aaabe07d599b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:43.796168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 552/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:16:43 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:16:45.957418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c1f7-0a30-431b-8ad4-b55e5c8b68c1 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:45.957950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c1f7-0a30-431b-8ad4-b55e5c8b68c1 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:45.957950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c1f7-0a30-431b-8ad4-b55e5c8b68c1 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:45.959318 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 583/1135] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:45.964759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a064ae9-d6c6-45ab-86aa-9923318c9d15 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:45.965150 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a064ae9-d6c6-45ab-86aa-9923318c9d15 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:45.965299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a064ae9-d6c6-45ab-86aa-9923318c9d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:45.984795 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1a064ae9-d6c6-45ab-86aa-9923318c9d15 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:45.985979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1a064ae9-d6c6-45ab-86aa-9923318c9d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:46.030866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:46.051583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 553/1136] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:46.319668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84c1f7-0a30-431b-8ad4-b55e5c8b68c1 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:46.421165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84c1f7-0a30-431b-8ad4-b55e5c8b68c1 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:46.453691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010c1e0-4e1f-4823-a180-db7f3e6d33d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:46.454301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010c1e0-4e1f-4823-a180-db7f3e6d33d3 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:46.454609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010c1e0-4e1f-4823-a180-db7f3e6d33d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:46.454880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010c1e0-4e1f-4823-a180-db7f3e6d33d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:46.455969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010c1e0-4e1f-4823-a180-db7f3e6d33d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:46.457385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010c1e0-4e1f-4823-a180-db7f3e6d33d3 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:46.458954 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 584/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:16:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:46.464830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a064ae9-d6c6-45ab-86aa-9923318c9d15 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:46.561310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a064ae9-d6c6-45ab-86aa-9923318c9d15 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:46.594929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805fb26-5748-427e-844e-f134a6b75225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:46.595463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805fb26-5748-427e-844e-f134a6b75225 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:46.595738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805fb26-5748-427e-844e-f134a6b75225 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:46.596008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805fb26-5748-427e-844e-f134a6b75225 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:46.596659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805fb26-5748-427e-844e-f134a6b75225 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:46.598077 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805fb26-5748-427e-844e-f134a6b75225 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:46.619304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 554/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:16:46 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:16:48.775583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238fe0c-df91-4f84-b126-b59b155148b7 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:48.776126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238fe0c-df91-4f84-b126-b59b155148b7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:48.776126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238fe0c-df91-4f84-b126-b59b155148b7 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:48.777438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 585/1139] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:48.782969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603034-19e4-4d9c-b51c-38593efe93ee None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:48.783386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603034-19e4-4d9c-b51c-38593efe93ee None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:48.783523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603034-19e4-4d9c-b51c-38593efe93ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:48.802209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-31603034-19e4-4d9c-b51c-38593efe93ee None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:48.803425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-31603034-19e4-4d9c-b51c-38593efe93ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:48.832300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:48.868851 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 555/1140] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:49.139277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238fe0c-df91-4f84-b126-b59b155148b7 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:49.151910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:49.239945 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238fe0c-df91-4f84-b126-b59b155148b7 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:49.272319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab95f4c-b5a6-4b27-a6bc-7df705cfaa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:49.272943 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab95f4c-b5a6-4b27-a6bc-7df705cfaa89 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:49.273227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab95f4c-b5a6-4b27-a6bc-7df705cfaa89 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:49.273505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab95f4c-b5a6-4b27-a6bc-7df705cfaa89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:49.284437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab95f4c-b5a6-4b27-a6bc-7df705cfaa89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-9ab95f4c-b5a6-4b27-a6bc-7df705cfaa89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:16:49.289255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:49.290343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:49.291536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 586/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:16:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:49.297485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603034-19e4-4d9c-b51c-38593efe93ee None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:49.396617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603034-19e4-4d9c-b51c-38593efe93ee None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:49.430495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3bcbb-1842-4840-8725-58a7635b4c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:49.431095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3bcbb-1842-4840-8725-58a7635b4c6b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:49.431376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3bcbb-1842-4840-8725-58a7635b4c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:49.431644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3bcbb-1842-4840-8725-58a7635b4c6b None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:49.432299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3bcbb-1842-4840-8725-58a7635b4c6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:49.432600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3bcbb-1842-4840-8725-58a7635b4c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:49.433963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3bcbb-1842-4840-8725-58a7635b4c6b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:49.441963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 556/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:16:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:49.447836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab95f4c-b5a6-4b27-a6bc-7df705cfaa89 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:49.516397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:49.552287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab95f4c-b5a6-4b27-a6bc-7df705cfaa89 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:49.585031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac409e-d4d7-4c71-b594-ac0efc469374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:49.585646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac409e-d4d7-4c71-b594-ac0efc469374 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:49.585924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac409e-d4d7-4c71-b594-ac0efc469374 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:49.586196 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac409e-d4d7-4c71-b594-ac0efc469374 None admin] PATH_INFO: `/v3/users/65fe72be4fa5414387099e921a3f2f91` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:49.599416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac409e-d4d7-4c71-b594-ac0efc469374 None admin] RBAC: Authorizing `identity:get_user(user_id=65fe72be4fa5414387099e921a3f2f91)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:49.600844 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac409e-d4d7-4c71-b594-ac0efc469374 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:49.602447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 587/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:16:49 2022] GET /identity/v3/users/65fe72be4fa5414387099e921a3f2f91 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:49.608401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3bcbb-1842-4840-8725-58a7635b4c6b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:49.638598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:49.707577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3bcbb-1842-4840-8725-58a7635b4c6b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:49.739463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53a014-84b3-4152-a1cb-7cf99c8bb83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:49.740052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53a014-84b3-4152-a1cb-7cf99c8bb83b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:49.740327 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53a014-84b3-4152-a1cb-7cf99c8bb83b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:49.740594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53a014-84b3-4152-a1cb-7cf99c8bb83b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:49.806424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53a014-84b3-4152-a1cb-7cf99c8bb83b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:49.807864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53a014-84b3-4152-a1cb-7cf99c8bb83b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:49.836575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:49.904330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 557/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:16:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:16:49.910265 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac409e-d4d7-4c71-b594-ac0efc469374 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:50.016160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac409e-d4d7-4c71-b594-ac0efc469374 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:50.041518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:50.050252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2c499-65c4-4f30-acc7-13b1e7bd6a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:50.050900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2c499-65c4-4f30-acc7-13b1e7bd6a5b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:50.051180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2c499-65c4-4f30-acc7-13b1e7bd6a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:50.051454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2c499-65c4-4f30-acc7-13b1e7bd6a5b None admin] PATH_INFO: `/v3/projects/b5a48420add846078a02ab8bec6477f4` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:50.052554 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2c499-65c4-4f30-acc7-13b1e7bd6a5b None admin] RBAC: Authorizing `identity:get_project(project_id=b5a48420add846078a02ab8bec6477f4)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:50.053983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2c499-65c4-4f30-acc7-13b1e7bd6a5b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:50.055640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 588/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:16:49 2022] GET /identity/v3/projects/b5a48420add846078a02ab8bec6477f4 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:50.062799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53a014-84b3-4152-a1cb-7cf99c8bb83b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:50.158232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53a014-84b3-4152-a1cb-7cf99c8bb83b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:50.187040 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:50.193269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90849b7-8d87-428d-a53d-b8cbc989e632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:50.193867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90849b7-8d87-428d-a53d-b8cbc989e632 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:50.194144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90849b7-8d87-428d-a53d-b8cbc989e632 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:50.194442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90849b7-8d87-428d-a53d-b8cbc989e632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:50.195159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90849b7-8d87-428d-a53d-b8cbc989e632 None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=b5a48420add846078a02ab8bec6477f4, user.id=65fe72be4fa5414387099e921a3f2f91) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:50.195462 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90849b7-8d87-428d-a53d-b8cbc989e632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:50.196883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90849b7-8d87-428d-a53d-b8cbc989e632 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:50.202798 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 558/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:16:50 2022] GET /identity/v3/role_assignments?user.id=65fe72be4fa5414387099e921a3f2f91&scope.project.id=b5a48420add846078a02ab8bec6477f4&role.id=6413aac4240a46ba816472c29e305973 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:52.309258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca9dc3-1454-41ea-a750-5dca8463de7a None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:52.309791 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca9dc3-1454-41ea-a750-5dca8463de7a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:52.310102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca9dc3-1454-41ea-a750-5dca8463de7a None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:52.311460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 589/1147] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:52.316536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2286cb7-6a7d-4af9-a5af-e6fbdb304d2e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:52.316958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2286cb7-6a7d-4af9-a5af-e6fbdb304d2e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:52.317082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2286cb7-6a7d-4af9-a5af-e6fbdb304d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:52.336287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c2286cb7-6a7d-4af9-a5af-e6fbdb304d2e None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:52.337476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c2286cb7-6a7d-4af9-a5af-e6fbdb304d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:52.403120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 559/1148] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:52.671823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca9dc3-1454-41ea-a750-5dca8463de7a None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:52.768897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca9dc3-1454-41ea-a750-5dca8463de7a None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:52.800861 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cdb4c-4c8c-4924-ba3d-31fcf911f710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:52.801466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cdb4c-4c8c-4924-ba3d-31fcf911f710 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:52.801741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cdb4c-4c8c-4924-ba3d-31fcf911f710 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:52.802006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cdb4c-4c8c-4924-ba3d-31fcf911f710 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:52.812128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cdb4c-4c8c-4924-ba3d-31fcf911f710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-3a5cdb4c-4c8c-4924-ba3d-31fcf911f710 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:16:52.816832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:52.817930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:52.819167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 590/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:16:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:52.823879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2286cb7-6a7d-4af9-a5af-e6fbdb304d2e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:52.919819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2286cb7-6a7d-4af9-a5af-e6fbdb304d2e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:52.942693 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:52.953427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5233ed1-b07a-4d05-87e4-b8fd2e3e9e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:52.954023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5233ed1-b07a-4d05-87e4-b8fd2e3e9e45 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:52.954305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5233ed1-b07a-4d05-87e4-b8fd2e3e9e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:52.954609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5233ed1-b07a-4d05-87e4-b8fd2e3e9e45 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:52.955266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5233ed1-b07a-4d05-87e4-b8fd2e3e9e45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:52.955563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5233ed1-b07a-4d05-87e4-b8fd2e3e9e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:52.956921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5233ed1-b07a-4d05-87e4-b8fd2e3e9e45 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:52.964745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 560/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:52.971024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cdb4c-4c8c-4924-ba3d-31fcf911f710 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:53.025127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:53.067696 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cdb4c-4c8c-4924-ba3d-31fcf911f710 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:53.100751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b108da-e958-4932-97e6-76357e5b5f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:53.101359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b108da-e958-4932-97e6-76357e5b5f85 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:53.101632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b108da-e958-4932-97e6-76357e5b5f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:53.101898 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b108da-e958-4932-97e6-76357e5b5f85 None admin] PATH_INFO: `/v3/users/65fe72be4fa5414387099e921a3f2f91` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:53.102989 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b108da-e958-4932-97e6-76357e5b5f85 None admin] RBAC: Authorizing `identity:get_user(user_id=65fe72be4fa5414387099e921a3f2f91)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:53.104396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b108da-e958-4932-97e6-76357e5b5f85 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:53.105922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 591/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:16:52 2022] GET /identity/v3/users/65fe72be4fa5414387099e921a3f2f91 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:53.111759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5233ed1-b07a-4d05-87e4-b8fd2e3e9e45 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:53.207789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5233ed1-b07a-4d05-87e4-b8fd2e3e9e45 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:53.240159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da66717-32b5-4b45-b11f-f62168e726db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:53.240772 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66717-32b5-4b45-b11f-f62168e726db None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:53.241049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66717-32b5-4b45-b11f-f62168e726db None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:53.241320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66717-32b5-4b45-b11f-f62168e726db None admin] PATH_INFO: `/v3/projects/b5a48420add846078a02ab8bec6477f4` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:53.242439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da66717-32b5-4b45-b11f-f62168e726db None admin] RBAC: Authorizing `identity:get_project(project_id=b5a48420add846078a02ab8bec6477f4)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:53.243864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da66717-32b5-4b45-b11f-f62168e726db None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:53.245465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 561/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:16:53 2022] GET /identity/v3/projects/b5a48420add846078a02ab8bec6477f4 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:53.251998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b108da-e958-4932-97e6-76357e5b5f85 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:53.347890 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b108da-e958-4932-97e6-76357e5b5f85 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:53.370796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:53.384788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c73a04-92b3-48f7-a9ee-d8182cd3e2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:53.385428 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c73a04-92b3-48f7-a9ee-d8182cd3e2d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:53.385710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c73a04-92b3-48f7-a9ee-d8182cd3e2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:53.385984 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c73a04-92b3-48f7-a9ee-d8182cd3e2d4 None admin] PATH_INFO: `/v3/projects/b5a48420add846078a02ab8bec6477f4/users/65fe72be4fa5414387099e921a3f2f91/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:53.387926 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c73a04-92b3-48f7-a9ee-d8182cd3e2d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5a48420add846078a02ab8bec6477f4, user_id=65fe72be4fa5414387099e921a3f2f91, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:53.389363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c73a04-92b3-48f7-a9ee-d8182cd3e2d4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:53.402081 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 592/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:16:53 2022] PUT /identity/v3/projects/b5a48420add846078a02ab8bec6477f4/users/65fe72be4fa5414387099e921a3f2f91/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:16:55.504877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0e2c-e002-4492-8ed3-9222b7230d87 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:55.505428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0e2c-e002-4492-8ed3-9222b7230d87 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:55.505428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0e2c-e002-4492-8ed3-9222b7230d87 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:55.506799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 562/1154] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:55.511825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab7ff5-136c-405f-bee6-e9ab661cbe05 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:55.512252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab7ff5-136c-405f-bee6-e9ab661cbe05 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:55.512898 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab7ff5-136c-405f-bee6-e9ab661cbe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:55.532182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-67ab7ff5-136c-405f-bee6-e9ab661cbe05 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:55.533338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-67ab7ff5-136c-405f-bee6-e9ab661cbe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:55.598465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 593/1155] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:55.870289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea0e2c-e002-4492-8ed3-9222b7230d87 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:55.925966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:55.970953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea0e2c-e002-4492-8ed3-9222b7230d87 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:56.003747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962c0a8-bbcb-4ae8-8e04-d39e20a5d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:56.004355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962c0a8-bbcb-4ae8-8e04-d39e20a5d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:56.004630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962c0a8-bbcb-4ae8-8e04-d39e20a5d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:56.004896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962c0a8-bbcb-4ae8-8e04-d39e20a5d1d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:56.015355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962c0a8-bbcb-4ae8-8e04-d39e20a5d1d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6962c0a8-bbcb-4ae8-8e04-d39e20a5d1d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:16:56.020042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:56.021105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:16:56.022138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 563/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:56.027221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab7ff5-136c-405f-bee6-e9ab661cbe05 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:56.125044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab7ff5-136c-405f-bee6-e9ab661cbe05 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:56.138308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:56.158938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eac535-7e30-41eb-a780-be0caf558df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:56.159536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eac535-7e30-41eb-a780-be0caf558df9 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:56.159811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eac535-7e30-41eb-a780-be0caf558df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:56.160078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eac535-7e30-41eb-a780-be0caf558df9 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:56.160735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eac535-7e30-41eb-a780-be0caf558df9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:56.161036 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eac535-7e30-41eb-a780-be0caf558df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:56.162410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eac535-7e30-41eb-a780-be0caf558df9 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:56.170963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 594/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:16:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:56.176900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962c0a8-bbcb-4ae8-8e04-d39e20a5d1d2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:56.278483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962c0a8-bbcb-4ae8-8e04-d39e20a5d1d2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:56.291727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:56.312524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b63f-8db2-4787-89d6-03ce763f63bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:56.313149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b63f-8db2-4787-89d6-03ce763f63bc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:56.313436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b63f-8db2-4787-89d6-03ce763f63bc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:56.313709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b63f-8db2-4787-89d6-03ce763f63bc None admin] PATH_INFO: `/v3/users/65fe72be4fa5414387099e921a3f2f91` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:56.314848 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86b63f-8db2-4787-89d6-03ce763f63bc None admin] RBAC: Authorizing `identity:get_user(user_id=65fe72be4fa5414387099e921a3f2f91)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:56.316289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86b63f-8db2-4787-89d6-03ce763f63bc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:56.317865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 564/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:16:56 2022] GET /identity/v3/users/65fe72be4fa5414387099e921a3f2f91 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:56.323691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eac535-7e30-41eb-a780-be0caf558df9 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:56.421008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eac535-7e30-41eb-a780-be0caf558df9 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:56.452274 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de08b05-55c6-4150-a883-3ed516a045dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:56.452866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de08b05-55c6-4150-a883-3ed516a045dd None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:56.453143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de08b05-55c6-4150-a883-3ed516a045dd None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:56.453414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de08b05-55c6-4150-a883-3ed516a045dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:56.496676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:56.518936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de08b05-55c6-4150-a883-3ed516a045dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:56.520377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de08b05-55c6-4150-a883-3ed516a045dd None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:56.616627 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 595/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:16:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:16:56.623189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b63f-8db2-4787-89d6-03ce763f63bc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:56.721806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b63f-8db2-4787-89d6-03ce763f63bc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:56.754450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609131f9-d449-45e2-9368-0eb7db606688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:56.755064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609131f9-d449-45e2-9368-0eb7db606688 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:56.755344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609131f9-d449-45e2-9368-0eb7db606688 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:56.755614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609131f9-d449-45e2-9368-0eb7db606688 None admin] PATH_INFO: `/v3/projects/b5a48420add846078a02ab8bec6477f4` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:56.756721 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609131f9-d449-45e2-9368-0eb7db606688 None admin] RBAC: Authorizing `identity:get_project(project_id=b5a48420add846078a02ab8bec6477f4)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:56.758141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609131f9-d449-45e2-9368-0eb7db606688 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:56.759768 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 565/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:16:56 2022] GET /identity/v3/projects/b5a48420add846078a02ab8bec6477f4 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:56.766203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de08b05-55c6-4150-a883-3ed516a045dd None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:56.841229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:56.863687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de08b05-55c6-4150-a883-3ed516a045dd None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:56.896427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d148ba-06f5-4e0e-8764-2737e28a4182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:56.897015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d148ba-06f5-4e0e-8764-2737e28a4182 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:56.897297 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d148ba-06f5-4e0e-8764-2737e28a4182 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:56.897571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d148ba-06f5-4e0e-8764-2737e28a4182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:56.898296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d148ba-06f5-4e0e-8764-2737e28a4182 None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=b5a48420add846078a02ab8bec6477f4, user.id=65fe72be4fa5414387099e921a3f2f91) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:16:56.898630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d148ba-06f5-4e0e-8764-2737e28a4182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:56.900047 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d148ba-06f5-4e0e-8764-2737e28a4182 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:56.906296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 596/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:16:56 2022] GET /identity/v3/role_assignments?user.id=65fe72be4fa5414387099e921a3f2f91&scope.project.id=b5a48420add846078a02ab8bec6477f4&role.id=6413aac4240a46ba816472c29e305973 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:16:59.069361 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eb5fe-0403-42a5-96b4-c297fbc9dfc1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:59.069913 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eb5fe-0403-42a5-96b4-c297fbc9dfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:59.069913 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eb5fe-0403-42a5-96b4-c297fbc9dfc1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:59.071330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 566/1162] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:16:59.077368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4b9e-826d-4ae7-9dc7-870960c0e5c8 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:59.077760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4b9e-826d-4ae7-9dc7-870960c0e5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:59.077912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4b9e-826d-4ae7-9dc7-870960c0e5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:59.096359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-bafb4b9e-826d-4ae7-9dc7-870960c0e5c8 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:16:59.097544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bafb4b9e-826d-4ae7-9dc7-870960c0e5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:16:59.162916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 597/1163] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:16:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:16:59.432236 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eb5fe-0403-42a5-96b4-c297fbc9dfc1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:59.483458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:59.532899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eb5fe-0403-42a5-96b4-c297fbc9dfc1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:59.565484 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa824e-969d-45a5-8fc2-7fb20b83f8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:59.566074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa824e-969d-45a5-8fc2-7fb20b83f8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:59.566346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa824e-969d-45a5-8fc2-7fb20b83f8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:59.566646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa824e-969d-45a5-8fc2-7fb20b83f8b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:59.632023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa824e-969d-45a5-8fc2-7fb20b83f8b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:59.633386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa824e-969d-45a5-8fc2-7fb20b83f8b2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:59.680539 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:59.729689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 567/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:16:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:16:59.736490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb4b9e-826d-4ae7-9dc7-870960c0e5c8 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:59.802328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:16:59.831855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb4b9e-826d-4ae7-9dc7-870960c0e5c8 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:16:59.864330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fb67d-1ffa-41b1-aa34-78853554ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:16:59.864944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fb67d-1ffa-41b1-aa34-78853554ac51 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:16:59.865220 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fb67d-1ffa-41b1-aa34-78853554ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:16:59.865490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fb67d-1ffa-41b1-aa34-78853554ac51 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:16:59.872119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fb67d-1ffa-41b1-aa34-78853554ac51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:16:59.873736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fb67d-1ffa-41b1-aa34-78853554ac51 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-437fb67d-1ffa-41b1-aa34-78853554ac51 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:16:59.884864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:16:59.886212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:16:59.887896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 598/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Sep 12 23:16:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:16:59.892391 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa824e-969d-45a5-8fc2-7fb20b83f8b2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:16:59.988941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa824e-969d-45a5-8fc2-7fb20b83f8b2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:00.022201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca1dd6-3fb1-4e8d-ac13-e51d942cbda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:00.022823 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca1dd6-3fb1-4e8d-ac13-e51d942cbda9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:00.023105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca1dd6-3fb1-4e8d-ac13-e51d942cbda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:00.023378 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca1dd6-3fb1-4e8d-ac13-e51d942cbda9 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:00.024014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca1dd6-3fb1-4e8d-ac13-e51d942cbda9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:17:00.024316 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca1dd6-3fb1-4e8d-ac13-e51d942cbda9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:00.025706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca1dd6-3fb1-4e8d-ac13-e51d942cbda9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:00.033371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 568/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Mon Sep 12 23:16:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:02.150308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe30c40-05b7-4538-9734-9387ea00a793 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:02.150901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe30c40-05b7-4538-9734-9387ea00a793 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:02.150901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe30c40-05b7-4538-9734-9387ea00a793 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:02.152185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 599/1167] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:17:02.157838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b6da9-03cf-4c95-9514-558045ea72c7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:02.158258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b6da9-03cf-4c95-9514-558045ea72c7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:02.158412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b6da9-03cf-4c95-9514-558045ea72c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:02.176647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ad8b6da9-03cf-4c95-9514-558045ea72c7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:17:02.177834 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ad8b6da9-03cf-4c95-9514-558045ea72c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:17:02.187063 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:02.243879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 569/1168] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:17:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:17:02.514302 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe30c40-05b7-4538-9734-9387ea00a793 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:02.612998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe30c40-05b7-4538-9734-9387ea00a793 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:02.640711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:02.646756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4bdbf-83d3-4ff8-bb95-ac356cd3b222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:02.647362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4bdbf-83d3-4ff8-bb95-ac356cd3b222 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:02.647643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4bdbf-83d3-4ff8-bb95-ac356cd3b222 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:02.647916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4bdbf-83d3-4ff8-bb95-ac356cd3b222 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:02.648590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4bdbf-83d3-4ff8-bb95-ac356cd3b222 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:02.649987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4bdbf-83d3-4ff8-bb95-ac356cd3b222 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:02.667514 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 600/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Mon Sep 12 23:17:02 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:17:04.806946 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ced7ba-135d-4075-9aa7-adaee3eec1da None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:04.807525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ced7ba-135d-4075-9aa7-adaee3eec1da None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:04.807525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ced7ba-135d-4075-9aa7-adaee3eec1da None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:04.809343 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 570/1170] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:17:04.814679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b700b6-49c4-4c5c-bf25-0f12f7ff9cb4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:04.815123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b700b6-49c4-4c5c-bf25-0f12f7ff9cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:04.815224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b700b6-49c4-4c5c-bf25-0f12f7ff9cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:04.833388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b8b700b6-49c4-4c5c-bf25-0f12f7ff9cb4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:17:04.834590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b8b700b6-49c4-4c5c-bf25-0f12f7ff9cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:17:04.898246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 601/1171] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:17:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:17:05.163306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ced7ba-135d-4075-9aa7-adaee3eec1da None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:05.261337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ced7ba-135d-4075-9aa7-adaee3eec1da None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:05.294901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea450400-262f-4d2d-a983-875a5353da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:05.295513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea450400-262f-4d2d-a983-875a5353da88 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:05.295789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea450400-262f-4d2d-a983-875a5353da88 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:05.296057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea450400-262f-4d2d-a983-875a5353da88 None admin] PATH_INFO: `/v3/domains/1611883897014d1e980d418833e83266` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:05.306073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea450400-262f-4d2d-a983-875a5353da88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1611883897014d1e980d418833e83266)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:05.307554 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea450400-262f-4d2d-a983-875a5353da88 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:05.309133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 571/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Mon Sep 12 23:17:05 2022] GET /identity/v3/domains/1611883897014d1e980d418833e83266 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:05.314971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b700b6-49c4-4c5c-bf25-0f12f7ff9cb4 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:05.412482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b700b6-49c4-4c5c-bf25-0f12f7ff9cb4 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:05.432692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:05.447634 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677447b-0ca0-4827-8c1b-cbfd91455fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:05.448231 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677447b-0ca0-4827-8c1b-cbfd91455fd1 None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:05.448503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677447b-0ca0-4827-8c1b-cbfd91455fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:05.448767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677447b-0ca0-4827-8c1b-cbfd91455fd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:05.449515 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677447b-0ca0-4827-8c1b-cbfd91455fd1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:05.451370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677447b-0ca0-4827-8c1b-cbfd91455fd1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:05.479961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 602/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:17:05 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:17:07.652354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca11ff1-5ce5-4781-9ac0-85bc0e0d71eb None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:07.653558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca11ff1-5ce5-4781-9ac0-85bc0e0d71eb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:07.653558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca11ff1-5ce5-4781-9ac0-85bc0e0d71eb None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:07.654798 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 572/1174] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:17:07.660026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7de74-9ef7-4837-93f6-62355b4dbf84 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:07.660437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7de74-9ef7-4837-93f6-62355b4dbf84 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:07.660568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7de74-9ef7-4837-93f6-62355b4dbf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:07.680003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-35e7de74-9ef7-4837-93f6-62355b4dbf84 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:17:07.681176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-35e7de74-9ef7-4837-93f6-62355b4dbf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:17:07.745083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 603/1175] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:17:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:17:08.017563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca11ff1-5ce5-4781-9ac0-85bc0e0d71eb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:08.021436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:08.118252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca11ff1-5ce5-4781-9ac0-85bc0e0d71eb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:08.151136 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de7d3c-7ca0-46c4-9ca5-cc3470dc1e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:08.151751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7d3c-7ca0-46c4-9ca5-cc3470dc1e45 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:08.152025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7d3c-7ca0-46c4-9ca5-cc3470dc1e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:08.152292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7d3c-7ca0-46c4-9ca5-cc3470dc1e45 None admin] PATH_INFO: `/v3/domains/1611883897014d1e980d418833e83266` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:08.153535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de7d3c-7ca0-46c4-9ca5-cc3470dc1e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1611883897014d1e980d418833e83266)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:08.154989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de7d3c-7ca0-46c4-9ca5-cc3470dc1e45 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:08.156520 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 573/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Mon Sep 12 23:17:08 2022] GET /identity/v3/domains/1611883897014d1e980d418833e83266 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:08.162218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7de74-9ef7-4837-93f6-62355b4dbf84 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:08.259081 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7de74-9ef7-4837-93f6-62355b4dbf84 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:08.260552 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:08.294285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742101a-19fb-403e-984d-681fb259524b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:08.294841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742101a-19fb-403e-984d-681fb259524b None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:08.295122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742101a-19fb-403e-984d-681fb259524b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:08.295389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742101a-19fb-403e-984d-681fb259524b None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:08.296035 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742101a-19fb-403e-984d-681fb259524b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:08.297453 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742101a-19fb-403e-984d-681fb259524b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:08.318118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 604/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:17:08 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:17:10.486527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46faa1b-a5c2-4d19-8155-3d558dcc5098 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:10.487073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46faa1b-a5c2-4d19-8155-3d558dcc5098 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:10.487073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46faa1b-a5c2-4d19-8155-3d558dcc5098 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:10.488410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 574/1178] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:17:10.493709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a30998-621f-42f1-86f5-086946fea7d3 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:10.494103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a30998-621f-42f1-86f5-086946fea7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:10.494260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a30998-621f-42f1-86f5-086946fea7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:10.512827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c4a30998-621f-42f1-86f5-086946fea7d3 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:17:10.514015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c4a30998-621f-42f1-86f5-086946fea7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:17:10.579009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 605/1179] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:17:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:17:10.847449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46faa1b-a5c2-4d19-8155-3d558dcc5098 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:10.917465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:10.948047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46faa1b-a5c2-4d19-8155-3d558dcc5098 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:10.980833 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a2499-5a55-4334-ac73-b448456f5961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:10.981561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a2499-5a55-4334-ac73-b448456f5961 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:10.981839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a2499-5a55-4334-ac73-b448456f5961 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:10.982108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a2499-5a55-4334-ac73-b448456f5961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:10.992285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a2499-5a55-4334-ac73-b448456f5961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-761a2499-5a55-4334-ac73-b448456f5961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:17:10.997765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:17:10.998872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:17:10.999917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 575/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:17:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:17:11.006887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a30998-621f-42f1-86f5-086946fea7d3 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:11.093926 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:11.107202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a30998-621f-42f1-86f5-086946fea7d3 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:11.139783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c005ed-4eff-4cd4-b03b-9b3f4008ce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:11.140377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c005ed-4eff-4cd4-b03b-9b3f4008ce04 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:11.140652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c005ed-4eff-4cd4-b03b-9b3f4008ce04 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:11.140922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c005ed-4eff-4cd4-b03b-9b3f4008ce04 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:11.141582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c005ed-4eff-4cd4-b03b-9b3f4008ce04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:17:11.141880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c005ed-4eff-4cd4-b03b-9b3f4008ce04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:11.143260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c005ed-4eff-4cd4-b03b-9b3f4008ce04 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:11.150916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 606/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:17:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:11.156815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a2499-5a55-4334-ac73-b448456f5961 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:11.255109 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a2499-5a55-4334-ac73-b448456f5961 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:11.282970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:11.287929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ee302-14b5-4e05-93df-b88757fa5636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:11.288544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee302-14b5-4e05-93df-b88757fa5636 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:11.288820 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee302-14b5-4e05-93df-b88757fa5636 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:11.289091 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee302-14b5-4e05-93df-b88757fa5636 None admin] PATH_INFO: `/v3/users/d42ee8efd1a44c6a900cdfd7f3ce8032` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:11.302828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ee302-14b5-4e05-93df-b88757fa5636 None admin] RBAC: Authorizing `identity:get_user(user_id=d42ee8efd1a44c6a900cdfd7f3ce8032)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:11.304257 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ee302-14b5-4e05-93df-b88757fa5636 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:11.305815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 576/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:17:11 2022] GET /identity/v3/users/d42ee8efd1a44c6a900cdfd7f3ce8032 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:11.312185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c005ed-4eff-4cd4-b03b-9b3f4008ce04 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:11.410913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c005ed-4eff-4cd4-b03b-9b3f4008ce04 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:11.443072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db07cf-c965-4339-a009-0aaa20225fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:11.443666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db07cf-c965-4339-a009-0aaa20225fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:11.443939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db07cf-c965-4339-a009-0aaa20225fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:11.444206 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db07cf-c965-4339-a009-0aaa20225fd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:11.462053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:11.509013 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db07cf-c965-4339-a009-0aaa20225fd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:11.510475 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db07cf-c965-4339-a009-0aaa20225fd5 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:11.604945 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 607/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:17:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:17:11.611695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ee302-14b5-4e05-93df-b88757fa5636 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:11.713519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ee302-14b5-4e05-93df-b88757fa5636 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:11.747273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2205ff-87cb-4001-aa86-68cb1090c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:11.747897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2205ff-87cb-4001-aa86-68cb1090c9df None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:11.748176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2205ff-87cb-4001-aa86-68cb1090c9df None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:11.748449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2205ff-87cb-4001-aa86-68cb1090c9df None admin] PATH_INFO: `/v3/projects/1064030542f9413f8046be02ebc6bb11` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:11.749556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2205ff-87cb-4001-aa86-68cb1090c9df None admin] RBAC: Authorizing `identity:get_project(project_id=1064030542f9413f8046be02ebc6bb11)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:11.751015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2205ff-87cb-4001-aa86-68cb1090c9df None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:11.752632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 577/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:17:11 2022] GET /identity/v3/projects/1064030542f9413f8046be02ebc6bb11 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:11.758907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db07cf-c965-4339-a009-0aaa20225fd5 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:11.807296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:11.856175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db07cf-c965-4339-a009-0aaa20225fd5 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:11.889175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb9bd7-23de-45bf-a8ed-1522da311c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:11.889760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb9bd7-23de-45bf-a8ed-1522da311c99 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:11.890037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb9bd7-23de-45bf-a8ed-1522da311c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:11.890306 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb9bd7-23de-45bf-a8ed-1522da311c99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:11.891050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb9bd7-23de-45bf-a8ed-1522da311c99 None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=1064030542f9413f8046be02ebc6bb11, user.id=d42ee8efd1a44c6a900cdfd7f3ce8032) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:17:11.891355 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb9bd7-23de-45bf-a8ed-1522da311c99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:11.892765 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb9bd7-23de-45bf-a8ed-1522da311c99 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:11.897908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 608/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:17:11 2022] GET /identity/v3/role_assignments?user.id=d42ee8efd1a44c6a900cdfd7f3ce8032&scope.project.id=1064030542f9413f8046be02ebc6bb11&role.id=6413aac4240a46ba816472c29e305973 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:14.034394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25778c-306a-4363-981f-9ba4b19250cf None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:14.034984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25778c-306a-4363-981f-9ba4b19250cf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:14.034984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25778c-306a-4363-981f-9ba4b19250cf None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:14.036280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 578/1186] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:17:14.041685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46759e5e-b995-4f09-b5dd-1f5f557393fb None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:14.042115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46759e5e-b995-4f09-b5dd-1f5f557393fb None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:14.042216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46759e5e-b995-4f09-b5dd-1f5f557393fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:14.061192 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-46759e5e-b995-4f09-b5dd-1f5f557393fb None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:17:14.062358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-46759e5e-b995-4f09-b5dd-1f5f557393fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:17:14.127026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 609/1187] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:17:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:17:14.399854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25778c-306a-4363-981f-9ba4b19250cf None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:14.459052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:14.501183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25778c-306a-4363-981f-9ba4b19250cf None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:14.534261 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87543de2-c447-4f41-b0ec-0dd1ba9b7dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:14.534908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87543de2-c447-4f41-b0ec-0dd1ba9b7dac None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:14.535186 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87543de2-c447-4f41-b0ec-0dd1ba9b7dac None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:14.535473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87543de2-c447-4f41-b0ec-0dd1ba9b7dac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:14.546366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87543de2-c447-4f41-b0ec-0dd1ba9b7dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-87543de2-c447-4f41-b0ec-0dd1ba9b7dac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:17:14.551167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:17:14.552279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:17:14.553135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 579/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:17:14.558255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46759e5e-b995-4f09-b5dd-1f5f557393fb None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:14.602894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:14.656065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46759e5e-b995-4f09-b5dd-1f5f557393fb None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:14.689160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd22b8-941f-4d86-ae69-42715ba798fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:14.689750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd22b8-941f-4d86-ae69-42715ba798fe None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:14.690026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd22b8-941f-4d86-ae69-42715ba798fe None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:14.690295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd22b8-941f-4d86-ae69-42715ba798fe None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:14.690981 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd22b8-941f-4d86-ae69-42715ba798fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:17:14.691282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd22b8-941f-4d86-ae69-42715ba798fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:14.692640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd22b8-941f-4d86-ae69-42715ba798fe None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:14.700513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 610/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:14.707686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87543de2-c447-4f41-b0ec-0dd1ba9b7dac None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:14.804194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87543de2-c447-4f41-b0ec-0dd1ba9b7dac None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:14.820618 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:14.837892 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3579e78-4d86-4461-960d-8942a6ce5ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:14.838554 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3579e78-4d86-4461-960d-8942a6ce5ffc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:14.838837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3579e78-4d86-4461-960d-8942a6ce5ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:14.839110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3579e78-4d86-4461-960d-8942a6ce5ffc None admin] PATH_INFO: `/v3/users/d42ee8efd1a44c6a900cdfd7f3ce8032` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:14.840786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3579e78-4d86-4461-960d-8942a6ce5ffc None admin] RBAC: Authorizing `identity:get_user(user_id=d42ee8efd1a44c6a900cdfd7f3ce8032)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:14.842215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3579e78-4d86-4461-960d-8942a6ce5ffc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:14.843816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 580/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:17:14 2022] GET /identity/v3/users/d42ee8efd1a44c6a900cdfd7f3ce8032 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:14.849506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd22b8-941f-4d86-ae69-42715ba798fe None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:14.945109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd22b8-941f-4d86-ae69-42715ba798fe None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:14.952315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:14.979334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cf208-672f-47da-80d7-5bf1b8af9599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:14.979947 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cf208-672f-47da-80d7-5bf1b8af9599 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:14.980229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cf208-672f-47da-80d7-5bf1b8af9599 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:14.980521 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cf208-672f-47da-80d7-5bf1b8af9599 None admin] PATH_INFO: `/v3/projects/1064030542f9413f8046be02ebc6bb11` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:14.981630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cf208-672f-47da-80d7-5bf1b8af9599 None admin] RBAC: Authorizing `identity:get_project(project_id=1064030542f9413f8046be02ebc6bb11)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:14.983082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cf208-672f-47da-80d7-5bf1b8af9599 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:14.984696 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 611/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:17:14 2022] GET /identity/v3/projects/1064030542f9413f8046be02ebc6bb11 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:14.990521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3579e78-4d86-4461-960d-8942a6ce5ffc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:15.088208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3579e78-4d86-4461-960d-8942a6ce5ffc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:15.121477 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b9a55-d4d6-4f42-8bd5-27054438a395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:15.122125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b9a55-d4d6-4f42-8bd5-27054438a395 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:15.122428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b9a55-d4d6-4f42-8bd5-27054438a395 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:15.122705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b9a55-d4d6-4f42-8bd5-27054438a395 None admin] PATH_INFO: `/v3/projects/1064030542f9413f8046be02ebc6bb11/users/d42ee8efd1a44c6a900cdfd7f3ce8032/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:15.124582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b9a55-d4d6-4f42-8bd5-27054438a395 None admin] RBAC: Authorizing `identity:create_grant(project_id=1064030542f9413f8046be02ebc6bb11, user_id=d42ee8efd1a44c6a900cdfd7f3ce8032, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:15.126014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b9a55-d4d6-4f42-8bd5-27054438a395 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:15.138856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 581/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:17:14 2022] PUT /identity/v3/projects/1064030542f9413f8046be02ebc6bb11/users/d42ee8efd1a44c6a900cdfd7f3ce8032/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:17:17.252303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a4498-91ca-4f17-a50b-9fb662d5e93e None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:17.252837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a4498-91ca-4f17-a50b-9fb662d5e93e None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:17.252837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a4498-91ca-4f17-a50b-9fb662d5e93e None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:17.254163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 612/1193] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:17:17.259344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdaa5d-eadc-4c4c-886a-aea10842c84d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:17.259751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdaa5d-eadc-4c4c-886a-aea10842c84d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:17.259900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdaa5d-eadc-4c4c-886a-aea10842c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:17.279369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f0cdaa5d-eadc-4c4c-886a-aea10842c84d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:17:17.280572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f0cdaa5d-eadc-4c4c-886a-aea10842c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:17:17.321294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:17.346747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 582/1194] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:17:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:17:17.614418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a4498-91ca-4f17-a50b-9fb662d5e93e None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:17.719617 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a4498-91ca-4f17-a50b-9fb662d5e93e None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:17.752212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0831e-e007-4578-96f2-2defb9c00da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:17.752830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0831e-e007-4578-96f2-2defb9c00da3 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:17.753109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0831e-e007-4578-96f2-2defb9c00da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:17.753386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0831e-e007-4578-96f2-2defb9c00da3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:17.764321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0831e-e007-4578-96f2-2defb9c00da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-fbb0831e-e007-4578-96f2-2defb9c00da3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:17:17.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:17:17.770164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:17:17.771102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 613/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:17:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:17:17.776229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdaa5d-eadc-4c4c-886a-aea10842c84d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:17.872156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdaa5d-eadc-4c4c-886a-aea10842c84d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:17.904251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ccc8-e800-4eb6-8965-5ba93560f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:17.904846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ccc8-e800-4eb6-8965-5ba93560f136 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:17.905123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ccc8-e800-4eb6-8965-5ba93560f136 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:17.905394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ccc8-e800-4eb6-8965-5ba93560f136 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:17.906051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164ccc8-e800-4eb6-8965-5ba93560f136 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:17:17.906353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164ccc8-e800-4eb6-8965-5ba93560f136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:17.907745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164ccc8-e800-4eb6-8965-5ba93560f136 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:17.915730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 583/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:17.922242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0831e-e007-4578-96f2-2defb9c00da3 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:17.957222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:18.022363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0831e-e007-4578-96f2-2defb9c00da3 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:18.055985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3add882-744a-4d60-b1a7-cc6646b91fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:18.056597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add882-744a-4d60-b1a7-cc6646b91fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:18.056867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add882-744a-4d60-b1a7-cc6646b91fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:18.057133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add882-744a-4d60-b1a7-cc6646b91fa3 None admin] PATH_INFO: `/v3/users/d42ee8efd1a44c6a900cdfd7f3ce8032` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:18.058314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3add882-744a-4d60-b1a7-cc6646b91fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=d42ee8efd1a44c6a900cdfd7f3ce8032)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:18.060397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3add882-744a-4d60-b1a7-cc6646b91fa3 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:18.061943 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 614/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Mon Sep 12 23:17:17 2022] GET /identity/v3/users/d42ee8efd1a44c6a900cdfd7f3ce8032 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:18.067624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ccc8-e800-4eb6-8965-5ba93560f136 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:18.107345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:18.165896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ccc8-e800-4eb6-8965-5ba93560f136 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:18.198055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa27e3-d21c-41b7-8141-b6a8a3247973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:18.198672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa27e3-d21c-41b7-8141-b6a8a3247973 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:18.199552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa27e3-d21c-41b7-8141-b6a8a3247973 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:18.199820 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa27e3-d21c-41b7-8141-b6a8a3247973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:18.265135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa27e3-d21c-41b7-8141-b6a8a3247973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:18.266616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa27e3-d21c-41b7-8141-b6a8a3247973 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:18.303968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:18.363757 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 584/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:17:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:17:18.370046 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3add882-744a-4d60-b1a7-cc6646b91fa3 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:18.469313 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3add882-744a-4d60-b1a7-cc6646b91fa3 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:18.470835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:18.503391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13542fa7-9a48-4ed3-aac5-977c83b9dde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:18.504011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13542fa7-9a48-4ed3-aac5-977c83b9dde9 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:18.504289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13542fa7-9a48-4ed3-aac5-977c83b9dde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:18.504560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13542fa7-9a48-4ed3-aac5-977c83b9dde9 None admin] PATH_INFO: `/v3/projects/1064030542f9413f8046be02ebc6bb11` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:18.505660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13542fa7-9a48-4ed3-aac5-977c83b9dde9 None admin] RBAC: Authorizing `identity:get_project(project_id=1064030542f9413f8046be02ebc6bb11)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:18.507123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13542fa7-9a48-4ed3-aac5-977c83b9dde9 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:18.508733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 615/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Mon Sep 12 23:17:18 2022] GET /identity/v3/projects/1064030542f9413f8046be02ebc6bb11 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:18.515171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa27e3-d21c-41b7-8141-b6a8a3247973 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:17:18.611164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa27e3-d21c-41b7-8141-b6a8a3247973 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:17:18.643675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ba3a-f882-45ed-966d-dd0005eeac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:17:18.644263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ba3a-f882-45ed-966d-dd0005eeac05 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:17:18.644538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ba3a-f882-45ed-966d-dd0005eeac05 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:17:18.644805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ba3a-f882-45ed-966d-dd0005eeac05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:17:18.645510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7ba3a-f882-45ed-966d-dd0005eeac05 None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=1064030542f9413f8046be02ebc6bb11, user.id=d42ee8efd1a44c6a900cdfd7f3ce8032) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:17:18.645812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7ba3a-f882-45ed-966d-dd0005eeac05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:17:18.647251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7ba3a-f882-45ed-966d-dd0005eeac05 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:17:18.653528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 585/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:17:18 2022] GET /identity/v3/role_assignments?user.id=d42ee8efd1a44c6a900cdfd7f3ce8032&scope.project.id=1064030542f9413f8046be02ebc6bb11&role.id=6413aac4240a46ba816472c29e305973 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:17:28.499275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=15 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:17:28.650314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:14.244478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc66eca-3e2d-4199-8bd5-850329a42e80 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:14.245148 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc66eca-3e2d-4199-8bd5-850329a42e80 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:14.245353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc66eca-3e2d-4199-8bd5-850329a42e80 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:14.247014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 616/1201] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:18:14.253018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c0ef-6a32-40dc-871a-4836e46cc79d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:14.253483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c0ef-6a32-40dc-871a-4836e46cc79d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:14.253588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c0ef-6a32-40dc-871a-4836e46cc79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:14.280195 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-df51c0ef-6a32-40dc-871a-4836e46cc79d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:18:14.281672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-df51c0ef-6a32-40dc-871a-4836e46cc79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:18:14.372154 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 586/1202] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:18:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:18:14.670236 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc66eca-3e2d-4199-8bd5-850329a42e80 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:14.798833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc66eca-3e2d-4199-8bd5-850329a42e80 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:14.847123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25441dca-9ebd-463c-9275-9e9bf8fe7e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:14.850191 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25441dca-9ebd-463c-9275-9e9bf8fe7e85 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:14.850711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25441dca-9ebd-463c-9275-9e9bf8fe7e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:14.851207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25441dca-9ebd-463c-9275-9e9bf8fe7e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:14.867247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25441dca-9ebd-463c-9275-9e9bf8fe7e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:14.868892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25441dca-9ebd-463c-9275-9e9bf8fe7e85 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-25441dca-9ebd-463c-9275-9e9bf8fe7e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:14.886857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:14.887998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:14.888976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:14.888976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:14.888976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:14.888976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 617/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:14.894301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c0ef-6a32-40dc-871a-4836e46cc79d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:15.031225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51c0ef-6a32-40dc-871a-4836e46cc79d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:15.070538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:15.085015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb8807-8711-4a24-90da-3de5d8f79393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:15.085637 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb8807-8711-4a24-90da-3de5d8f79393 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:15.086007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb8807-8711-4a24-90da-3de5d8f79393 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:15.086211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb8807-8711-4a24-90da-3de5d8f79393 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:15.086926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb8807-8711-4a24-90da-3de5d8f79393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:15.087230 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb8807-8711-4a24-90da-3de5d8f79393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:15.088836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb8807-8711-4a24-90da-3de5d8f79393 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:15.106425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 587/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:15.110069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25441dca-9ebd-463c-9275-9e9bf8fe7e85 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:15.186086 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:15.248877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25441dca-9ebd-463c-9275-9e9bf8fe7e85 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:15.295827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe1170-17e2-4fdc-bccf-16de5e0292bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:15.296756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe1170-17e2-4fdc-bccf-16de5e0292bf None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:15.297078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe1170-17e2-4fdc-bccf-16de5e0292bf None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:15.297570 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe1170-17e2-4fdc-bccf-16de5e0292bf None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:15.298575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe1170-17e2-4fdc-bccf-16de5e0292bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:15.300255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe1170-17e2-4fdc-bccf-16de5e0292bf None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:15.326413 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 618/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Mon Sep 12 23:18:15 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:18:17.945939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c839ac3-793e-423f-98c6-32bd3a2d371f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:17.946526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c839ac3-793e-423f-98c6-32bd3a2d371f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:17.946737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c839ac3-793e-423f-98c6-32bd3a2d371f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:17.948627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 588/1206] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:18:17.954536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeac370-9907-48f6-b1ab-0084bf08bfb4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:17.955006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeac370-9907-48f6-b1ab-0084bf08bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:17.955088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeac370-9907-48f6-b1ab-0084bf08bfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:17.976164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-deeac370-9907-48f6-b1ab-0084bf08bfb4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:18:17.978700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-deeac370-9907-48f6-b1ab-0084bf08bfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:18:18.068860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 619/1207] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:18:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:18:18.350476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c839ac3-793e-423f-98c6-32bd3a2d371f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:18.482467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c839ac3-793e-423f-98c6-32bd3a2d371f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:18.520351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173718a7-99f5-4ff7-8a7b-65cb9bb5265d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:18.520959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173718a7-99f5-4ff7-8a7b-65cb9bb5265d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:18.521238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173718a7-99f5-4ff7-8a7b-65cb9bb5265d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:18.521504 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173718a7-99f5-4ff7-8a7b-65cb9bb5265d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:18.535511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173718a7-99f5-4ff7-8a7b-65cb9bb5265d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-173718a7-99f5-4ff7-8a7b-65cb9bb5265d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:18:18.542591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:18.544749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:18.545570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 589/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:18:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:18.551394 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeac370-9907-48f6-b1ab-0084bf08bfb4 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:18.599934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:18.670683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeac370-9907-48f6-b1ab-0084bf08bfb4 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:18.711469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e1eef-4953-41cb-ac8b-209cb8625dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:18.712127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e1eef-4953-41cb-ac8b-209cb8625dbd None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:18.712361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e1eef-4953-41cb-ac8b-209cb8625dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:18.712653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e1eef-4953-41cb-ac8b-209cb8625dbd None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:18.713725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e1eef-4953-41cb-ac8b-209cb8625dbd None admin] RBAC: Adding query filter params (name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:18.714063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e1eef-4953-41cb-ac8b-209cb8625dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:18.715808 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e1eef-4953-41cb-ac8b-209cb8625dbd None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:18.729975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 620/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:18:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:18:18.731634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173718a7-99f5-4ff7-8a7b-65cb9bb5265d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:18.792753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:18.862475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173718a7-99f5-4ff7-8a7b-65cb9bb5265d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:18.901127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a388a-4a40-4ff2-87d3-30a0c67aa940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:18.901773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a388a-4a40-4ff2-87d3-30a0c67aa940 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:18.902043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a388a-4a40-4ff2-87d3-30a0c67aa940 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:18.902322 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a388a-4a40-4ff2-87d3-30a0c67aa940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:18.913511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a388a-4a40-4ff2-87d3-30a0c67aa940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:18.915007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a388a-4a40-4ff2-87d3-30a0c67aa940 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-717a388a-4a40-4ff2-87d3-30a0c67aa940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:18.935885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:18.937209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:18.938297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:18.938297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:18.938297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:18.942675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 590/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:18.944420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e1eef-4953-41cb-ac8b-209cb8625dbd None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:19.065455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:19.070779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e1eef-4953-41cb-ac8b-209cb8625dbd None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:19.112798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e839a-3a6b-4771-bdbd-5f2563c4ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:19.113425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e839a-3a6b-4771-bdbd-5f2563c4ed8c None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:19.113707 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e839a-3a6b-4771-bdbd-5f2563c4ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:19.114004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e839a-3a6b-4771-bdbd-5f2563c4ed8c None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:19.114707 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e839a-3a6b-4771-bdbd-5f2563c4ed8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:19.114993 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e839a-3a6b-4771-bdbd-5f2563c4ed8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:19.116513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e839a-3a6b-4771-bdbd-5f2563c4ed8c None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:19.130183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 621/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:19.136409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a388a-4a40-4ff2-87d3-30a0c67aa940 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:19.254714 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a388a-4a40-4ff2-87d3-30a0c67aa940 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:19.256473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:19.293785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab2879-bfcd-4b58-acf9-828e6388d64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:19.294445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab2879-bfcd-4b58-acf9-828e6388d64c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:19.294727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab2879-bfcd-4b58-acf9-828e6388d64c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:19.294994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab2879-bfcd-4b58-acf9-828e6388d64c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:19.302818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab2879-bfcd-4b58-acf9-828e6388d64c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:19.304332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab2879-bfcd-4b58-acf9-828e6388d64c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-feab2879-bfcd-4b58-acf9-828e6388d64c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:18:19.317379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:19.318415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:19.319377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:19.319377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:19.319377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:18:19.319377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:18:19.319377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:18:19.319377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:18:19.319377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:18:19.319377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:18:19.319377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:18:19.319377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:19.319377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 591/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:19.327862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e839a-3a6b-4771-bdbd-5f2563c4ed8c None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:19.453076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e839a-3a6b-4771-bdbd-5f2563c4ed8c None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:19.488478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf5c3d-6cbd-46cd-a6b8-556dc47a0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:19.489168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf5c3d-6cbd-46cd-a6b8-556dc47a0e46 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:19.489509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf5c3d-6cbd-46cd-a6b8-556dc47a0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:19.489844 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf5c3d-6cbd-46cd-a6b8-556dc47a0e46 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:19.490666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf5c3d-6cbd-46cd-a6b8-556dc47a0e46 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:19.491045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf5c3d-6cbd-46cd-a6b8-556dc47a0e46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:19.492576 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf5c3d-6cbd-46cd-a6b8-556dc47a0e46 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:19.512665 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 622/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Sep 12 23:18:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:19.518571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab2879-bfcd-4b58-acf9-828e6388d64c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:19.637290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab2879-bfcd-4b58-acf9-828e6388d64c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:19.674945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28d614-0890-4e5a-8ae9-63b7650b3eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:19.675560 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28d614-0890-4e5a-8ae9-63b7650b3eda None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:19.675838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28d614-0890-4e5a-8ae9-63b7650b3eda None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:19.676107 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28d614-0890-4e5a-8ae9-63b7650b3eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:19.712434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:19.761546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28d614-0890-4e5a-8ae9-63b7650b3eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:19.763474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28d614-0890-4e5a-8ae9-63b7650b3eda None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:19.886876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 592/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:18:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:18:19.893850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf5c3d-6cbd-46cd-a6b8-556dc47a0e46 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:19.917622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:20.014431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf5c3d-6cbd-46cd-a6b8-556dc47a0e46 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:20.064784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9e3f7-dc60-4169-b2e8-33b4e8e59d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:20.065564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9e3f7-dc60-4169-b2e8-33b4e8e59d7d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:20.066242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9e3f7-dc60-4169-b2e8-33b4e8e59d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:20.066242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9e3f7-dc60-4169-b2e8-33b4e8e59d7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:20.081185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9e3f7-dc60-4169-b2e8-33b4e8e59d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:20.082802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9e3f7-dc60-4169-b2e8-33b4e8e59d7d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-e6e9e3f7-dc60-4169-b2e8-33b4e8e59d7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:20.101880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:20.103018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:20.103967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:20.103967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:20.103967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:20.105599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 623/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:20.111940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28d614-0890-4e5a-8ae9-63b7650b3eda None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:20.180633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:20.223520 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28d614-0890-4e5a-8ae9-63b7650b3eda None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:20.258350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a6cd7-77ab-40ec-bab2-1eac2e372f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:20.258998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a6cd7-77ab-40ec-bab2-1eac2e372f95 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:20.259277 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a6cd7-77ab-40ec-bab2-1eac2e372f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:20.259546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a6cd7-77ab-40ec-bab2-1eac2e372f95 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:20.260731 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a6cd7-77ab-40ec-bab2-1eac2e372f95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:20.261031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a6cd7-77ab-40ec-bab2-1eac2e372f95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:20.262420 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a6cd7-77ab-40ec-bab2-1eac2e372f95 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:20.273690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 593/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:18:20.280287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9e3f7-dc60-4169-b2e8-33b4e8e59d7d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:20.358474 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:20.393607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9e3f7-dc60-4169-b2e8-33b4e8e59d7d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:20.433339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e8748-0361-465f-953a-4f350ac602e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:20.434012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e8748-0361-465f-953a-4f350ac602e0 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:20.434293 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e8748-0361-465f-953a-4f350ac602e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:20.434597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e8748-0361-465f-953a-4f350ac602e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:20.441293 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e8748-0361-465f-953a-4f350ac602e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:20.442767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e8748-0361-465f-953a-4f350ac602e0 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-061e8748-0361-465f-953a-4f350ac602e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:18:20.457165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:20.458396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:20.459654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:18:20.459654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:18:20.459654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:18:20.459654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:18:20.459654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:18:20.459654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:18:20.459654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:18:20.459654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:20.459654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 624/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:20.464753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a6cd7-77ab-40ec-bab2-1eac2e372f95 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:20.577028 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a6cd7-77ab-40ec-bab2-1eac2e372f95 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:20.600755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:20.615380 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa00b86-1f51-4e62-ba7e-25504ec7f9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:20.616115 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa00b86-1f51-4e62-ba7e-25504ec7f9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:20.616390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa00b86-1f51-4e62-ba7e-25504ec7f9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:20.616658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa00b86-1f51-4e62-ba7e-25504ec7f9a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:20.617384 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa00b86-1f51-4e62-ba7e-25504ec7f9a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:20.617744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa00b86-1f51-4e62-ba7e-25504ec7f9a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:20.619209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa00b86-1f51-4e62-ba7e-25504ec7f9a5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:20.633088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 594/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:18:20.639631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e8748-0361-465f-953a-4f350ac602e0 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:20.754880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e8748-0361-465f-953a-4f350ac602e0 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:20.786583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:20.793858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002beef-a4af-43a2-b494-ffa01d11ce76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:20.794499 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002beef-a4af-43a2-b494-ffa01d11ce76 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:20.794781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002beef-a4af-43a2-b494-ffa01d11ce76 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:20.795051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002beef-a4af-43a2-b494-ffa01d11ce76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:20.795779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002beef-a4af-43a2-b494-ffa01d11ce76 None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=559a4af215324597b203e6866cb51fe2) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:20.796083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002beef-a4af-43a2-b494-ffa01d11ce76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:20.797505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002beef-a4af-43a2-b494-ffa01d11ce76 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:20.802824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 625/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:18:20 2022] GET /identity/v3/role_assignments?user.id=559a4af215324597b203e6866cb51fe2&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:18:23.051336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94295783-1641-4bea-a3f4-d74653b1dd16 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:23.051867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94295783-1641-4bea-a3f4-d74653b1dd16 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:23.052053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94295783-1641-4bea-a3f4-d74653b1dd16 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:23.053901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 595/1220] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:18:23.060842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49762c-43ab-459b-a611-5d9948dee727 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:23.061387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49762c-43ab-459b-a611-5d9948dee727 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:23.061479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49762c-43ab-459b-a611-5d9948dee727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:23.081843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-5e49762c-43ab-459b-a611-5d9948dee727 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:18:23.083195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5e49762c-43ab-459b-a611-5d9948dee727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:18:23.152279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 626/1221] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:18:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:18:23.423176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94295783-1641-4bea-a3f4-d74653b1dd16 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:23.533514 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94295783-1641-4bea-a3f4-d74653b1dd16 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:23.572162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2132b9-efd0-4ccb-8c93-0ba3cf4fce96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:23.574407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2132b9-efd0-4ccb-8c93-0ba3cf4fce96 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:23.574847 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2132b9-efd0-4ccb-8c93-0ba3cf4fce96 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:23.575185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2132b9-efd0-4ccb-8c93-0ba3cf4fce96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:23.586767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2132b9-efd0-4ccb-8c93-0ba3cf4fce96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3e2132b9-efd0-4ccb-8c93-0ba3cf4fce96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:18:23.592663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:23.593817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:23.594888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 596/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:23.600163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49762c-43ab-459b-a611-5d9948dee727 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:23.711123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49762c-43ab-459b-a611-5d9948dee727 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:23.739051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:23.750330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f4b52-a1c5-4f40-be07-4a91b025c08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:23.750977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f4b52-a1c5-4f40-be07-4a91b025c08f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:23.751287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f4b52-a1c5-4f40-be07-4a91b025c08f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:23.751529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f4b52-a1c5-4f40-be07-4a91b025c08f None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:23.752193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f4b52-a1c5-4f40-be07-4a91b025c08f None admin] RBAC: Adding query filter params (name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:23.752496 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f4b52-a1c5-4f40-be07-4a91b025c08f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:23.753866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f4b52-a1c5-4f40-be07-4a91b025c08f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:23.765066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 627/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:18:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:23.771020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2132b9-efd0-4ccb-8c93-0ba3cf4fce96 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:23.822007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:23.886558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2132b9-efd0-4ccb-8c93-0ba3cf4fce96 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:23.923277 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e218e7-d6ff-4017-b75e-59d6f97f6baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:23.923937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e218e7-d6ff-4017-b75e-59d6f97f6baf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:23.924262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e218e7-d6ff-4017-b75e-59d6f97f6baf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:23.924485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e218e7-d6ff-4017-b75e-59d6f97f6baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:23.936142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e218e7-d6ff-4017-b75e-59d6f97f6baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:23.937626 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e218e7-d6ff-4017-b75e-59d6f97f6baf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-03e218e7-d6ff-4017-b75e-59d6f97f6baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:23.954701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:23.956787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:23.957982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:23.957982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:23.957982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:23.957982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 597/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:23.962932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f4b52-a1c5-4f40-be07-4a91b025c08f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:24.080523 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f4b52-a1c5-4f40-be07-4a91b025c08f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:24.118617 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223a082-6949-416a-92c3-41bc49cb8cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:24.121062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223a082-6949-416a-92c3-41bc49cb8cdd None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:24.121330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223a082-6949-416a-92c3-41bc49cb8cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:24.121610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223a082-6949-416a-92c3-41bc49cb8cdd None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:24.122253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223a082-6949-416a-92c3-41bc49cb8cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:24.122579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223a082-6949-416a-92c3-41bc49cb8cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:24.123945 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223a082-6949-416a-92c3-41bc49cb8cdd None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:24.142484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 628/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:18:24.148178 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e218e7-d6ff-4017-b75e-59d6f97f6baf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:24.247614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:24.255412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e218e7-d6ff-4017-b75e-59d6f97f6baf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:24.293841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d9666-cab5-4939-94a5-99d5669adae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:24.294575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d9666-cab5-4939-94a5-99d5669adae0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:24.294808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d9666-cab5-4939-94a5-99d5669adae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:24.295074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d9666-cab5-4939-94a5-99d5669adae0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:24.302967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d9666-cab5-4939-94a5-99d5669adae0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:24.304526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d9666-cab5-4939-94a5-99d5669adae0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b38d9666-cab5-4939-94a5-99d5669adae0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:18:24.317008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:24.323283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:24.324527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:24.324527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:24.324527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:18:24.324527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:18:24.324527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:18:24.324527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:18:24.324527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:18:24.324527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:18:24.324527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:18:24.324527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:24.324527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 598/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:24.325261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223a082-6949-416a-92c3-41bc49cb8cdd None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:24.381953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:24.442822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223a082-6949-416a-92c3-41bc49cb8cdd None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:24.478367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe44b2f-b7c0-49cd-ad8a-2736aeecead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:24.479633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe44b2f-b7c0-49cd-ad8a-2736aeecead0 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:24.479900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe44b2f-b7c0-49cd-ad8a-2736aeecead0 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:24.480169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe44b2f-b7c0-49cd-ad8a-2736aeecead0 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:24.480885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe44b2f-b7c0-49cd-ad8a-2736aeecead0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:24.481198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe44b2f-b7c0-49cd-ad8a-2736aeecead0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:24.482652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe44b2f-b7c0-49cd-ad8a-2736aeecead0 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:24.501394 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 629/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Sep 12 23:18:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:18:24.507253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d9666-cab5-4939-94a5-99d5669adae0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:24.618806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d9666-cab5-4939-94a5-99d5669adae0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:24.656471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762356d-0e10-4308-b982-9f77177a36ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:24.657098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762356d-0e10-4308-b982-9f77177a36ba None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:24.657374 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762356d-0e10-4308-b982-9f77177a36ba None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:24.657643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762356d-0e10-4308-b982-9f77177a36ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:24.668692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762356d-0e10-4308-b982-9f77177a36ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:24.670159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762356d-0e10-4308-b982-9f77177a36ba None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e762356d-0e10-4308-b982-9f77177a36ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:24.684444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:24.685608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:24.686695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:24.686695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:24.686695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:24.686695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 599/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:24.691602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe44b2f-b7c0-49cd-ad8a-2736aeecead0 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:24.815645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe44b2f-b7c0-49cd-ad8a-2736aeecead0 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:24.817912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:24.852028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71e205-7ad5-4c17-8489-c4b50bf837f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:24.852627 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71e205-7ad5-4c17-8489-c4b50bf837f1 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:24.852913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71e205-7ad5-4c17-8489-c4b50bf837f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:24.853164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71e205-7ad5-4c17-8489-c4b50bf837f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:24.853864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71e205-7ad5-4c17-8489-c4b50bf837f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:24.854135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71e205-7ad5-4c17-8489-c4b50bf837f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:24.855499 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71e205-7ad5-4c17-8489-c4b50bf837f1 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:24.866974 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 630/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:24.873227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762356d-0e10-4308-b982-9f77177a36ba None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:24.882531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:24.984538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762356d-0e10-4308-b982-9f77177a36ba None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:25.021145 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d590d-3545-4e80-9c15-97911992b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:25.021781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d590d-3545-4e80-9c15-97911992b81b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:25.022061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d590d-3545-4e80-9c15-97911992b81b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:25.022332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d590d-3545-4e80-9c15-97911992b81b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:25.029194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d590d-3545-4e80-9c15-97911992b81b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:25.030675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d590d-3545-4e80-9c15-97911992b81b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-431d590d-3545-4e80-9c15-97911992b81b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:18:25.042902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:25.043863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:25.049803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:18:25.049803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:18:25.049803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:18:25.049803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:18:25.049803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:18:25.049803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:18:25.049803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:18:25.049803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:25.049803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 600/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:25.052492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71e205-7ad5-4c17-8489-c4b50bf837f1 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:25.167615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71e205-7ad5-4c17-8489-c4b50bf837f1 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:25.205306 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a0057-4b99-4ded-8966-5f70ef51ac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:25.205910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a0057-4b99-4ded-8966-5f70ef51ac85 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:25.206183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a0057-4b99-4ded-8966-5f70ef51ac85 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:25.206476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a0057-4b99-4ded-8966-5f70ef51ac85 None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:25.207210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a0057-4b99-4ded-8966-5f70ef51ac85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:25.207463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a0057-4b99-4ded-8966-5f70ef51ac85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:25.208905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a0057-4b99-4ded-8966-5f70ef51ac85 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:25.222244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 631/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:18:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:25.228352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d590d-3545-4e80-9c15-97911992b81b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:25.303549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:25.340291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d590d-3545-4e80-9c15-97911992b81b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:25.383212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bbeb9-e051-4572-b999-55d1766c483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:25.383982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bbeb9-e051-4572-b999-55d1766c483b None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:25.384263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bbeb9-e051-4572-b999-55d1766c483b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:25.384535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bbeb9-e051-4572-b999-55d1766c483b None admin] PATH_INFO: `/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/559a4af215324597b203e6866cb51fe2/roles/bb220d22e80a428d8855c3d5767fbc03` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:25.400452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bbeb9-e051-4572-b999-55d1766c483b None admin] RBAC: Authorizing `identity:create_grant(project_id=fd655924cf9a4736ba38740ade63ec52, user_id=559a4af215324597b203e6866cb51fe2, role_id=bb220d22e80a428d8855c3d5767fbc03)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:25.402114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bbeb9-e051-4572-b999-55d1766c483b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:25.414273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 601/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:18:25 2022] PUT /identity/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/559a4af215324597b203e6866cb51fe2/roles/bb220d22e80a428d8855c3d5767fbc03 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:18:27.839025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0094fa-c5d9-4d36-9123-fbfe5b6571b2 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:27.839726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0094fa-c5d9-4d36-9123-fbfe5b6571b2 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:27.839726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0094fa-c5d9-4d36-9123-fbfe5b6571b2 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:27.840960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 632/1233] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:18:27.846686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb67bb-26dd-4d56-acd4-0cd34b5c239f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:27.847210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb67bb-26dd-4d56-acd4-0cd34b5c239f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:27.847323 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb67bb-26dd-4d56-acd4-0cd34b5c239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:27.866987 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0ebb67bb-26dd-4d56-acd4-0cd34b5c239f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:18:27.868192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0ebb67bb-26dd-4d56-acd4-0cd34b5c239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:18:27.942819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 602/1234] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:18:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:18:28.233477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0094fa-c5d9-4d36-9123-fbfe5b6571b2 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:28.260783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:28.342473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0094fa-c5d9-4d36-9123-fbfe5b6571b2 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:28.382572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1fff6-d814-4729-ad07-fd7a0710fd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:28.383213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1fff6-d814-4729-ad07-fd7a0710fd20 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:28.383497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1fff6-d814-4729-ad07-fd7a0710fd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:28.383767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1fff6-d814-4729-ad07-fd7a0710fd20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:28.395571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1fff6-d814-4729-ad07-fd7a0710fd20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-d3d1fff6-d814-4729-ad07-fd7a0710fd20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:18:28.401432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:28.402668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:28.403695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 633/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Mon Sep 12 23:18:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:28.408889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb67bb-26dd-4d56-acd4-0cd34b5c239f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:28.464587 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:28.524887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb67bb-26dd-4d56-acd4-0cd34b5c239f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:28.562750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8abb53-9291-4bee-99ce-0644d93d7da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:28.563475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8abb53-9291-4bee-99ce-0644d93d7da2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:28.563784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8abb53-9291-4bee-99ce-0644d93d7da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:28.564051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8abb53-9291-4bee-99ce-0644d93d7da2 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:28.564758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8abb53-9291-4bee-99ce-0644d93d7da2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:28.565056 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8abb53-9291-4bee-99ce-0644d93d7da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:28.566748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8abb53-9291-4bee-99ce-0644d93d7da2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:28.576658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 603/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Mon Sep 12 23:18:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:28.581923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1fff6-d814-4729-ad07-fd7a0710fd20 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:28.681920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:28.699787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1fff6-d814-4729-ad07-fd7a0710fd20 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:28.735647 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439aa434-7749-4485-bc83-fc6db7260ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:28.736268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aa434-7749-4485-bc83-fc6db7260ccc None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:28.736543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aa434-7749-4485-bc83-fc6db7260ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:28.736809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aa434-7749-4485-bc83-fc6db7260ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:28.749116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439aa434-7749-4485-bc83-fc6db7260ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:28.750606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439aa434-7749-4485-bc83-fc6db7260ccc None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-439aa434-7749-4485-bc83-fc6db7260ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:28.766606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:28.768282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:28.769922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:28.769922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:28.769922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:28.771031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 634/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:28.778256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8abb53-9291-4bee-99ce-0644d93d7da2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:28.893837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8abb53-9291-4bee-99ce-0644d93d7da2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:28.904283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:28.933857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9fbb1-51d8-4824-8a5d-26ecc2bb6089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:28.934497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9fbb1-51d8-4824-8a5d-26ecc2bb6089 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:28.934780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9fbb1-51d8-4824-8a5d-26ecc2bb6089 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:28.935092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9fbb1-51d8-4824-8a5d-26ecc2bb6089 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:28.935840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9fbb1-51d8-4824-8a5d-26ecc2bb6089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:28.936322 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9fbb1-51d8-4824-8a5d-26ecc2bb6089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:28.937892 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9fbb1-51d8-4824-8a5d-26ecc2bb6089 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:28.952127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 604/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:28.958171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439aa434-7749-4485-bc83-fc6db7260ccc None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:29.075083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439aa434-7749-4485-bc83-fc6db7260ccc None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:29.120490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ab2a4-be32-4979-986b-580c3c34c445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:29.121310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ab2a4-be32-4979-986b-580c3c34c445 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:29.121745 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ab2a4-be32-4979-986b-580c3c34c445 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:29.122215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ab2a4-be32-4979-986b-580c3c34c445 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:29.125934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:29.130865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ab2a4-be32-4979-986b-580c3c34c445 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:29.132517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ab2a4-be32-4979-986b-580c3c34c445 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-6d2ab2a4-be32-4979-986b-580c3c34c445 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:18:29.144380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:29.145651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:29.147024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:29.147024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:29.147024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:18:29.147024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:18:29.147024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:18:29.147024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:18:29.147024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:18:29.147024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:18:29.147024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:18:29.147024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:29.150528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 635/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:29.151759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9fbb1-51d8-4824-8a5d-26ecc2bb6089 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:29.266759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9fbb1-51d8-4824-8a5d-26ecc2bb6089 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:29.306739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afa864-31b1-4b32-a447-3209866bbf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:29.307353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afa864-31b1-4b32-a447-3209866bbf73 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:29.307633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afa864-31b1-4b32-a447-3209866bbf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:29.307903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afa864-31b1-4b32-a447-3209866bbf73 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:29.308622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afa864-31b1-4b32-a447-3209866bbf73 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:29.309180 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afa864-31b1-4b32-a447-3209866bbf73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:29.310539 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afa864-31b1-4b32-a447-3209866bbf73 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:29.331965 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 605/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Sep 12 23:18:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:29.338994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ab2a4-be32-4979-986b-580c3c34c445 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:29.462952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ab2a4-be32-4979-986b-580c3c34c445 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:29.501524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301c11e-6967-4186-8f0d-9058dccd035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:29.502209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301c11e-6967-4186-8f0d-9058dccd035d None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:29.502515 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301c11e-6967-4186-8f0d-9058dccd035d None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:29.502786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301c11e-6967-4186-8f0d-9058dccd035d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:29.573335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:29.581030 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301c11e-6967-4186-8f0d-9058dccd035d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:29.582520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301c11e-6967-4186-8f0d-9058dccd035d None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:29.694889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 636/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:18:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:18:29.701447 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afa864-31b1-4b32-a447-3209866bbf73 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:29.735873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:29.823874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afa864-31b1-4b32-a447-3209866bbf73 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:29.866174 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc9a78-2610-4bbc-873c-97e965307e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:29.866801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc9a78-2610-4bbc-873c-97e965307e04 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:29.867080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc9a78-2610-4bbc-873c-97e965307e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:29.867352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc9a78-2610-4bbc-873c-97e965307e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:29.878720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc9a78-2610-4bbc-873c-97e965307e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:29.880162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc9a78-2610-4bbc-873c-97e965307e04 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-40bc9a78-2610-4bbc-873c-97e965307e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:29.896602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:29.898479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:29.899749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:29.899749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:29.899749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:29.899749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 606/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:29.904923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301c11e-6967-4186-8f0d-9058dccd035d None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:30.005478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:30.012969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301c11e-6967-4186-8f0d-9058dccd035d None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:30.057221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d5e28-2db8-436d-822e-bd954d2061d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:30.058228 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d5e28-2db8-436d-822e-bd954d2061d6 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:30.058596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d5e28-2db8-436d-822e-bd954d2061d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:30.058925 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d5e28-2db8-436d-822e-bd954d2061d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:30.059910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d5e28-2db8-436d-822e-bd954d2061d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:30.060278 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d5e28-2db8-436d-822e-bd954d2061d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:30.062198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d5e28-2db8-436d-822e-bd954d2061d6 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:30.081602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 637/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:30.090437 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc9a78-2610-4bbc-873c-97e965307e04 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:30.181863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:30.205812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc9a78-2610-4bbc-873c-97e965307e04 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:30.243444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55180b6-87ff-488d-82ef-1c7f6468a5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:30.244248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55180b6-87ff-488d-82ef-1c7f6468a5b8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:30.244545 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55180b6-87ff-488d-82ef-1c7f6468a5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:30.244844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55180b6-87ff-488d-82ef-1c7f6468a5b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:30.252078 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55180b6-87ff-488d-82ef-1c7f6468a5b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:30.253746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55180b6-87ff-488d-82ef-1c7f6468a5b8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d55180b6-87ff-488d-82ef-1c7f6468a5b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:18:30.268161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:30.269334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:30.275873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:18:30.275873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:18:30.275873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:18:30.275873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:18:30.275873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:18:30.275873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:18:30.275873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:18:30.275873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:30.275873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 607/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:18:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:30.276981 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d5e28-2db8-436d-822e-bd954d2061d6 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:30.392423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d5e28-2db8-436d-822e-bd954d2061d6 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:30.436053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633ca18-aebf-4117-8653-19cc13a9a3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:30.436688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633ca18-aebf-4117-8653-19cc13a9a3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:30.437055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633ca18-aebf-4117-8653-19cc13a9a3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:30.437338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633ca18-aebf-4117-8653-19cc13a9a3c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:30.438163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633ca18-aebf-4117-8653-19cc13a9a3c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:30.438529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633ca18-aebf-4117-8653-19cc13a9a3c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:30.440161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633ca18-aebf-4117-8653-19cc13a9a3c9 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:30.455156 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 638/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:18:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:18:30.461631 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55180b6-87ff-488d-82ef-1c7f6468a5b8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:30.577837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55180b6-87ff-488d-82ef-1c7f6468a5b8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:30.622821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a04589-22b0-4638-9e20-1e64ed5547f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:30.623735 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a04589-22b0-4638-9e20-1e64ed5547f9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:30.624079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a04589-22b0-4638-9e20-1e64ed5547f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:30.624408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a04589-22b0-4638-9e20-1e64ed5547f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:30.625240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a04589-22b0-4638-9e20-1e64ed5547f9 None admin] RBAC: Adding query filter params (role.id=bb220d22e80a428d8855c3d5767fbc03, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=559a4af215324597b203e6866cb51fe2) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:30.625736 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a04589-22b0-4638-9e20-1e64ed5547f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:30.629406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a04589-22b0-4638-9e20-1e64ed5547f9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:30.637744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 608/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:18:30 2022] GET /identity/v3/role_assignments?user.id=559a4af215324597b203e6866cb51fe2&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=bb220d22e80a428d8855c3d5767fbc03 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:32.969550 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb152ff5-e715-4258-aa99-903afb15c892 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:32.970123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb152ff5-e715-4258-aa99-903afb15c892 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:32.970123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb152ff5-e715-4258-aa99-903afb15c892 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:32.971425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 639/1247] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:18:32.977017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7e314-78d3-4741-8949-07a422c128e6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:32.977473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7e314-78d3-4741-8949-07a422c128e6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:32.977645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7e314-78d3-4741-8949-07a422c128e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:32.984381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:32.997374 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a8f7e314-78d3-4741-8949-07a422c128e6 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:18:32.998599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a8f7e314-78d3-4741-8949-07a422c128e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:18:33.075450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 609/1248] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:18:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:18:33.344992 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb152ff5-e715-4258-aa99-903afb15c892 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:33.364527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:33.459588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb152ff5-e715-4258-aa99-903afb15c892 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:33.496179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542032d3-5321-4818-b419-d3ad35de132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:33.496807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542032d3-5321-4818-b419-d3ad35de132a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:33.497086 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542032d3-5321-4818-b419-d3ad35de132a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:33.497357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542032d3-5321-4818-b419-d3ad35de132a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:33.508096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542032d3-5321-4818-b419-d3ad35de132a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-542032d3-5321-4818-b419-d3ad35de132a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:18:33.513746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:33.514928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:33.519427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 640/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:18:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:33.521238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7e314-78d3-4741-8949-07a422c128e6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:33.626954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7e314-78d3-4741-8949-07a422c128e6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:33.659013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:33.664682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc9abe-50d7-49f8-b82a-3b289fe9f099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:33.665603 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc9abe-50d7-49f8-b82a-3b289fe9f099 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:33.665892 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc9abe-50d7-49f8-b82a-3b289fe9f099 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:33.666166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc9abe-50d7-49f8-b82a-3b289fe9f099 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:33.666874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc9abe-50d7-49f8-b82a-3b289fe9f099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:33.667177 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc9abe-50d7-49f8-b82a-3b289fe9f099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:33.668567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc9abe-50d7-49f8-b82a-3b289fe9f099 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:33.677372 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 610/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:33.683441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542032d3-5321-4818-b419-d3ad35de132a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:33.762631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:33.788484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542032d3-5321-4818-b419-d3ad35de132a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:33.824084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba45eed-f617-447f-98de-e172c0462932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:33.824706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45eed-f617-447f-98de-e172c0462932 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:33.824986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45eed-f617-447f-98de-e172c0462932 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:33.825259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45eed-f617-447f-98de-e172c0462932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:33.835566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba45eed-f617-447f-98de-e172c0462932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:33.837012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba45eed-f617-447f-98de-e172c0462932 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-7ba45eed-f617-447f-98de-e172c0462932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:33.852995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:33.854605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:33.855534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:33.855534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:33.855534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:33.855534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 641/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:33.860949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc9abe-50d7-49f8-b82a-3b289fe9f099 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:33.965660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc9abe-50d7-49f8-b82a-3b289fe9f099 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:33.997840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe987bfa-409a-4d4d-a1c0-6334e6db6253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:33.998458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe987bfa-409a-4d4d-a1c0-6334e6db6253 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:33.998735 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe987bfa-409a-4d4d-a1c0-6334e6db6253 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:33.999002 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe987bfa-409a-4d4d-a1c0-6334e6db6253 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:33.999625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe987bfa-409a-4d4d-a1c0-6334e6db6253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:33.999921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe987bfa-409a-4d4d-a1c0-6334e6db6253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:34.001272 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe987bfa-409a-4d4d-a1c0-6334e6db6253 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:34.012490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 611/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:34.018150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba45eed-f617-447f-98de-e172c0462932 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:34.126828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba45eed-f617-447f-98de-e172c0462932 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:34.152672 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:34.160691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf102c8-40fc-489e-b448-2b882e9577bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:34.161319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf102c8-40fc-489e-b448-2b882e9577bf None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:34.161596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf102c8-40fc-489e-b448-2b882e9577bf None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:34.161867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf102c8-40fc-489e-b448-2b882e9577bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:34.170100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf102c8-40fc-489e-b448-2b882e9577bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:34.171555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf102c8-40fc-489e-b448-2b882e9577bf None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-daf102c8-40fc-489e-b448-2b882e9577bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:18:34.182422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:34.183571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:34.184502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:34.184502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:34.184502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:18:34.184502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:18:34.184502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:18:34.184502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:18:34.184502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:18:34.184502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:18:34.184502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:18:34.184502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:34.184502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 642/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:34.189386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe987bfa-409a-4d4d-a1c0-6334e6db6253 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:34.244496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:34.288837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe987bfa-409a-4d4d-a1c0-6334e6db6253 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:34.321248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc2bbb-ce04-4be4-a625-3c2b688bc022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:34.322413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc2bbb-ce04-4be4-a625-3c2b688bc022 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:34.322684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc2bbb-ce04-4be4-a625-3c2b688bc022 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:34.322961 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc2bbb-ce04-4be4-a625-3c2b688bc022 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:34.323675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc2bbb-ce04-4be4-a625-3c2b688bc022 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:34.323978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc2bbb-ce04-4be4-a625-3c2b688bc022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:34.325392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc2bbb-ce04-4be4-a625-3c2b688bc022 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:34.343506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 612/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Sep 12 23:18:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:34.349190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf102c8-40fc-489e-b448-2b882e9577bf None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:34.446113 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf102c8-40fc-489e-b448-2b882e9577bf None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:34.479752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b0aa2-f73f-4b84-b45e-40db61df29ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:34.480334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b0aa2-f73f-4b84-b45e-40db61df29ff None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:34.480608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b0aa2-f73f-4b84-b45e-40db61df29ff None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:34.480874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b0aa2-f73f-4b84-b45e-40db61df29ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:34.535954 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:34.549292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b0aa2-f73f-4b84-b45e-40db61df29ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:34.550769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b0aa2-f73f-4b84-b45e-40db61df29ff None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:34.647059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 643/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:18:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:18:34.653393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc2bbb-ce04-4be4-a625-3c2b688bc022 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:34.749971 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc2bbb-ce04-4be4-a625-3c2b688bc022 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:34.762764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:34.784344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1434d-1989-48c4-95c8-2b5c9302595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:34.784958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1434d-1989-48c4-95c8-2b5c9302595e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:34.785235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1434d-1989-48c4-95c8-2b5c9302595e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:34.785503 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1434d-1989-48c4-95c8-2b5c9302595e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:34.796240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1434d-1989-48c4-95c8-2b5c9302595e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:34.797625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1434d-1989-48c4-95c8-2b5c9302595e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-46b1434d-1989-48c4-95c8-2b5c9302595e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:34.811824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:34.812927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:34.814197 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:34.814197 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:34.814197 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:34.814197 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 613/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:34.818566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b0aa2-f73f-4b84-b45e-40db61df29ff None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:34.903485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:34.915456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b0aa2-f73f-4b84-b45e-40db61df29ff None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:34.948801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d442e9-194f-4853-a3ab-86b90aaffc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:34.949388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d442e9-194f-4853-a3ab-86b90aaffc7e None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:34.949660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d442e9-194f-4853-a3ab-86b90aaffc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:34.949925 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d442e9-194f-4853-a3ab-86b90aaffc7e None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:34.950579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d442e9-194f-4853-a3ab-86b90aaffc7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:34.950876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d442e9-194f-4853-a3ab-86b90aaffc7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:34.952224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d442e9-194f-4853-a3ab-86b90aaffc7e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:34.963676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 644/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:34.969209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1434d-1989-48c4-95c8-2b5c9302595e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:35.070676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1434d-1989-48c4-95c8-2b5c9302595e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:35.106123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82179880-21de-4cf1-bbeb-567c0f29d5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:35.106770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82179880-21de-4cf1-bbeb-567c0f29d5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:35.107049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82179880-21de-4cf1-bbeb-567c0f29d5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:35.107318 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82179880-21de-4cf1-bbeb-567c0f29d5e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:35.113663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82179880-21de-4cf1-bbeb-567c0f29d5e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:35.115124 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82179880-21de-4cf1-bbeb-567c0f29d5e4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-82179880-21de-4cf1-bbeb-567c0f29d5e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:18:35.126092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:35.127161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:35.128369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:18:35.128369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:18:35.128369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:18:35.128369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:18:35.128369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:18:35.128369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:18:35.128369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:18:35.128369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:35.128369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 614/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:18:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:35.133123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d442e9-194f-4853-a3ab-86b90aaffc7e None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:35.229908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d442e9-194f-4853-a3ab-86b90aaffc7e None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:35.261953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0d9f5-153c-4478-8cfd-2726d92db8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:35.262567 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d9f5-153c-4478-8cfd-2726d92db8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:35.262843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d9f5-153c-4478-8cfd-2726d92db8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:35.263109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d9f5-153c-4478-8cfd-2726d92db8d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:35.263784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0d9f5-153c-4478-8cfd-2726d92db8d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:35.264087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0d9f5-153c-4478-8cfd-2726d92db8d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:35.265494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0d9f5-153c-4478-8cfd-2726d92db8d0 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:35.277008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 645/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:35.282965 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82179880-21de-4cf1-bbeb-567c0f29d5e4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:35.309320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:35.381988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82179880-21de-4cf1-bbeb-567c0f29d5e4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:35.414822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1831df-d22c-4b3a-ae74-3a4f107b2543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:35.416359 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1831df-d22c-4b3a-ae74-3a4f107b2543 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:35.416848 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1831df-d22c-4b3a-ae74-3a4f107b2543 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:35.417125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1831df-d22c-4b3a-ae74-3a4f107b2543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:35.417840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1831df-d22c-4b3a-ae74-3a4f107b2543 None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=559a4af215324597b203e6866cb51fe2) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:35.418144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1831df-d22c-4b3a-ae74-3a4f107b2543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:35.419589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1831df-d22c-4b3a-ae74-3a4f107b2543 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:35.424873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 615/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:18:35 2022] GET /identity/v3/role_assignments?user.id=559a4af215324597b203e6866cb51fe2&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=6413aac4240a46ba816472c29e305973 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:37.549912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5405ec-b43f-4f6e-be2c-a27cbef564b1 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:37.550501 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5405ec-b43f-4f6e-be2c-a27cbef564b1 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:37.550501 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5405ec-b43f-4f6e-be2c-a27cbef564b1 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:37.551798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 646/1261] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:18:37.557694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253634a3-35a3-4c35-92a8-b293db930cef None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:37.558116 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253634a3-35a3-4c35-92a8-b293db930cef None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:37.558298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253634a3-35a3-4c35-92a8-b293db930cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:37.576681 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-253634a3-35a3-4c35-92a8-b293db930cef None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:18:37.577850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-253634a3-35a3-4c35-92a8-b293db930cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:18:37.643239 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 616/1262] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:18:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:18:37.908713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5405ec-b43f-4f6e-be2c-a27cbef564b1 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:37.920771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:38.009901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5405ec-b43f-4f6e-be2c-a27cbef564b1 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:38.044583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a53be-c645-4f95-9817-53a5128ff5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:38.045502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a53be-c645-4f95-9817-53a5128ff5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:38.045959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a53be-c645-4f95-9817-53a5128ff5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:38.046335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a53be-c645-4f95-9817-53a5128ff5e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:38.059789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a53be-c645-4f95-9817-53a5128ff5e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-437a53be-c645-4f95-9817-53a5128ff5e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:18:38.070161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:38.071279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:38.073074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 647/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:18:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:38.079170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253634a3-35a3-4c35-92a8-b293db930cef None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:38.099548 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:38.185557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253634a3-35a3-4c35-92a8-b293db930cef None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:38.219450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe998-3ed0-46bb-8a77-546d46974463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:38.220044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe998-3ed0-46bb-8a77-546d46974463 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:38.220318 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe998-3ed0-46bb-8a77-546d46974463 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:38.220583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe998-3ed0-46bb-8a77-546d46974463 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:38.221230 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fe998-3ed0-46bb-8a77-546d46974463 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:38.221525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fe998-3ed0-46bb-8a77-546d46974463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:38.222900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fe998-3ed0-46bb-8a77-546d46974463 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:38.230986 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 617/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:38.236871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a53be-c645-4f95-9817-53a5128ff5e9 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:38.301657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:38.333799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a53be-c645-4f95-9817-53a5128ff5e9 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:38.367210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d026257-8378-4805-ac6d-6ce28942762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:38.367817 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d026257-8378-4805-ac6d-6ce28942762f None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:38.368092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d026257-8378-4805-ac6d-6ce28942762f None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:38.368361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d026257-8378-4805-ac6d-6ce28942762f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:38.378801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d026257-8378-4805-ac6d-6ce28942762f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:38.380237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d026257-8378-4805-ac6d-6ce28942762f None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-9d026257-8378-4805-ac6d-6ce28942762f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:38.395273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:38.396393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:38.397510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:38.397510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:38.397510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:38.397510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 648/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:38.402735 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe998-3ed0-46bb-8a77-546d46974463 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:38.482647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:38.502002 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe998-3ed0-46bb-8a77-546d46974463 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:38.534933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906520d3-f92b-4286-844b-dac6b624f7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:38.535530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906520d3-f92b-4286-844b-dac6b624f7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:38.535811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906520d3-f92b-4286-844b-dac6b624f7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:38.536083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906520d3-f92b-4286-844b-dac6b624f7a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:38.536717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906520d3-f92b-4286-844b-dac6b624f7a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:38.537022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906520d3-f92b-4286-844b-dac6b624f7a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:38.538415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906520d3-f92b-4286-844b-dac6b624f7a3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:38.550188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 618/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:38.555952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d026257-8378-4805-ac6d-6ce28942762f None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:38.654234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d026257-8378-4805-ac6d-6ce28942762f None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:38.674343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:38.688975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f49a52-7ee6-4cf0-956c-a7558f8c4834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:38.689610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f49a52-7ee6-4cf0-956c-a7558f8c4834 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:38.689894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f49a52-7ee6-4cf0-956c-a7558f8c4834 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:38.690170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f49a52-7ee6-4cf0-956c-a7558f8c4834 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:38.698669 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f49a52-7ee6-4cf0-956c-a7558f8c4834 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:38.700101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f49a52-7ee6-4cf0-956c-a7558f8c4834 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-35f49a52-7ee6-4cf0-956c-a7558f8c4834 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:18:38.711001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:38.712073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:38.713056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:38.713056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:38.713056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:18:38.713056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:18:38.713056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:18:38.713056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:18:38.713056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:18:38.713056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:18:38.713056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:18:38.713056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:38.713056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 649/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:38.718009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906520d3-f92b-4286-844b-dac6b624f7a3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:38.815331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906520d3-f92b-4286-844b-dac6b624f7a3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:38.847496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3ae91-0cb5-4089-b3de-9620906d19a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:38.848089 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3ae91-0cb5-4089-b3de-9620906d19a8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:38.848370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3ae91-0cb5-4089-b3de-9620906d19a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:38.848641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3ae91-0cb5-4089-b3de-9620906d19a8 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:38.849358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3ae91-0cb5-4089-b3de-9620906d19a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:38.849663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3ae91-0cb5-4089-b3de-9620906d19a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:38.851110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3ae91-0cb5-4089-b3de-9620906d19a8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:38.860148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:38.868701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 619/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Sep 12 23:18:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:38.874512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f49a52-7ee6-4cf0-956c-a7558f8c4834 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:38.972837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f49a52-7ee6-4cf0-956c-a7558f8c4834 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:39.004828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094f7fb-5d57-48b1-a71d-8f58c2d5a1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:39.005438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094f7fb-5d57-48b1-a71d-8f58c2d5a1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:39.005719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094f7fb-5d57-48b1-a71d-8f58c2d5a1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:39.005995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094f7fb-5d57-48b1-a71d-8f58c2d5a1f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:39.017034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094f7fb-5d57-48b1-a71d-8f58c2d5a1f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:39.018485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094f7fb-5d57-48b1-a71d-8f58c2d5a1f4 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-7094f7fb-5d57-48b1-a71d-8f58c2d5a1f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:39.033062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:39.034145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:39.035214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:39.035214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:39.035214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:39.035214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 650/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:39.040991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3ae91-0cb5-4089-b3de-9620906d19a8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:39.144881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3ae91-0cb5-4089-b3de-9620906d19a8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:39.177826 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233cc4c-ebbc-4e60-a76b-9e24a0249358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:39.178456 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233cc4c-ebbc-4e60-a76b-9e24a0249358 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:39.178738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233cc4c-ebbc-4e60-a76b-9e24a0249358 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:39.179008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233cc4c-ebbc-4e60-a76b-9e24a0249358 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:39.179640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233cc4c-ebbc-4e60-a76b-9e24a0249358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:39.179939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233cc4c-ebbc-4e60-a76b-9e24a0249358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:39.181859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233cc4c-ebbc-4e60-a76b-9e24a0249358 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:39.192695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 620/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:39.199247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094f7fb-5d57-48b1-a71d-8f58c2d5a1f4 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:39.230558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:39.297725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094f7fb-5d57-48b1-a71d-8f58c2d5a1f4 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:39.331156 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d084b6-1f06-40bb-9d2c-bc352181eadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:39.331766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d084b6-1f06-40bb-9d2c-bc352181eadf None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:39.332046 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d084b6-1f06-40bb-9d2c-bc352181eadf None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:39.332316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d084b6-1f06-40bb-9d2c-bc352181eadf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:39.338788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d084b6-1f06-40bb-9d2c-bc352181eadf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:39.340215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d084b6-1f06-40bb-9d2c-bc352181eadf None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-f4d084b6-1f06-40bb-9d2c-bc352181eadf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:18:39.351199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:39.352234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:39.353421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:18:39.353421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:18:39.353421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:18:39.353421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:18:39.353421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:18:39.353421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:18:39.353421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:18:39.353421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:39.353421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 651/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:39.358294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233cc4c-ebbc-4e60-a76b-9e24a0249358 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:39.419033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:39.460401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233cc4c-ebbc-4e60-a76b-9e24a0249358 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:39.492108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce822-dd4f-44e2-952e-94b7d578bd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:39.492704 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce822-dd4f-44e2-952e-94b7d578bd22 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:39.492976 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce822-dd4f-44e2-952e-94b7d578bd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:39.493242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce822-dd4f-44e2-952e-94b7d578bd22 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:39.494833 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ce822-dd4f-44e2-952e-94b7d578bd22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:39.495138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ce822-dd4f-44e2-952e-94b7d578bd22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:39.496587 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ce822-dd4f-44e2-952e-94b7d578bd22 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:39.507987 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 621/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:39.514841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d084b6-1f06-40bb-9d2c-bc352181eadf None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:39.604903 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:39.613648 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d084b6-1f06-40bb-9d2c-bc352181eadf None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:39.646291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e55fe-310b-4f6b-8541-d450af9fa884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:39.647079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e55fe-310b-4f6b-8541-d450af9fa884 None admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:39.647359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e55fe-310b-4f6b-8541-d450af9fa884 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:39.647630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e55fe-310b-4f6b-8541-d450af9fa884 None admin] PATH_INFO: `/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/559a4af215324597b203e6866cb51fe2/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:39.649508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e55fe-310b-4f6b-8541-d450af9fa884 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd655924cf9a4736ba38740ade63ec52, user_id=559a4af215324597b203e6866cb51fe2, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:39.651053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e55fe-310b-4f6b-8541-d450af9fa884 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:39.664176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 652/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Mon Sep 12 23:18:39 2022] PUT /identity/v3/projects/fd655924cf9a4736ba38740ade63ec52/users/559a4af215324597b203e6866cb51fe2/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:18:41.792611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1237810-b2ab-4758-a39d-5fac0a3718f3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:41.793137 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1237810-b2ab-4758-a39d-5fac0a3718f3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:41.793228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1237810-b2ab-4758-a39d-5fac0a3718f3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:41.794530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 622/1274] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:18:41.799741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056f68c-c27d-42d5-bb5b-c0e3056421e1 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:41.800144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056f68c-c27d-42d5-bb5b-c0e3056421e1 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:41.800289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056f68c-c27d-42d5-bb5b-c0e3056421e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:41.818756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f056f68c-c27d-42d5-bb5b-c0e3056421e1 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:18:41.819943 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f056f68c-c27d-42d5-bb5b-c0e3056421e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:18:41.885019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 653/1275] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:18:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:18:42.159854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1237810-b2ab-4758-a39d-5fac0a3718f3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:42.262793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1237810-b2ab-4758-a39d-5fac0a3718f3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:42.280149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:42.297547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d87f50-7be0-4c33-9c57-38bb77970426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:42.298164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d87f50-7be0-4c33-9c57-38bb77970426 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:42.298468 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d87f50-7be0-4c33-9c57-38bb77970426 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:42.298788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d87f50-7be0-4c33-9c57-38bb77970426 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:42.308505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d87f50-7be0-4c33-9c57-38bb77970426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-54d87f50-7be0-4c33-9c57-38bb77970426 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:18:42.313210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:42.314299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:42.315521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 623/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Mon Sep 12 23:18:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:42.320252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056f68c-c27d-42d5-bb5b-c0e3056421e1 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:42.398653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:42.418444 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056f68c-c27d-42d5-bb5b-c0e3056421e1 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:42.450641 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96b99-7be6-4d3d-b000-7080264794c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:42.451239 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96b99-7be6-4d3d-b000-7080264794c5 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:42.451517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96b99-7be6-4d3d-b000-7080264794c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:42.451788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96b99-7be6-4d3d-b000-7080264794c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:42.452447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff96b99-7be6-4d3d-b000-7080264794c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:42.452748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff96b99-7be6-4d3d-b000-7080264794c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:42.454102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff96b99-7be6-4d3d-b000-7080264794c5 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:42.461864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 654/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Mon Sep 12 23:18:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:42.468193 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d87f50-7be0-4c33-9c57-38bb77970426 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:42.564281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d87f50-7be0-4c33-9c57-38bb77970426 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:42.597673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d843c4e-d99c-4ef8-b049-4731fdffd991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:42.598285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d843c4e-d99c-4ef8-b049-4731fdffd991 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:42.598585 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d843c4e-d99c-4ef8-b049-4731fdffd991 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:42.598887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d843c4e-d99c-4ef8-b049-4731fdffd991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:42.608562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d843c4e-d99c-4ef8-b049-4731fdffd991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:42.610010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d843c4e-d99c-4ef8-b049-4731fdffd991 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9d843c4e-d99c-4ef8-b049-4731fdffd991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:42.623994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:42.625175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:42.626306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:42.626306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:42.626306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:42.626306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 624/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:42.630773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96b99-7be6-4d3d-b000-7080264794c5 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:42.732036 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96b99-7be6-4d3d-b000-7080264794c5 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:42.764246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6358c5-82c5-42b2-bded-e32b9dda8739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:42.764831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6358c5-82c5-42b2-bded-e32b9dda8739 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:42.765104 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6358c5-82c5-42b2-bded-e32b9dda8739 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:42.765373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6358c5-82c5-42b2-bded-e32b9dda8739 None admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:42.766000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6358c5-82c5-42b2-bded-e32b9dda8739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:42.766295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6358c5-82c5-42b2-bded-e32b9dda8739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:42.767661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6358c5-82c5-42b2-bded-e32b9dda8739 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:42.779636 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 655/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:42.785171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d843c4e-d99c-4ef8-b049-4731fdffd991 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:42.815012 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:42.881890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d843c4e-d99c-4ef8-b049-4731fdffd991 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:42.914481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438528f-88d4-44eb-acaa-b34c5914fb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:42.915422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438528f-88d4-44eb-acaa-b34c5914fb3b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:42.915696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438528f-88d4-44eb-acaa-b34c5914fb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:42.915963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438528f-88d4-44eb-acaa-b34c5914fb3b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:42.923091 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438528f-88d4-44eb-acaa-b34c5914fb3b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:42.924515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438528f-88d4-44eb-acaa-b34c5914fb3b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f438528f-88d4-44eb-acaa-b34c5914fb3b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:18:42.935789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:42.936880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:42.938289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:42.938289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:42.938289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:18:42.938289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:18:42.938289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:18:42.938289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:18:42.938289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:18:42.938289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:18:42.938289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:18:42.938289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:42.938289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 625/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:42.942522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6358c5-82c5-42b2-bded-e32b9dda8739 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:42.946257 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:43.038222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6358c5-82c5-42b2-bded-e32b9dda8739 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:43.070864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75650db6-fd05-4097-94e6-9d6a37181914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:43.072044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75650db6-fd05-4097-94e6-9d6a37181914 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:43.072325 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75650db6-fd05-4097-94e6-9d6a37181914 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:43.072594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75650db6-fd05-4097-94e6-9d6a37181914 None admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:43.073305 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75650db6-fd05-4097-94e6-9d6a37181914 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:43.073605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75650db6-fd05-4097-94e6-9d6a37181914 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:43.075031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75650db6-fd05-4097-94e6-9d6a37181914 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:43.091183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 656/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Mon Sep 12 23:18:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:43.097026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438528f-88d4-44eb-acaa-b34c5914fb3b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:43.184737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:43.194401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438528f-88d4-44eb-acaa-b34c5914fb3b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:43.227009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382346e8-fc8a-49e1-ad78-c1f48a9d24e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:43.227601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382346e8-fc8a-49e1-ad78-c1f48a9d24e2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:43.228069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382346e8-fc8a-49e1-ad78-c1f48a9d24e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:43.228411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382346e8-fc8a-49e1-ad78-c1f48a9d24e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:43.293406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382346e8-fc8a-49e1-ad78-c1f48a9d24e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:43.294803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382346e8-fc8a-49e1-ad78-c1f48a9d24e2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:43.380918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:43.391503 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 626/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Mon Sep 12 23:18:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:18:43.397216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75650db6-fd05-4097-94e6-9d6a37181914 None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:43.457335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:43.495326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75650db6-fd05-4097-94e6-9d6a37181914 None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:43.527974 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ac4bc-8faa-4e53-9487-09fadda8b62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:43.528581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ac4bc-8faa-4e53-9487-09fadda8b62a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:43.528853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ac4bc-8faa-4e53-9487-09fadda8b62a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:43.529120 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ac4bc-8faa-4e53-9487-09fadda8b62a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:43.538623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ac4bc-8faa-4e53-9487-09fadda8b62a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:43.540895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ac4bc-8faa-4e53-9487-09fadda8b62a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-a74ac4bc-8faa-4e53-9487-09fadda8b62a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:18:43.555109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:43.556939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:18:43.557932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:18:43.557932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:18:43.557932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:43.557932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 657/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:43.562496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382346e8-fc8a-49e1-ad78-c1f48a9d24e2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:43.659050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382346e8-fc8a-49e1-ad78-c1f48a9d24e2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:43.692337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586f603-ab86-4627-b5c8-90c8ca47dea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:43.692935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586f603-ab86-4627-b5c8-90c8ca47dea8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:43.693215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586f603-ab86-4627-b5c8-90c8ca47dea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:43.693488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586f603-ab86-4627-b5c8-90c8ca47dea8 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:43.694122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586f603-ab86-4627-b5c8-90c8ca47dea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:43.694453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586f603-ab86-4627-b5c8-90c8ca47dea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:43.695810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586f603-ab86-4627-b5c8-90c8ca47dea8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:43.706780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 627/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Mon Sep 12 23:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:43.712503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ac4bc-8faa-4e53-9487-09fadda8b62a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:43.810557 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ac4bc-8faa-4e53-9487-09fadda8b62a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:43.823594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:43.843579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ac957-94aa-464e-849c-47e286c8691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:43.844188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ac957-94aa-464e-849c-47e286c8691b None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:43.844462 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ac957-94aa-464e-849c-47e286c8691b None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:43.844729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ac957-94aa-464e-849c-47e286c8691b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:43.851045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ac957-94aa-464e-849c-47e286c8691b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:43.852457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ac957-94aa-464e-849c-47e286c8691b None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application [None req-1d3ac957-94aa-464e-849c-47e286c8691b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:18:43.863517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:43.864540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:43.865622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:18:43.865622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:18:43.865622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:18:43.865622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:18:43.865622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:18:43.865622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:18:43.865622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:18:43.865622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: ERROR keystone.server.flask.application Sep 12 23:18:43.865622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 658/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Mon Sep 12 23:18:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:43.871384 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586f603-ab86-4627-b5c8-90c8ca47dea8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:43.920694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:43.970311 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586f603-ab86-4627-b5c8-90c8ca47dea8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:44.002838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e763d9-6553-496b-accd-9b1918255fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:44.003434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e763d9-6553-496b-accd-9b1918255fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:44.003713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e763d9-6553-496b-accd-9b1918255fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:44.003986 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e763d9-6553-496b-accd-9b1918255fa7 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:44.004670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e763d9-6553-496b-accd-9b1918255fa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:44.004978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e763d9-6553-496b-accd-9b1918255fa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:44.006432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e763d9-6553-496b-accd-9b1918255fa7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:44.018598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 628/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Mon Sep 12 23:18:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:44.024794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ac957-94aa-464e-849c-47e286c8691b None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:44.122076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ac957-94aa-464e-849c-47e286c8691b None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:44.155388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3509d43-9d47-4c04-b688-fc0d34683500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:44.156094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3509d43-9d47-4c04-b688-fc0d34683500 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:44.156368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3509d43-9d47-4c04-b688-fc0d34683500 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:44.159958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3509d43-9d47-4c04-b688-fc0d34683500 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:44.159958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3509d43-9d47-4c04-b688-fc0d34683500 None admin] RBAC: Adding query filter params (role.id=6413aac4240a46ba816472c29e305973, scope.project.id=fd655924cf9a4736ba38740ade63ec52, user.id=559a4af215324597b203e6866cb51fe2) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:44.159958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3509d43-9d47-4c04-b688-fc0d34683500 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:44.159958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3509d43-9d47-4c04-b688-fc0d34683500 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:44.165989 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 659/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Mon Sep 12 23:18:44 2022] GET /identity/v3/role_assignments?user.id=559a4af215324597b203e6866cb51fe2&scope.project.id=fd655924cf9a4736ba38740ade63ec52&role.id=6413aac4240a46ba816472c29e305973 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:46.337084 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3203-83d4-4508-a392-9cb4096f9437 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:46.337671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3203-83d4-4508-a392-9cb4096f9437 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:46.337671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3203-83d4-4508-a392-9cb4096f9437 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:46.339007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 629/1288] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:18:46.344599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a55d7-afad-4e76-9b21-77760f78fbea None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:46.345018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a55d7-afad-4e76-9b21-77760f78fbea None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:46.345128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a55d7-afad-4e76-9b21-77760f78fbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:46.363272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-4d6a55d7-afad-4e76-9b21-77760f78fbea None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:18:46.364443 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4d6a55d7-afad-4e76-9b21-77760f78fbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:18:46.394604 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:46.432065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 660/1289] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:18:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:18:46.700785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3203-83d4-4508-a392-9cb4096f9437 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:46.801059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3203-83d4-4508-a392-9cb4096f9437 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:46.811593 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:46.834483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71a64d-6f3e-461a-9d2c-18ef1d4abe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:46.835097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71a64d-6f3e-461a-9d2c-18ef1d4abe88 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:46.835376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71a64d-6f3e-461a-9d2c-18ef1d4abe88 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:46.835646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71a64d-6f3e-461a-9d2c-18ef1d4abe88 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:46.836222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71a64d-6f3e-461a-9d2c-18ef1d4abe88 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:46.838088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71a64d-6f3e-461a-9d2c-18ef1d4abe88 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2b71a64d-6f3e-461a-9d2c-18ef1d4abe88 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:46.846606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:46.847803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:46.848845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 630/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Sep 12 23:18:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:46.854355 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a55d7-afad-4e76-9b21-77760f78fbea None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:46.948850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a55d7-afad-4e76-9b21-77760f78fbea None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:46.981991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528295d-8a78-4757-a828-3978919a9936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:46.982606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528295d-8a78-4757-a828-3978919a9936 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:46.982885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528295d-8a78-4757-a828-3978919a9936 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:46.983155 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528295d-8a78-4757-a828-3978919a9936 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:46.983778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528295d-8a78-4757-a828-3978919a9936 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:46.984079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528295d-8a78-4757-a828-3978919a9936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:46.985426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528295d-8a78-4757-a828-3978919a9936 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:46.990036 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 661/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Mon Sep 12 23:18:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:18:46.995728 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71a64d-6f3e-461a-9d2c-18ef1d4abe88 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:47.102143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71a64d-6f3e-461a-9d2c-18ef1d4abe88 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:47.137130 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c93582-26ea-4579-97fb-2e37e7946f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:47.137724 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c93582-26ea-4579-97fb-2e37e7946f80 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:47.137999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c93582-26ea-4579-97fb-2e37e7946f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:47.138266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c93582-26ea-4579-97fb-2e37e7946f80 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:47.138908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c93582-26ea-4579-97fb-2e37e7946f80 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:47.139205 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c93582-26ea-4579-97fb-2e37e7946f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:47.140554 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c93582-26ea-4579-97fb-2e37e7946f80 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:47.144790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 631/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Mon Sep 12 23:18:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:49.263463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437181-bf7f-40a5-9b6a-efaa67c83fec None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:49.263997 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437181-bf7f-40a5-9b6a-efaa67c83fec None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:49.263997 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437181-bf7f-40a5-9b6a-efaa67c83fec None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:49.265344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 662/1293] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:18:49.270447 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7230c7d-abff-4da8-8d8c-f1110b76ff59 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:49.270852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7230c7d-abff-4da8-8d8c-f1110b76ff59 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:49.270990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7230c7d-abff-4da8-8d8c-f1110b76ff59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:49.289141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a7230c7d-abff-4da8-8d8c-f1110b76ff59 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:18:49.291152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a7230c7d-abff-4da8-8d8c-f1110b76ff59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:18:49.320181 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:49.357890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 632/1294] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:18:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:18:49.625319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437181-bf7f-40a5-9b6a-efaa67c83fec None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:49.656356 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:49.725047 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437181-bf7f-40a5-9b6a-efaa67c83fec None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:49.759233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00766a4d-ea23-4859-87d7-9f3c7207db9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:49.759824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00766a4d-ea23-4859-87d7-9f3c7207db9e None admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:49.760100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00766a4d-ea23-4859-87d7-9f3c7207db9e None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:49.760370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00766a4d-ea23-4859-87d7-9f3c7207db9e None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:49.761018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00766a4d-ea23-4859-87d7-9f3c7207db9e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:49.762371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00766a4d-ea23-4859-87d7-9f3c7207db9e None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:49.776526 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 663/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Mon Sep 12 23:18:49 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:18:51.892597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a24e-ff07-4c4c-a98c-7f6dae46bfe0 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:51.893127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a24e-ff07-4c4c-a98c-7f6dae46bfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:51.893127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a24e-ff07-4c4c-a98c-7f6dae46bfe0 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:51.894476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 633/1296] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:18:51.900237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbc950-d63c-44f1-9d07-06baa6852aa8 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:51.900677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbc950-d63c-44f1-9d07-06baa6852aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:51.900771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbc950-d63c-44f1-9d07-06baa6852aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:51.919296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-65fbc950-d63c-44f1-9d07-06baa6852aa8 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:18:51.920463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-65fbc950-d63c-44f1-9d07-06baa6852aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:18:51.990448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 664/1297] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:18:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:18:52.268180 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a24e-ff07-4c4c-a98c-7f6dae46bfe0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:52.367751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a24e-ff07-4c4c-a98c-7f6dae46bfe0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:52.402709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e730e4-4ca3-4ade-b1c9-266d1a212131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:52.403333 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e730e4-4ca3-4ade-b1c9-266d1a212131 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:52.403607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e730e4-4ca3-4ade-b1c9-266d1a212131 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:52.403877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e730e4-4ca3-4ade-b1c9-266d1a212131 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:52.404446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e730e4-4ca3-4ade-b1c9-266d1a212131 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:52.405790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e730e4-4ca3-4ade-b1c9-266d1a212131 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-14e730e4-4ca3-4ade-b1c9-266d1a212131 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:52.414226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:52.416212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:52.417235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 634/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Sep 12 23:18:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:52.422184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbc950-d63c-44f1-9d07-06baa6852aa8 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:52.440799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:52.518830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbc950-d63c-44f1-9d07-06baa6852aa8 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:52.551550 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a1e27-e9d1-4439-a15c-6fa0638bbe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:52.552147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a1e27-e9d1-4439-a15c-6fa0638bbe5a None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:52.552426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a1e27-e9d1-4439-a15c-6fa0638bbe5a None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:52.552694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a1e27-e9d1-4439-a15c-6fa0638bbe5a None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:52.553322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a1e27-e9d1-4439-a15c-6fa0638bbe5a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:52.553625 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a1e27-e9d1-4439-a15c-6fa0638bbe5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:52.555013 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a1e27-e9d1-4439-a15c-6fa0638bbe5a None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:52.560096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 665/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Mon Sep 12 23:18:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:52.566020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e730e4-4ca3-4ade-b1c9-266d1a212131 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:52.597854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:52.666001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e730e4-4ca3-4ade-b1c9-266d1a212131 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:52.699632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca5b33-d076-4fcd-950a-8691d2d6e166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:52.700228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca5b33-d076-4fcd-950a-8691d2d6e166 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:52.700517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca5b33-d076-4fcd-950a-8691d2d6e166 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:52.700790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca5b33-d076-4fcd-950a-8691d2d6e166 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:52.701482 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca5b33-d076-4fcd-950a-8691d2d6e166 None admin] RBAC: Adding query filter params (interface=public, service_id=15496e57e6d0476c8b789eee247be3a8, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:52.701790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca5b33-d076-4fcd-950a-8691d2d6e166 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:52.703215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca5b33-d076-4fcd-950a-8691d2d6e166 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:52.708111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 635/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Mon Sep 12 23:18:52 2022] GET /identity/v3/endpoints?service_id=15496e57e6d0476c8b789eee247be3a8&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:52.713982 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a1e27-e9d1-4439-a15c-6fa0638bbe5a None admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:52.792319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:52.810708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a1e27-e9d1-4439-a15c-6fa0638bbe5a None admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:52.844347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05e6f7-75fc-408e-a279-3208748ee788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:52.844946 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05e6f7-75fc-408e-a279-3208748ee788 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:52.845219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05e6f7-75fc-408e-a279-3208748ee788 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:52.845486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05e6f7-75fc-408e-a279-3208748ee788 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:52.846089 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05e6f7-75fc-408e-a279-3208748ee788 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:52.847478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05e6f7-75fc-408e-a279-3208748ee788 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:52.854403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 666/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Mon Sep 12 23:18:52 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:18:54.957138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd28ff-276b-44a8-9e9e-69668fe91363 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:54.957668 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd28ff-276b-44a8-9e9e-69668fe91363 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:54.957668 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd28ff-276b-44a8-9e9e-69668fe91363 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:54.959056 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 636/1302] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:18:54.964440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb56779-5ed6-41cc-94d1-be3a3a33a85a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:54.964857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb56779-5ed6-41cc-94d1-be3a3a33a85a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:54.964971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb56779-5ed6-41cc-94d1-be3a3a33a85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:54.982706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-dcb56779-5ed6-41cc-94d1-be3a3a33a85a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:18:54.983879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-dcb56779-5ed6-41cc-94d1-be3a3a33a85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:18:55.049099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 667/1303] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:18:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:18:55.318774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd28ff-276b-44a8-9e9e-69668fe91363 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:55.415716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:55.424078 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd28ff-276b-44a8-9e9e-69668fe91363 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:55.457127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f15fa-8d2e-4233-beb7-9f2e803b36bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:55.457742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f15fa-8d2e-4233-beb7-9f2e803b36bf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:55.458017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f15fa-8d2e-4233-beb7-9f2e803b36bf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:55.458285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f15fa-8d2e-4233-beb7-9f2e803b36bf None admin] PATH_INFO: `/v3/services/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:55.458895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f15fa-8d2e-4233-beb7-9f2e803b36bf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:55.460248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f15fa-8d2e-4233-beb7-9f2e803b36bf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c20f15fa-8d2e-4233-beb7-9f2e803b36bf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:18:55.468994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:18:55.474582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 12 23:18:55.475510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 637/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Mon Sep 12 23:18:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:18:55.476518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb56779-5ed6-41cc-94d1-be3a3a33a85a None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:55.550215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:18:55.573248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb56779-5ed6-41cc-94d1-be3a3a33a85a None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:55.606325 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7156c-caf4-4080-80dc-ebecf66e6963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:55.606949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7156c-caf4-4080-80dc-ebecf66e6963 None admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:55.607222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7156c-caf4-4080-80dc-ebecf66e6963 None admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:55.607487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7156c-caf4-4080-80dc-ebecf66e6963 None admin] PATH_INFO: `/v3/services` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:55.608107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7156c-caf4-4080-80dc-ebecf66e6963 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:18:55.608404 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7156c-caf4-4080-80dc-ebecf66e6963 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:55.609758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7156c-caf4-4080-80dc-ebecf66e6963 None admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:55.614776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 668/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Mon Sep 12 23:18:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:18:55.620991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f15fa-8d2e-4233-beb7-9f2e803b36bf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:18:55.716482 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f15fa-8d2e-4233-beb7-9f2e803b36bf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:18:55.748887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb1343-b771-4e43-bc60-800c348a5043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:18:55.749473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1343-b771-4e43-bc60-800c348a5043 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:18:55.749746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1343-b771-4e43-bc60-800c348a5043 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:18:55.750014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1343-b771-4e43-bc60-800c348a5043 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:18:55.750698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb1343-b771-4e43-bc60-800c348a5043 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:18:55.752050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb1343-b771-4e43-bc60-800c348a5043 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:18:55.770704 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 638/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:18:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:19:05.612239 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=30 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:19:05.766298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:19:59.983688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c347f7-308e-4afa-a984-4d36a7166d05 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:19:59.984667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c347f7-308e-4afa-a984-4d36a7166d05 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:19:59.985111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c347f7-308e-4afa-a984-4d36a7166d05 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:19:59.986637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 669/1307] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:19:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:19:59.992674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af010d17-1e1b-435c-8cfb-b7b6c86e32c5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:19:59.993163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af010d17-1e1b-435c-8cfb-b7b6c86e32c5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:19:59.993280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af010d17-1e1b-435c-8cfb-b7b6c86e32c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:00.141315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-af010d17-1e1b-435c-8cfb-b7b6c86e32c5 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:00.142578 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-af010d17-1e1b-435c-8cfb-b7b6c86e32c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:00.319172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 639/1308] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:20:00.633586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c51c-4ec6-4d0f-bab4-bdc87319790a None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:00.633967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c51c-4ec6-4d0f-bab4-bdc87319790a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:00.634142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c51c-4ec6-4d0f-bab4-bdc87319790a None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:00.635622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 670/1309] 10.222.0.33 () {54 vars in 965 bytes} [Mon Sep 12 23:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:00.646690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968272d-1705-46a1-90bf-f0e630fafd0a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:00.647485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968272d-1705-46a1-90bf-f0e630fafd0a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:00.648239 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968272d-1705-46a1-90bf-f0e630fafd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:00.766009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4968272d-1705-46a1-90bf-f0e630fafd0a None None] MFA Rules not processed for user `b1d4b0f322c741c5b69b922071aab3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:00.767956 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4968272d-1705-46a1-90bf-f0e630fafd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:00.798222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:00.875329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 640/1310] 10.222.0.33 () {58 vars in 1062 bytes} [Mon Sep 12 23:20:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:20:00.876091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c51c-4ec6-4d0f-bab4-bdc87319790a None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:00.877822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4e45c51c-4ec6-4d0f-bab4-bdc87319790a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:01.014885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c51c-4ec6-4d0f-bab4-bdc87319790a None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:01.100922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d098e7-ae15-417c-a474-5df023fad4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:01.101935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d098e7-ae15-417c-a474-5df023fad4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:01.102469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d098e7-ae15-417c-a474-5df023fad4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:01.102964 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d098e7-ae15-417c-a474-5df023fad4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:01.105088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-94d098e7-ae15-417c-a474-5df023fad4f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:01.168204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:01.230827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d098e7-ae15-417c-a474-5df023fad4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:01.232683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d098e7-ae15-417c-a474-5df023fad4f7 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:01.255317 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 671/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:20:03.757230 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019c3f0-37a1-47cb-b8ce-a5006c22620a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:03.757748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019c3f0-37a1-47cb-b8ce-a5006c22620a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:03.757853 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019c3f0-37a1-47cb-b8ce-a5006c22620a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:03.759136 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 641/1312] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:03.764439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0973-7c71-45f0-8abd-26452a846d27 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:03.764858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0973-7c71-45f0-8abd-26452a846d27 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:03.764969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0973-7c71-45f0-8abd-26452a846d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:03.845922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ec6a0973-7c71-45f0-8abd-26452a846d27 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:03.847179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ec6a0973-7c71-45f0-8abd-26452a846d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:03.944968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 672/1313] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:04.234622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019c3f0-37a1-47cb-b8ce-a5006c22620a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:04.236138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f019c3f0-37a1-47cb-b8ce-a5006c22620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:04.338812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019c3f0-37a1-47cb-b8ce-a5006c22620a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:04.409287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:04.412211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b55800-b703-425d-a3c1-0f70a00eeb91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:04.413128 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b55800-b703-425d-a3c1-0f70a00eeb91 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:04.413613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b55800-b703-425d-a3c1-0f70a00eeb91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:04.414083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b55800-b703-425d-a3c1-0f70a00eeb91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:04.416042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a4b55800-b703-425d-a3c1-0f70a00eeb91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:04.523237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b55800-b703-425d-a3c1-0f70a00eeb91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:04.524600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b55800-b703-425d-a3c1-0f70a00eeb91 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:04.542700 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 642/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:20:06.998952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083ce84-5d96-4130-bcb1-2e4a86fc07ee None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:06.999490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083ce84-5d96-4130-bcb1-2e4a86fc07ee None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:06.999490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083ce84-5d96-4130-bcb1-2e4a86fc07ee None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:07.000832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 673/1315] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:07.006911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ca2a7-a364-4ce6-b903-6748ddc0c47f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:07.007356 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ca2a7-a364-4ce6-b903-6748ddc0c47f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:07.007453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ca2a7-a364-4ce6-b903-6748ddc0c47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:07.073365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a85ca2a7-a364-4ce6-b903-6748ddc0c47f None None] MFA Rules not processed for user `3cbe79decc7e47dbbe30a01873217e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:07.074586 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a85ca2a7-a364-4ce6-b903-6748ddc0c47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:07.125968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:07.171647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 643/1316] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:07.459325 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083ce84-5d96-4130-bcb1-2e4a86fc07ee None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:07.460862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c083ce84-5d96-4130-bcb1-2e4a86fc07ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:07.470687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:07.564068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083ce84-5d96-4130-bcb1-2e4a86fc07ee None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:07.635924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1382a-7d28-43c1-96a2-fbc56e42aea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:07.636454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1382a-7d28-43c1-96a2-fbc56e42aea5 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:07.636731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1382a-7d28-43c1-96a2-fbc56e42aea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:07.637002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1382a-7d28-43c1-96a2-fbc56e42aea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:07.638596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-63c1382a-7d28-43c1-96a2-fbc56e42aea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:07.701353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:07.749568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1382a-7d28-43c1-96a2-fbc56e42aea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:07.751046 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1382a-7d28-43c1-96a2-fbc56e42aea5 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:07.769386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 674/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:20:10.439734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1bc7d-1ce0-4575-a334-3764fbc85cf2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:10.440237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1bc7d-1ce0-4575-a334-3764fbc85cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:10.440343 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1bc7d-1ce0-4575-a334-3764fbc85cf2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:10.441604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 644/1318] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:10.447189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89276fab-609c-4bba-ae74-514af3e7f049 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:10.447591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89276fab-609c-4bba-ae74-514af3e7f049 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:10.447768 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89276fab-609c-4bba-ae74-514af3e7f049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:10.514221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-89276fab-609c-4bba-ae74-514af3e7f049 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:10.515469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-89276fab-609c-4bba-ae74-514af3e7f049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:10.611225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 675/1319] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:10.898247 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1bc7d-1ce0-4575-a334-3764fbc85cf2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:10.899801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7da1bc7d-1ce0-4575-a334-3764fbc85cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:11.002105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1bc7d-1ce0-4575-a334-3764fbc85cf2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:11.076547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122222fd-403a-4ffd-a9b4-41091613f691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:11.077173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122222fd-403a-4ffd-a9b4-41091613f691 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:11.077450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122222fd-403a-4ffd-a9b4-41091613f691 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:11.077745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122222fd-403a-4ffd-a9b4-41091613f691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:11.079355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-122222fd-403a-4ffd-a9b4-41091613f691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:11.086209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:11.191073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122222fd-403a-4ffd-a9b4-41091613f691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:11.192478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122222fd-403a-4ffd-a9b4-41091613f691 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:11.210115 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 645/1320] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:20:13.998253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2d87-366e-4199-bb6a-8c94db54b4a0 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:13.998850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2d87-366e-4199-bb6a-8c94db54b4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:13.998850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2d87-366e-4199-bb6a-8c94db54b4a0 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:14.000160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 676/1321] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:14.006164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812db561-5eb3-4e04-8715-8ce3cf53fe9e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:14.006764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812db561-5eb3-4e04-8715-8ce3cf53fe9e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:14.006764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812db561-5eb3-4e04-8715-8ce3cf53fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:14.080461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-812db561-5eb3-4e04-8715-8ce3cf53fe9e None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:14.081725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-812db561-5eb3-4e04-8715-8ce3cf53fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:14.144388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:14.190716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 646/1322] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:14.487894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d6af-34f1-4ac9-b1c2-cdfd195ac901 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:14.488209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d6af-34f1-4ac9-b1c2-cdfd195ac901 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:14.488489 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d6af-34f1-4ac9-b1c2-cdfd195ac901 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:14.490025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 677/1323] 10.222.0.33 () {54 vars in 965 bytes} [Mon Sep 12 23:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:14.495664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825ef8d-3d88-4dd2-8faf-fd5e0c3a766d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:14.496019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825ef8d-3d88-4dd2-8faf-fd5e0c3a766d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:14.496364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825ef8d-3d88-4dd2-8faf-fd5e0c3a766d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:14.574508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8825ef8d-3d88-4dd2-8faf-fd5e0c3a766d None None] MFA Rules not processed for user `b1d4b0f322c741c5b69b922071aab3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:14.575691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8825ef8d-3d88-4dd2-8faf-fd5e0c3a766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:14.651119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 647/1324] 10.222.0.33 () {58 vars in 1062 bytes} [Mon Sep 12 23:20:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:14.660151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308d6af-34f1-4ac9-b1c2-cdfd195ac901 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:14.661762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0308d6af-34f1-4ac9-b1c2-cdfd195ac901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:14.683181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:14.767128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308d6af-34f1-4ac9-b1c2-cdfd195ac901 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:14.841862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e061a1-136e-43de-83e8-690aa5b105e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:14.842502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e061a1-136e-43de-83e8-690aa5b105e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:14.842786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e061a1-136e-43de-83e8-690aa5b105e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:14.843060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e061a1-136e-43de-83e8-690aa5b105e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:14.844636 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-21e061a1-136e-43de-83e8-690aa5b105e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:14.915127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:14.952882 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e061a1-136e-43de-83e8-690aa5b105e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:14.954318 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e061a1-136e-43de-83e8-690aa5b105e1 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:14.972895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 678/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:20:17.448105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537676c7-1093-42df-899e-0c7f997fab0b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:17.448610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537676c7-1093-42df-899e-0c7f997fab0b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:17.448610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537676c7-1093-42df-899e-0c7f997fab0b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:17.449884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 648/1326] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:17.455439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f44b7f-b5f1-4b61-81aa-833344ae3a45 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:17.455863 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f44b7f-b5f1-4b61-81aa-833344ae3a45 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:17.455967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f44b7f-b5f1-4b61-81aa-833344ae3a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:17.522626 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-70f44b7f-b5f1-4b61-81aa-833344ae3a45 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:17.523817 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-70f44b7f-b5f1-4b61-81aa-833344ae3a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:17.620137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 679/1327] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:17.905785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537676c7-1093-42df-899e-0c7f997fab0b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:17.907460 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-537676c7-1093-42df-899e-0c7f997fab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:17.971689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:18.016967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537676c7-1093-42df-899e-0c7f997fab0b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:18.090473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa29d8-9720-4cb5-ab35-2917e3a5f170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:18.091111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa29d8-9720-4cb5-ab35-2917e3a5f170 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:18.091384 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa29d8-9720-4cb5-ab35-2917e3a5f170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:18.091650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa29d8-9720-4cb5-ab35-2917e3a5f170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:18.093238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-22fa29d8-9720-4cb5-ab35-2917e3a5f170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:18.204676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:18.206957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa29d8-9720-4cb5-ab35-2917e3a5f170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:18.209245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa29d8-9720-4cb5-ab35-2917e3a5f170 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:18.228184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 649/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:20:20.463310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee3fba-6082-4569-8cdf-6800a33da644 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:20.463824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee3fba-6082-4569-8cdf-6800a33da644 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:20.463930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee3fba-6082-4569-8cdf-6800a33da644 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:20.465221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 680/1329] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:20.470770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cff96-292f-4cc1-a8c1-6a4937aac34c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:20.471245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cff96-292f-4cc1-a8c1-6a4937aac34c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:20.471338 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cff96-292f-4cc1-a8c1-6a4937aac34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:20.543883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ad2cff96-292f-4cc1-a8c1-6a4937aac34c None None] MFA Rules not processed for user `3cbe79decc7e47dbbe30a01873217e73`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:20.545095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ad2cff96-292f-4cc1-a8c1-6a4937aac34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:20.642947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 650/1330] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:20.931273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee3fba-6082-4569-8cdf-6800a33da644 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:20.932869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-05ee3fba-6082-4569-8cdf-6800a33da644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:20.965099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:21.042762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee3fba-6082-4569-8cdf-6800a33da644 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:21.118965 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370b955-7110-467c-9e3f-5a2d5b897665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:21.119568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370b955-7110-467c-9e3f-5a2d5b897665 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:21.119840 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370b955-7110-467c-9e3f-5a2d5b897665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:21.120106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370b955-7110-467c-9e3f-5a2d5b897665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:21.121678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5370b955-7110-467c-9e3f-5a2d5b897665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:21.213893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:21.251599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370b955-7110-467c-9e3f-5a2d5b897665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:21.253063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370b955-7110-467c-9e3f-5a2d5b897665 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:21.273029 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 681/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:20:23.650755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c540737-5fa1-4ff8-8770-ff97635a5c76 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:23.651280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c540737-5fa1-4ff8-8770-ff97635a5c76 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:23.651280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c540737-5fa1-4ff8-8770-ff97635a5c76 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:23.652579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 651/1332] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:23.657716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433badfe-7a28-474e-b974-efe25cd01a44 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:23.658144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433badfe-7a28-474e-b974-efe25cd01a44 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:23.658266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433badfe-7a28-474e-b974-efe25cd01a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:23.724904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-433badfe-7a28-474e-b974-efe25cd01a44 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:23.726097 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-433badfe-7a28-474e-b974-efe25cd01a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:23.822204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 682/1333] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:24.100896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c540737-5fa1-4ff8-8770-ff97635a5c76 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:24.102449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0c540737-5fa1-4ff8-8770-ff97635a5c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:24.172099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:24.206818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c540737-5fa1-4ff8-8770-ff97635a5c76 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:24.280542 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e957d5-57a3-4bef-b667-b2c1752746bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:24.281145 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e957d5-57a3-4bef-b667-b2c1752746bc service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:24.281424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e957d5-57a3-4bef-b667-b2c1752746bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:24.281696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e957d5-57a3-4bef-b667-b2c1752746bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:24.283316 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e9e957d5-57a3-4bef-b667-b2c1752746bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:24.392721 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e957d5-57a3-4bef-b667-b2c1752746bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:24.394176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e957d5-57a3-4bef-b667-b2c1752746bc service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:24.404634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:24.413300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 652/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:20:26.593822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75511a3-752c-47ec-9664-e23b98dcf671 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:26.594354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75511a3-752c-47ec-9664-e23b98dcf671 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:26.594354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75511a3-752c-47ec-9664-e23b98dcf671 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:26.595716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 683/1335] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:26.601609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817bcf9-52ab-43e6-8fef-1eeae30332db None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:26.602025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817bcf9-52ab-43e6-8fef-1eeae30332db None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:26.602198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817bcf9-52ab-43e6-8fef-1eeae30332db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:26.668295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c817bcf9-52ab-43e6-8fef-1eeae30332db None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:26.669421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c817bcf9-52ab-43e6-8fef-1eeae30332db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:26.765457 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 653/1336] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:27.054141 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75511a3-752c-47ec-9664-e23b98dcf671 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:27.055711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c75511a3-752c-47ec-9664-e23b98dcf671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:27.095404 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:27.158619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75511a3-752c-47ec-9664-e23b98dcf671 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:27.233407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ec5c1-abba-414a-81ff-23dd96a72c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:27.234011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ec5c1-abba-414a-81ff-23dd96a72c2e service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:27.234291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ec5c1-abba-414a-81ff-23dd96a72c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:27.234601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ec5c1-abba-414a-81ff-23dd96a72c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:27.236180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5c1ec5c1-abba-414a-81ff-23dd96a72c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:27.318989 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:27.344693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ec5c1-abba-414a-81ff-23dd96a72c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:27.346126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ec5c1-abba-414a-81ff-23dd96a72c2e service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:27.363616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 684/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:20:29.859569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf0574-5b18-43c9-ac48-963b96dfa8ea None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:29.860121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf0574-5b18-43c9-ac48-963b96dfa8ea None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:29.860121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf0574-5b18-43c9-ac48-963b96dfa8ea None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:29.861440 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 654/1338] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:29.867338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa8d49-6ae9-45ec-8c6c-3c58bab01b3d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:29.867782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa8d49-6ae9-45ec-8c6c-3c58bab01b3d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:29.867969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa8d49-6ae9-45ec-8c6c-3c58bab01b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:29.933592 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ddaa8d49-6ae9-45ec-8c6c-3c58bab01b3d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:29.934763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ddaa8d49-6ae9-45ec-8c6c-3c58bab01b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:30.030337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 685/1339] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:30.319601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf0574-5b18-43c9-ac48-963b96dfa8ea None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:30.321165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fcaf0574-5b18-43c9-ac48-963b96dfa8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:30.397498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:30.426736 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf0574-5b18-43c9-ac48-963b96dfa8ea None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:30.503353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd468c-8204-4e65-99cb-c20df7ec02cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:30.503962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd468c-8204-4e65-99cb-c20df7ec02cf service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:30.504245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd468c-8204-4e65-99cb-c20df7ec02cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:30.504516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd468c-8204-4e65-99cb-c20df7ec02cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:30.506081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5ecd468c-8204-4e65-99cb-c20df7ec02cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:30.615999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd468c-8204-4e65-99cb-c20df7ec02cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:30.617441 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd468c-8204-4e65-99cb-c20df7ec02cf service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:30.635903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 655/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:20:34.769699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8468dc-1647-46ca-b139-49b07bae5101 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:34.770284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8468dc-1647-46ca-b139-49b07bae5101 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:34.770284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8468dc-1647-46ca-b139-49b07bae5101 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:34.771620 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 686/1341] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:34.777598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3106bc8-c2c4-4589-8deb-3302fdfb1ef0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:34.778046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3106bc8-c2c4-4589-8deb-3302fdfb1ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:34.778307 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3106bc8-c2c4-4589-8deb-3302fdfb1ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:34.783951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:34.847021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c3106bc8-c2c4-4589-8deb-3302fdfb1ef0 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:34.848106 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c3106bc8-c2c4-4589-8deb-3302fdfb1ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:34.945488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 656/1342] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:35.234419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8468dc-1647-46ca-b139-49b07bae5101 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:35.236059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-db8468dc-1647-46ca-b139-49b07bae5101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:35.286637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:35.344133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8468dc-1647-46ca-b139-49b07bae5101 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:35.421407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44198bcf-c738-4abb-b91a-2b57809c24cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:35.422061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44198bcf-c738-4abb-b91a-2b57809c24cf service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:35.422332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44198bcf-c738-4abb-b91a-2b57809c24cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:35.422628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44198bcf-c738-4abb-b91a-2b57809c24cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:35.424193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-44198bcf-c738-4abb-b91a-2b57809c24cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:35.518503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:35.535608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44198bcf-c738-4abb-b91a-2b57809c24cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:35.537092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44198bcf-c738-4abb-b91a-2b57809c24cf service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:35.556821 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 687/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:20:38.387158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a2f8c-3023-41db-8700-76d6a1efedd4 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:38.387630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a2f8c-3023-41db-8700-76d6a1efedd4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:38.387747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a2f8c-3023-41db-8700-76d6a1efedd4 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:38.389060 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 657/1344] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:38.394256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655000b2-88e5-45dd-9cd7-8d8d8b1839fc None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:38.395254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655000b2-88e5-45dd-9cd7-8d8d8b1839fc None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:38.395347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655000b2-88e5-45dd-9cd7-8d8d8b1839fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:38.462986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-655000b2-88e5-45dd-9cd7-8d8d8b1839fc None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:38.464218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-655000b2-88e5-45dd-9cd7-8d8d8b1839fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:38.563068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 688/1345] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:38.851569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a2f8c-3023-41db-8700-76d6a1efedd4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:38.853098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-510a2f8c-3023-41db-8700-76d6a1efedd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:38.948287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:38.966130 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a2f8c-3023-41db-8700-76d6a1efedd4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:39.042015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055d483-d012-4a30-b92b-0d3c47374027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:39.042566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055d483-d012-4a30-b92b-0d3c47374027 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:39.042843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055d483-d012-4a30-b92b-0d3c47374027 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:39.043166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055d483-d012-4a30-b92b-0d3c47374027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:39.044672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0055d483-d012-4a30-b92b-0d3c47374027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:39.161748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055d483-d012-4a30-b92b-0d3c47374027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:39.163216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055d483-d012-4a30-b92b-0d3c47374027 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:39.181413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 658/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:20:43.298025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da050ad-f829-49cb-b4ff-2a0a20a59898 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:43.298545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da050ad-f829-49cb-b4ff-2a0a20a59898 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:43.298639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da050ad-f829-49cb-b4ff-2a0a20a59898 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:43.299927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 689/1347] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:43.305727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e01d23-d58c-41a6-a431-e27506859241 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:43.306144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e01d23-d58c-41a6-a431-e27506859241 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:43.306296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e01d23-d58c-41a6-a431-e27506859241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:43.323158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:43.375407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-63e01d23-d58c-41a6-a431-e27506859241 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:43.376646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-63e01d23-d58c-41a6-a431-e27506859241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:43.476854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 659/1348] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:43.758790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da050ad-f829-49cb-b4ff-2a0a20a59898 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:43.760301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9da050ad-f829-49cb-b4ff-2a0a20a59898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:43.820373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:43.867119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da050ad-f829-49cb-b4ff-2a0a20a59898 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:43.942801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e634d7-ffa9-4ed2-a5ea-1540be6d0ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:43.943400 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e634d7-ffa9-4ed2-a5ea-1540be6d0ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:43.943682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e634d7-ffa9-4ed2-a5ea-1540be6d0ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:43.943950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e634d7-ffa9-4ed2-a5ea-1540be6d0ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:43.945537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-73e634d7-ffa9-4ed2-a5ea-1540be6d0ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:44.051551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:44.056554 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e634d7-ffa9-4ed2-a5ea-1540be6d0ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:44.058043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e634d7-ffa9-4ed2-a5ea-1540be6d0ca3 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:20:44.076587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 690/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:20:48.979535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588da562-f740-4a34-add0-9cda74825a2b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:48.979990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588da562-f740-4a34-add0-9cda74825a2b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:48.981236 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588da562-f740-4a34-add0-9cda74825a2b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:48.982504 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 660/1350] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:48.990413 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8f401-b9cd-4724-a144-586e4678142a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:48.990413 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8f401-b9cd-4724-a144-586e4678142a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:48.990413 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8f401-b9cd-4724-a144-586e4678142a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:49.098691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f9a8f401-b9cd-4724-a144-586e4678142a None None] MFA Rules not processed for user `559a4af215324597b203e6866cb51fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:49.100269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f9a8f401-b9cd-4724-a144-586e4678142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:49.246553 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 691/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:20:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:53.475343 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=59 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:53.544393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffd271-80d5-41fd-918d-7112d92bea75 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:53.544738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffd271-80d5-41fd-918d-7112d92bea75 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:53.544990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffd271-80d5-41fd-918d-7112d92bea75 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:53.546466 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 661/1352] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:53.551455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c0434-bec3-42ce-b81d-0d44c18ad70b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:53.551932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c0434-bec3-42ce-b81d-0d44c18ad70b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:53.552025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c0434-bec3-42ce-b81d-0d44c18ad70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:53.608979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:53.634135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-461c0434-bec3-42ce-b81d-0d44c18ad70b None None] MFA Rules not processed for user `559a4af215324597b203e6866cb51fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:53.635299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-461c0434-bec3-42ce-b81d-0d44c18ad70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:53.759855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 692/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:20:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:54.984874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c6821-fe9e-4c49-a107-65bd58b86ac4 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:54.985426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c6821-fe9e-4c49-a107-65bd58b86ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:54.985426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c6821-fe9e-4c49-a107-65bd58b86ac4 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:54.986767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 662/1354] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:54.991861 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b184a8-1b5d-4708-b359-14547d10621b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:54.992271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b184a8-1b5d-4708-b359-14547d10621b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:54.992415 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b184a8-1b5d-4708-b359-14547d10621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:55.073063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-10b184a8-1b5d-4708-b359-14547d10621b None None] MFA Rules not processed for user `559a4af215324597b203e6866cb51fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:55.074268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-10b184a8-1b5d-4708-b359-14547d10621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:55.117543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:55.182834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 693/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:20:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:58.819556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a9acb-48ba-4427-907b-0477b82a712c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:58.820402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a9acb-48ba-4427-907b-0477b82a712c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:58.820840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a9acb-48ba-4427-907b-0477b82a712c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:58.822184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 663/1356] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:58.827647 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75a0c9-170f-401b-af43-349a079ee24a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:58.828067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75a0c9-170f-401b-af43-349a079ee24a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:58.828238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75a0c9-170f-401b-af43-349a079ee24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:58.904655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-8e75a0c9-170f-401b-af43-349a079ee24a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:58.906112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8e75a0c9-170f-401b-af43-349a079ee24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:59.024019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 694/1357] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:20:59.347977 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96a4ae-1229-4ec5-ae7a-5094caa3fb08 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:59.348521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96a4ae-1229-4ec5-ae7a-5094caa3fb08 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:59.349035 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96a4ae-1229-4ec5-ae7a-5094caa3fb08 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:59.351261 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 664/1358] 10.222.0.33 () {54 vars in 962 bytes} [Mon Sep 12 23:20:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:20:59.358516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93877838-f360-4c28-9d9c-527a49eb5700 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:59.359063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93877838-f360-4c28-9d9c-527a49eb5700 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:59.359590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93877838-f360-4c28-9d9c-527a49eb5700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:59.386129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:59.456755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-93877838-f360-4c28-9d9c-527a49eb5700 None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:20:59.457951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-93877838-f360-4c28-9d9c-527a49eb5700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:59.584992 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 695/1359] 10.222.0.33 () {58 vars in 1059 bytes} [Mon Sep 12 23:20:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:20:59.593284 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96a4ae-1229-4ec5-ae7a-5094caa3fb08 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:20:59.594895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8a96a4ae-1229-4ec5-ae7a-5094caa3fb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:59.751632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96a4ae-1229-4ec5-ae7a-5094caa3fb08 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:20:59.832760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:59.880956 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30922b7-0dc3-4317-a222-d6026b9376b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:20:59.881501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30922b7-0dc3-4317-a222-d6026b9376b0 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:20:59.881789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30922b7-0dc3-4317-a222-d6026b9376b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:20:59.882082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30922b7-0dc3-4317-a222-d6026b9376b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:20:59.883875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d30922b7-0dc3-4317-a222-d6026b9376b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:20:59.984334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30922b7-0dc3-4317-a222-d6026b9376b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:20:59.985997 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30922b7-0dc3-4317-a222-d6026b9376b0 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:00.006703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 665/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:02.431771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaf7f5-e00c-41e5-8379-0ee7c6efa7f2 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:02.432467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaf7f5-e00c-41e5-8379-0ee7c6efa7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:02.432467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaf7f5-e00c-41e5-8379-0ee7c6efa7f2 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:02.438879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179b2a1-cda5-4b5c-b1dc-36e0c86ec483 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:02.438879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179b2a1-cda5-4b5c-b1dc-36e0c86ec483 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:02.439699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179b2a1-cda5-4b5c-b1dc-36e0c86ec483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:02.445217 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 696/1361] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:02 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:02.511867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6179b2a1-cda5-4b5c-b1dc-36e0c86ec483 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:02.513102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6179b2a1-cda5-4b5c-b1dc-36e0c86ec483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:02.553296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:02.617362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 666/1362] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:21:02.910173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaf7f5-e00c-41e5-8379-0ee7c6efa7f2 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:02.911791 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6ceaf7f5-e00c-41e5-8379-0ee7c6efa7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:02.984540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:03.095621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaf7f5-e00c-41e5-8379-0ee7c6efa7f2 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:03.228460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21d1d7-4b74-4688-8e6c-100155557a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:03.229191 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21d1d7-4b74-4688-8e6c-100155557a8f service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:03.229539 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21d1d7-4b74-4688-8e6c-100155557a8f service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:03.229880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21d1d7-4b74-4688-8e6c-100155557a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:03.231582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3c21d1d7-4b74-4688-8e6c-100155557a8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:03.256341 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:03.325415 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21d1d7-4b74-4688-8e6c-100155557a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:03.327151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21d1d7-4b74-4688-8e6c-100155557a8f service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:03.346024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 697/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:05.882152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037f356-da59-40c7-a53b-55f4ed5537cc None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:05.882745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037f356-da59-40c7-a53b-55f4ed5537cc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:05.882745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037f356-da59-40c7-a53b-55f4ed5537cc None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:05.884622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 667/1364] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:05.889976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8a52d-2838-4f9b-9b5b-a4a5e96f7caa None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:05.890373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8a52d-2838-4f9b-9b5b-a4a5e96f7caa None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:05.890646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8a52d-2838-4f9b-9b5b-a4a5e96f7caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:05.961089 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-0cb8a52d-2838-4f9b-9b5b-a4a5e96f7caa None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:05.962235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0cb8a52d-2838-4f9b-9b5b-a4a5e96f7caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:06.064164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:06.074249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 698/1365] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:06.365792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4e6c3-19f2-4f08-b04c-bfbb7ffdd953 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:06.366075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4e6c3-19f2-4f08-b04c-bfbb7ffdd953 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:06.366592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4e6c3-19f2-4f08-b04c-bfbb7ffdd953 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:06.367941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 668/1366] 10.222.0.33 () {54 vars in 962 bytes} [Mon Sep 12 23:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:06.373332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a59fff-ce29-4909-ab25-34b5e0e33156 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:06.373724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a59fff-ce29-4909-ab25-34b5e0e33156 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:06.374098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a59fff-ce29-4909-ab25-34b5e0e33156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:06.462372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-06a59fff-ce29-4909-ab25-34b5e0e33156 None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:06.463763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-06a59fff-ce29-4909-ab25-34b5e0e33156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:06.588307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 699/1367] 10.222.0.33 () {58 vars in 1059 bytes} [Mon Sep 12 23:21:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:06.597181 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4e6c3-19f2-4f08-b04c-bfbb7ffdd953 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:06.598949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-61e4e6c3-19f2-4f08-b04c-bfbb7ffdd953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:06.762827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4e6c3-19f2-4f08-b04c-bfbb7ffdd953 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:06.783905 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:06.884957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bc8d2-9a86-4f83-b4e7-ed33167af01b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:06.885634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bc8d2-9a86-4f83-b4e7-ed33167af01b service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:06.885873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bc8d2-9a86-4f83-b4e7-ed33167af01b service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:06.886790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bc8d2-9a86-4f83-b4e7-ed33167af01b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:06.888391 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-424bc8d2-9a86-4f83-b4e7-ed33167af01b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:06.991743 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bc8d2-9a86-4f83-b4e7-ed33167af01b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:06.993367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bc8d2-9a86-4f83-b4e7-ed33167af01b service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:07.014125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 669/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:07.076147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731f3b6-516f-416c-9d47-b8e670a28ff0 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:07.076605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731f3b6-516f-416c-9d47-b8e670a28ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:07.076706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731f3b6-516f-416c-9d47-b8e670a28ff0 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:07.078149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 700/1369] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:21:07.084642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc7d0c-6074-4441-b9a7-514835f53e65 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:07.084933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc7d0c-6074-4441-b9a7-514835f53e65 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:07.085212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc7d0c-6074-4441-b9a7-514835f53e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:07.129095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:07.181211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d4fc7d0c-6074-4441-b9a7-514835f53e65 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:07.182728 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d4fc7d0c-6074-4441-b9a7-514835f53e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:07.302567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 670/1370] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:07.637832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6803c-2aa6-4baa-9dd8-8a1b10ca9c31 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:07.638209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6803c-2aa6-4baa-9dd8-8a1b10ca9c31 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:07.638588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6803c-2aa6-4baa-9dd8-8a1b10ca9c31 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:07.640276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 701/1371] 10.222.0.33 () {54 vars in 964 bytes} [Mon Sep 12 23:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:07.645600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949c9e1-f1c9-46b2-8613-cc181ff32f6a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:07.645891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949c9e1-f1c9-46b2-8613-cc181ff32f6a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:07.646169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949c9e1-f1c9-46b2-8613-cc181ff32f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:07.739837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7949c9e1-f1c9-46b2-8613-cc181ff32f6a None None] MFA Rules not processed for user `4f5d6fe6235447acb395030fb0f0555d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:07.741212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7949c9e1-f1c9-46b2-8613-cc181ff32f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:07.790580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:07.823239 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 671/1372] 10.222.0.33 () {58 vars in 1061 bytes} [Mon Sep 12 23:21:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:07.831102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6803c-2aa6-4baa-9dd8-8a1b10ca9c31 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:07.833016 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-29f6803c-2aa6-4baa-9dd8-8a1b10ca9c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:07.891996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:07.956044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6803c-2aa6-4baa-9dd8-8a1b10ca9c31 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:08.049019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f42c06-c93f-4f33-a38e-032e6573a60e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:08.050506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f42c06-c93f-4f33-a38e-032e6573a60e service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:08.050992 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f42c06-c93f-4f33-a38e-032e6573a60e service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:08.051234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f42c06-c93f-4f33-a38e-032e6573a60e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:08.054169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-65f42c06-c93f-4f33-a38e-032e6573a60e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:08.173608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:08.189423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f42c06-c93f-4f33-a38e-032e6573a60e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:08.191222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f42c06-c93f-4f33-a38e-032e6573a60e service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:08.210899 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 702/1373] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:09.284009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef045b5-6d28-4ffc-b748-7f1ef4735271 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:09.284609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef045b5-6d28-4ffc-b748-7f1ef4735271 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:09.284609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef045b5-6d28-4ffc-b748-7f1ef4735271 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:09.285895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 672/1374] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:09.291339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef62b0-1599-42c7-bfa8-5d0fda9bbb0d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:09.291733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef62b0-1599-42c7-bfa8-5d0fda9bbb0d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:09.292076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef62b0-1599-42c7-bfa8-5d0fda9bbb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:09.361101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-24ef62b0-1599-42c7-bfa8-5d0fda9bbb0d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:09.363011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-24ef62b0-1599-42c7-bfa8-5d0fda9bbb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:09.462748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 703/1375] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:09.761517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef045b5-6d28-4ffc-b748-7f1ef4735271 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:09.763087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bef045b5-6d28-4ffc-b748-7f1ef4735271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:09.925389 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef045b5-6d28-4ffc-b748-7f1ef4735271 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:09.978931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:10.044555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86536d66-0109-4b2c-82c4-505577088bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:10.045175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536d66-0109-4b2c-82c4-505577088bca service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:10.045456 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536d66-0109-4b2c-82c4-505577088bca service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:10.045726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536d66-0109-4b2c-82c4-505577088bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:10.047368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-86536d66-0109-4b2c-82c4-505577088bca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:10.147012 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86536d66-0109-4b2c-82c4-505577088bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:10.148681 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86536d66-0109-4b2c-82c4-505577088bca service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:10.168525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 673/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:12.412804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203e9b6-431e-49c5-9107-0e3bdd308f69 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:12.413343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203e9b6-431e-49c5-9107-0e3bdd308f69 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:12.413343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203e9b6-431e-49c5-9107-0e3bdd308f69 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:12.415142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 704/1377] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:12.420223 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba814bf-0444-4626-b174-7bf8dd8815b3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:12.420655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba814bf-0444-4626-b174-7bf8dd8815b3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:12.420771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba814bf-0444-4626-b174-7bf8dd8815b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:12.491283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-cba814bf-0444-4626-b174-7bf8dd8815b3 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:12.492480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cba814bf-0444-4626-b174-7bf8dd8815b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:12.501639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:12.601701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 674/1378] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:12.889338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203e9b6-431e-49c5-9107-0e3bdd308f69 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:12.890996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9203e9b6-431e-49c5-9107-0e3bdd308f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:12.961315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:13.062931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203e9b6-431e-49c5-9107-0e3bdd308f69 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:13.195465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a8c3d-095f-45fc-ad6e-b2dadb70669d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:13.196270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a8c3d-095f-45fc-ad6e-b2dadb70669d service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:13.196559 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a8c3d-095f-45fc-ad6e-b2dadb70669d service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:13.196884 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a8c3d-095f-45fc-ad6e-b2dadb70669d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:13.199570 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-820a8c3d-095f-45fc-ad6e-b2dadb70669d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:13.224833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:13.301318 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a8c3d-095f-45fc-ad6e-b2dadb70669d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:13.302954 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a8c3d-095f-45fc-ad6e-b2dadb70669d service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:13.321582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 705/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:15.697875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5add549-2a52-41b3-97fc-f1183458af33 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:15.698290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5add549-2a52-41b3-97fc-f1183458af33 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:15.698459 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5add549-2a52-41b3-97fc-f1183458af33 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:15.701682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 675/1380] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:15.705117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee10b3d-d87b-43d3-b665-ca0a677213f9 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:15.705544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee10b3d-d87b-43d3-b665-ca0a677213f9 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:15.705972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee10b3d-d87b-43d3-b665-ca0a677213f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:15.778150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cee10b3d-d87b-43d3-b665-ca0a677213f9 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:15.779465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cee10b3d-d87b-43d3-b665-ca0a677213f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:15.878494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:15.895691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 706/1381] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:16.189674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5add549-2a52-41b3-97fc-f1183458af33 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:16.191802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b5add549-2a52-41b3-97fc-f1183458af33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:16.346358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:16.357569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5add549-2a52-41b3-97fc-f1183458af33 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:16.483003 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c2615-dc7f-4cd3-bc4e-9ac18940bc5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:16.483614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c2615-dc7f-4cd3-bc4e-9ac18940bc5c service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:16.483891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c2615-dc7f-4cd3-bc4e-9ac18940bc5c service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:16.484159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c2615-dc7f-4cd3-bc4e-9ac18940bc5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:16.485978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-031c2615-dc7f-4cd3-bc4e-9ac18940bc5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:16.587176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c2615-dc7f-4cd3-bc4e-9ac18940bc5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:16.589083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c2615-dc7f-4cd3-bc4e-9ac18940bc5c service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:16.601641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:16.611753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 676/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:18.962763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df1d8-d4af-41d8-bc1b-6d428119d059 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:18.963322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df1d8-d4af-41d8-bc1b-6d428119d059 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:18.963420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df1d8-d4af-41d8-bc1b-6d428119d059 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:18.964759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 707/1383] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:18.970418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed1a65-0b01-4019-ac18-1836b3b7b584 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:18.971041 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed1a65-0b01-4019-ac18-1836b3b7b584 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:18.971300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed1a65-0b01-4019-ac18-1836b3b7b584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:19.043461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-beed1a65-0b01-4019-ac18-1836b3b7b584 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:19.044763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-beed1a65-0b01-4019-ac18-1836b3b7b584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:19.149171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 677/1384] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:19.448962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212df1d8-d4af-41d8-bc1b-6d428119d059 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:19.450752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-212df1d8-d4af-41d8-bc1b-6d428119d059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:19.607426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212df1d8-d4af-41d8-bc1b-6d428119d059 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:19.677673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:19.728120 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b23e34-85dc-4eae-a0be-70e2666fef98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:19.728732 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b23e34-85dc-4eae-a0be-70e2666fef98 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:19.729012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b23e34-85dc-4eae-a0be-70e2666fef98 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:19.729287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b23e34-85dc-4eae-a0be-70e2666fef98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:19.730920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-47b23e34-85dc-4eae-a0be-70e2666fef98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:19.828562 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b23e34-85dc-4eae-a0be-70e2666fef98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:19.830329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b23e34-85dc-4eae-a0be-70e2666fef98 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:19.849699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 708/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:22.101600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507a1c5-20e9-4275-9598-869d0ec8abae None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:22.102148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507a1c5-20e9-4275-9598-869d0ec8abae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:22.102300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507a1c5-20e9-4275-9598-869d0ec8abae None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:22.103701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 678/1386] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:21:22.109791 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf2687-cfe2-4872-9ac3-03f0096dc60d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:22.110262 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf2687-cfe2-4872-9ac3-03f0096dc60d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:22.110537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf2687-cfe2-4872-9ac3-03f0096dc60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:22.193981 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ecdf2687-cfe2-4872-9ac3-03f0096dc60d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:22.195630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ecdf2687-cfe2-4872-9ac3-03f0096dc60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:22.238643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:22.312956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 709/1387] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:22.613392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507a1c5-20e9-4275-9598-869d0ec8abae None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:22.615036 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1507a1c5-20e9-4275-9598-869d0ec8abae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:22.702554 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:22.784633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507a1c5-20e9-4275-9598-869d0ec8abae None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:22.901562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305af753-5610-41ab-ab09-bb9dc1d2c08d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:22.902183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305af753-5610-41ab-ab09-bb9dc1d2c08d service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:22.902500 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305af753-5610-41ab-ab09-bb9dc1d2c08d service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:22.902777 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305af753-5610-41ab-ab09-bb9dc1d2c08d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:22.904385 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-305af753-5610-41ab-ab09-bb9dc1d2c08d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:22.945624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:23.018522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305af753-5610-41ab-ab09-bb9dc1d2c08d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:23.020926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305af753-5610-41ab-ab09-bb9dc1d2c08d service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:23.047417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 679/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:25.314110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45b7c3-47fd-4cc3-b0ab-21ba9cf35950 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:25.314869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45b7c3-47fd-4cc3-b0ab-21ba9cf35950 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:25.315758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45b7c3-47fd-4cc3-b0ab-21ba9cf35950 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:25.317843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 710/1389] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:25.323424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf03592-9eb8-4f61-8203-7a3e76c69e79 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:25.323896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf03592-9eb8-4f61-8203-7a3e76c69e79 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:25.323994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf03592-9eb8-4f61-8203-7a3e76c69e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:25.394795 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-baf03592-9eb8-4f61-8203-7a3e76c69e79 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:25.395955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-baf03592-9eb8-4f61-8203-7a3e76c69e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:25.498779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 680/1390] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:25.787600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45b7c3-47fd-4cc3-b0ab-21ba9cf35950 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:25.789381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ad45b7c3-47fd-4cc3-b0ab-21ba9cf35950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:25.937577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45b7c3-47fd-4cc3-b0ab-21ba9cf35950 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:25.953848 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:26.054683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2687cb-cc86-4756-a7f8-45b5def8c155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:26.055370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2687cb-cc86-4756-a7f8-45b5def8c155 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:26.055634 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2687cb-cc86-4756-a7f8-45b5def8c155 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:26.055911 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2687cb-cc86-4756-a7f8-45b5def8c155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:26.057602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-1f2687cb-cc86-4756-a7f8-45b5def8c155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:26.150639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2687cb-cc86-4756-a7f8-45b5def8c155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:26.152267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2687cb-cc86-4756-a7f8-45b5def8c155 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:26.170119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 711/1391] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:27.714290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27df3e-a612-4c91-810f-4da97754782c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:27.714759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27df3e-a612-4c91-810f-4da97754782c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:27.714867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27df3e-a612-4c91-810f-4da97754782c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:27.716605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 681/1392] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:27.722456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3e047-2e84-4679-be70-8b80e3d62c6f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:27.722854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3e047-2e84-4679-be70-8b80e3d62c6f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:27.723003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3e047-2e84-4679-be70-8b80e3d62c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:27.748713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:27.791300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-05a3e047-2e84-4679-be70-8b80e3d62c6f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:27.792513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-05a3e047-2e84-4679-be70-8b80e3d62c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:27.890598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 712/1393] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:21:28.214053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2cd4-eb83-4e45-880c-bef58e9c1ed0 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:28.214338 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2cd4-eb83-4e45-880c-bef58e9c1ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:28.214648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2cd4-eb83-4e45-880c-bef58e9c1ed0 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:28.215968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 682/1394] 10.222.0.33 () {54 vars in 966 bytes} [Mon Sep 12 23:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:28.221378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8e728-e236-4019-ba94-ff71e2946fbd None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:28.221663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8e728-e236-4019-ba94-ff71e2946fbd None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:28.221937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8e728-e236-4019-ba94-ff71e2946fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:28.306197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e0e8e728-e236-4019-ba94-ff71e2946fbd None None] MFA Rules not processed for user `46f96bbb14c04691ac403271de293224`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:28.307434 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e0e8e728-e236-4019-ba94-ff71e2946fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:28.350402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:28.358978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710c581-abc8-430e-81b1-ad778dfb0a3c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:28.359264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710c581-abc8-430e-81b1-ad778dfb0a3c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:28.359906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710c581-abc8-430e-81b1-ad778dfb0a3c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:28.361426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 683/1395] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:21:28.366665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e5b0-43c7-47b8-8df3-79fcaa0b79ec None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:28.366943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e5b0-43c7-47b8-8df3-79fcaa0b79ec None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:28.367213 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e5b0-43c7-47b8-8df3-79fcaa0b79ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:28.384546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:28.391758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 713/1396] 10.222.0.33 () {58 vars in 1063 bytes} [Mon Sep 12 23:21:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:28.401030 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8e728-e236-4019-ba94-ff71e2946fbd None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:28.409524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8e728-e236-4019-ba94-ff71e2946fbd None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:28.439114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-57e9e5b0-43c7-47b8-8df3-79fcaa0b79ec None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:28.440641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-57e9e5b0-43c7-47b8-8df3-79fcaa0b79ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:28.485950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ce91e-f092-4751-b941-2b1f22ce450e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f96bbb14c04691ac403271de293224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:28.487224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ce91e-f092-4751-b941-2b1f22ce450e service glance] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:28.487498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ce91e-f092-4751-b941-2b1f22ce450e service glance] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:28.487763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ce91e-f092-4751-b941-2b1f22ce450e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:28.489372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ee1ce91e-f092-4751-b941-2b1f22ce450e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:28.539584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 684/1397] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:28.598713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ce91e-f092-4751-b941-2b1f22ce450e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:28.600151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ce91e-f092-4751-b941-2b1f22ce450e service glance] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:28.605474 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:28.619886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 714/1398] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:21:28.830801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e5b0-43c7-47b8-8df3-79fcaa0b79ec None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:28.832077 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-57e9e5b0-43c7-47b8-8df3-79fcaa0b79ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:28.926181 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:28.953450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e5b0-43c7-47b8-8df3-79fcaa0b79ec None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:29.093931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86516b-0507-4787-bb7c-b90662e33557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:29.094525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86516b-0507-4787-bb7c-b90662e33557 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:29.094805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86516b-0507-4787-bb7c-b90662e33557 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:29.095074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86516b-0507-4787-bb7c-b90662e33557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:29.097277 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8b86516b-0507-4787-bb7c-b90662e33557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:29.188845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:29.191856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86516b-0507-4787-bb7c-b90662e33557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:29.194274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86516b-0507-4787-bb7c-b90662e33557 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:29.215893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 685/1399] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:29.385399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948e557-4106-4fe6-b8d5-7686504ca157 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:29.385786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948e557-4106-4fe6-b8d5-7686504ca157 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:29.386043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948e557-4106-4fe6-b8d5-7686504ca157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:29.462804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-2948e557-4106-4fe6-b8d5-7686504ca157 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:29.464037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2948e557-4106-4fe6-b8d5-7686504ca157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:29.553514 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 715/1400] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:21:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:29.596834 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413c30b-637c-477e-9e64-7a577b62e85f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:29.597221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413c30b-637c-477e-9e64-7a577b62e85f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:29.597523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413c30b-637c-477e-9e64-7a577b62e85f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:29.598967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 686/1401] 10.222.0.33 () {54 vars in 943 bytes} [Mon Sep 12 23:21:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:29.605537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a9855-261a-449a-9f03-bda0284a01bd None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:29.605852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a9855-261a-449a-9f03-bda0284a01bd None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:29.606151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a9855-261a-449a-9f03-bda0284a01bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:29.684100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-7c1a9855-261a-449a-9f03-bda0284a01bd None None] MFA Rules not processed for user `53214ffdc5d04c14b3b3ac868862480b`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:29.685222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7c1a9855-261a-449a-9f03-bda0284a01bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:29.709472 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:29.798135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 716/1402] 10.222.0.33 () {58 vars in 1040 bytes} [Mon Sep 12 23:21:29 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:21:29.808303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413c30b-637c-477e-9e64-7a577b62e85f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:29.810017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6413c30b-637c-477e-9e64-7a577b62e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:29.954557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413c30b-637c-477e-9e64-7a577b62e85f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:30.029529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:30.065130 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9ee1-c63b-496a-aae4-e893919f63c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:30.065747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9ee1-c63b-496a-aae4-e893919f63c0 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:30.066026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9ee1-c63b-496a-aae4-e893919f63c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:30.066298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9ee1-c63b-496a-aae4-e893919f63c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:30.067943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-79ba9ee1-c63b-496a-aae4-e893919f63c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:30.154348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba9ee1-c63b-496a-aae4-e893919f63c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:30.156003 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba9ee1-c63b-496a-aae4-e893919f63c0 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:30.165822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 687/1403] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:21:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:21:31.437117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a61c5-d5b5-48cc-9cb0-9fa8c801fcc4 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:31.437702 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a61c5-d5b5-48cc-9cb0-9fa8c801fcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:31.437702 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a61c5-d5b5-48cc-9cb0-9fa8c801fcc4 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:31.439022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 717/1404] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:31.444688 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811b40-2a78-4faa-ba4e-feb4de7b41b3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:31.445147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811b40-2a78-4faa-ba4e-feb4de7b41b3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:31.445245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811b40-2a78-4faa-ba4e-feb4de7b41b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:31.519094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-13811b40-2a78-4faa-ba4e-feb4de7b41b3 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:31.520607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-13811b40-2a78-4faa-ba4e-feb4de7b41b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:31.586558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:31.633707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 688/1405] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:31.930339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a61c5-d5b5-48cc-9cb0-9fa8c801fcc4 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:31.932174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5c9a61c5-d5b5-48cc-9cb0-9fa8c801fcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:32.165438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:32.170815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a61c5-d5b5-48cc-9cb0-9fa8c801fcc4 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:32.298326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313799b-1a0c-4389-a41d-7cf25b846161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:32.299299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313799b-1a0c-4389-a41d-7cf25b846161 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:32.299679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313799b-1a0c-4389-a41d-7cf25b846161 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:32.300052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313799b-1a0c-4389-a41d-7cf25b846161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:32.301728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2313799b-1a0c-4389-a41d-7cf25b846161 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:32.406615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313799b-1a0c-4389-a41d-7cf25b846161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:32.408799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313799b-1a0c-4389-a41d-7cf25b846161 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:32.425885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:32.431368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 718/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:34.799077 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5145-f8fa-4372-a15f-b94595b5b1aa None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:34.799692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5145-f8fa-4372-a15f-b94595b5b1aa None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:34.799692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5145-f8fa-4372-a15f-b94595b5b1aa None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:34.800980 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 689/1407] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:34.806558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d85551-ce8e-4831-9f44-58a4f77c91eb None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:34.807643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d85551-ce8e-4831-9f44-58a4f77c91eb None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:34.808143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d85551-ce8e-4831-9f44-58a4f77c91eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:34.884069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-96d85551-ce8e-4831-9f44-58a4f77c91eb None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:34.885369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-96d85551-ce8e-4831-9f44-58a4f77c91eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:34.994321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 719/1408] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:35.289401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5145-f8fa-4372-a15f-b94595b5b1aa None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:35.290942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-532b5145-f8fa-4372-a15f-b94595b5b1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:35.469386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5145-f8fa-4372-a15f-b94595b5b1aa None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:35.520686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:35.600971 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e4035-cfe9-4ec0-9ad8-5f9b0b02d4e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:35.601499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e4035-cfe9-4ec0-9ad8-5f9b0b02d4e2 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:35.601811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e4035-cfe9-4ec0-9ad8-5f9b0b02d4e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:35.602085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e4035-cfe9-4ec0-9ad8-5f9b0b02d4e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:35.603994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dd4e4035-cfe9-4ec0-9ad8-5f9b0b02d4e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:35.705537 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e4035-cfe9-4ec0-9ad8-5f9b0b02d4e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:35.707230 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e4035-cfe9-4ec0-9ad8-5f9b0b02d4e2 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:35.727542 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 690/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:44.992762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=65 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:45.724836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=78 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:53.136767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c516af1-f69d-4ed3-820e-0e0f19928990 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:53.137345 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c516af1-f69d-4ed3-820e-0e0f19928990 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:53.137664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c516af1-f69d-4ed3-820e-0e0f19928990 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:53.139079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 720/1410] 10.222.0.33 () {54 vars in 918 bytes} [Mon Sep 12 23:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:53.144375 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27747179-25c1-4464-aec0-a699ae428aba None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:53.144831 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27747179-25c1-4464-aec0-a699ae428aba None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:53.145007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27747179-25c1-4464-aec0-a699ae428aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:53.219805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-27747179-25c1-4464-aec0-a699ae428aba None None] MFA Rules not processed for user `559a4af215324597b203e6866cb51fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:53.221001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-27747179-25c1-4464-aec0-a699ae428aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:53.326340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 691/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Mon Sep 12 23:21:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:53.340342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745a3a3-0ca5-434a-ac64-5db46916e82d None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:53.340626 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745a3a3-0ca5-434a-ac64-5db46916e82d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:53.340897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745a3a3-0ca5-434a-ac64-5db46916e82d None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:53.342206 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 721/1412] 10.222.0.33 () {54 vars in 918 bytes} [Mon Sep 12 23:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:53.346737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cb1ef-f259-4cd7-85c4-b5a16aa07c3c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:53.347019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cb1ef-f259-4cd7-85c4-b5a16aa07c3c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:53.347291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cb1ef-f259-4cd7-85c4-b5a16aa07c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:53.422986 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:53.426942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-970cb1ef-f259-4cd7-85c4-b5a16aa07c3c None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:53.428688 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-970cb1ef-f259-4cd7-85c4-b5a16aa07c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:53.543931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 692/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Mon Sep 12 23:21:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:56.102744 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c528cb-75ae-49f8-833a-902943ce9b48 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:56.103322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c528cb-75ae-49f8-833a-902943ce9b48 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:56.103322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c528cb-75ae-49f8-833a-902943ce9b48 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:56.104584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 722/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:56.109718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4e1c4-d1ba-461f-9a5a-1c1adbaf123b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:56.110114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4e1c4-d1ba-461f-9a5a-1c1adbaf123b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:56.110268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4e1c4-d1ba-461f-9a5a-1c1adbaf123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:56.177726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d6a4e1c4-d1ba-461f-9a5a-1c1adbaf123b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:56.178989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d6a4e1c4-d1ba-461f-9a5a-1c1adbaf123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:56.234701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:56.277110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 693/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:56.568641 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c528cb-75ae-49f8-833a-902943ce9b48 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:56.570174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-44c528cb-75ae-49f8-833a-902943ce9b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:56.714974 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c528cb-75ae-49f8-833a-902943ce9b48 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:56.787112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:56.826285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bbf48-88f9-4d94-919b-68c546aa01ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:56.826912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bbf48-88f9-4d94-919b-68c546aa01ec service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:56.827185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bbf48-88f9-4d94-919b-68c546aa01ec service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:56.827449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bbf48-88f9-4d94-919b-68c546aa01ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:56.828999 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6d5bbf48-88f9-4d94-919b-68c546aa01ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:56.919158 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bbf48-88f9-4d94-919b-68c546aa01ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:56.920800 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bbf48-88f9-4d94-919b-68c546aa01ec service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:56.938561 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 723/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:58.075834 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb3f37-4a1b-43b9-ab37-a8ced44b70c1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:58.076368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb3f37-4a1b-43b9-ab37-a8ced44b70c1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:58.076368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb3f37-4a1b-43b9-ab37-a8ced44b70c1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:58.077631 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 694/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:58.084398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8a070-3c42-4276-be6e-6e2592a5d23d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:58.084836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8a070-3c42-4276-be6e-6e2592a5d23d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:58.084949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8a070-3c42-4276-be6e-6e2592a5d23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:58.160566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-d6c8a070-3c42-4276-be6e-6e2592a5d23d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:21:58.161762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d6c8a070-3c42-4276-be6e-6e2592a5d23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:58.189099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:58.260666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 724/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:21:58.413598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb3f37-4a1b-43b9-ab37-a8ced44b70c1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:21:58.415424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-eceb3f37-4a1b-43b9-ab37-a8ced44b70c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:58.561060 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb3f37-4a1b-43b9-ab37-a8ced44b70c1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:21:58.602026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:58.676311 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97048c-139a-4e2e-8e49-2b12c44d77df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:21:58.676870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97048c-139a-4e2e-8e49-2b12c44d77df service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:58.677149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97048c-139a-4e2e-8e49-2b12c44d77df service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:58.677418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97048c-139a-4e2e-8e49-2b12c44d77df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:58.679042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9f97048c-139a-4e2e-8e49-2b12c44d77df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:21:58.767895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97048c-139a-4e2e-8e49-2b12c44d77df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:21:58.769514 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97048c-139a-4e2e-8e49-2b12c44d77df service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:21:58.787163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 695/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:59.919302 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333100d-68c2-4458-8a89-27dc41d65628 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:59.919874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333100d-68c2-4458-8a89-27dc41d65628 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:59.919874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333100d-68c2-4458-8a89-27dc41d65628 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:59.921209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 725/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:21:59.927579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2b2a1-80c4-41be-8f9f-79e6f7f13902 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:21:59.928002 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2b2a1-80c4-41be-8f9f-79e6f7f13902 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:21:59.928119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2b2a1-80c4-41be-8f9f-79e6f7f13902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:21:59.984739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:00.007001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7df2b2a1-80c4-41be-8f9f-79e6f7f13902 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:00.008220 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7df2b2a1-80c4-41be-8f9f-79e6f7f13902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:00.104782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 696/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:00.258065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333100d-68c2-4458-8a89-27dc41d65628 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:00.259533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4333100d-68c2-4458-8a89-27dc41d65628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:00.404797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333100d-68c2-4458-8a89-27dc41d65628 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:00.417416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:00.522028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720a09e-0653-43db-8445-3526b4eac55e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:00.522601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720a09e-0653-43db-8445-3526b4eac55e service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:00.522883 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720a09e-0653-43db-8445-3526b4eac55e service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:00.523151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720a09e-0653-43db-8445-3526b4eac55e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:00.524726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c720a09e-0653-43db-8445-3526b4eac55e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:00.617477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720a09e-0653-43db-8445-3526b4eac55e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:00.619112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720a09e-0653-43db-8445-3526b4eac55e service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:00.637399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 726/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:01.750794 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835e555-a0dd-414f-bf30-e37c8d4e6026 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:01.751749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835e555-a0dd-414f-bf30-e37c8d4e6026 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:01.751860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835e555-a0dd-414f-bf30-e37c8d4e6026 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:01.753312 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 697/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:22:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:01.759659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34007444-5178-4d49-b2a3-c2d067f58241 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:01.760114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34007444-5178-4d49-b2a3-c2d067f58241 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:01.760240 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34007444-5178-4d49-b2a3-c2d067f58241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:01.780304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:01.838602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-34007444-5178-4d49-b2a3-c2d067f58241 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:01.839820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-34007444-5178-4d49-b2a3-c2d067f58241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:01.935502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 727/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:02.087154 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835e555-a0dd-414f-bf30-e37c8d4e6026 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:02.088673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f835e555-a0dd-414f-bf30-e37c8d4e6026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:02.202848 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:02.239768 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835e555-a0dd-414f-bf30-e37c8d4e6026 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:02.353918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd04543-8914-40bb-b7ff-fe004aec22be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:02.354486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd04543-8914-40bb-b7ff-fe004aec22be service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:02.354764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd04543-8914-40bb-b7ff-fe004aec22be service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:02.355034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd04543-8914-40bb-b7ff-fe004aec22be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:02.356624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3cd04543-8914-40bb-b7ff-fe004aec22be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:02.434401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:02.448748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd04543-8914-40bb-b7ff-fe004aec22be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:02.450355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd04543-8914-40bb-b7ff-fe004aec22be service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:02.469129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 698/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:03.581286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14efe2-61d7-41c0-8924-10d743086201 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:03.581887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14efe2-61d7-41c0-8924-10d743086201 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:03.581887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14efe2-61d7-41c0-8924-10d743086201 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:03.583216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 728/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:22:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:03.589589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39465e70-3193-4747-a75c-392fc19103b8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:03.590073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39465e70-3193-4747-a75c-392fc19103b8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:03.590179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39465e70-3193-4747-a75c-392fc19103b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:03.665291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-39465e70-3193-4747-a75c-392fc19103b8 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:03.666429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-39465e70-3193-4747-a75c-392fc19103b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:03.764450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 699/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:03.917540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14efe2-61d7-41c0-8924-10d743086201 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:03.918984 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ab14efe2-61d7-41c0-8924-10d743086201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:04.005659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:04.068543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14efe2-61d7-41c0-8924-10d743086201 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:04.183075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf949277-55f9-4916-a25c-54db778c97f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:04.183596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949277-55f9-4916-a25c-54db778c97f6 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:04.183872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949277-55f9-4916-a25c-54db778c97f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:04.184140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949277-55f9-4916-a25c-54db778c97f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:04.185710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bf949277-55f9-4916-a25c-54db778c97f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:04.234963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:04.277236 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf949277-55f9-4916-a25c-54db778c97f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:04.278878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf949277-55f9-4916-a25c-54db778c97f6 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:04.298548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 729/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:05.374899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271dce9-0e5a-42b6-ba43-e891bd2316f9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:05.375473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271dce9-0e5a-42b6-ba43-e891bd2316f9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:05.375473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271dce9-0e5a-42b6-ba43-e891bd2316f9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:05.377339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 700/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:05.384183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bfd50-fa9e-4c51-98f9-5963307e5ba7 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:05.384183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bfd50-fa9e-4c51-98f9-5963307e5ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:05.384646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bfd50-fa9e-4c51-98f9-5963307e5ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:05.462398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f64bfd50-fa9e-4c51-98f9-5963307e5ba7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:05.463637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f64bfd50-fa9e-4c51-98f9-5963307e5ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:05.558896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 730/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:05.712449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271dce9-0e5a-42b6-ba43-e891bd2316f9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:05.713865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c271dce9-0e5a-42b6-ba43-e891bd2316f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:05.762666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:05.860061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271dce9-0e5a-42b6-ba43-e891bd2316f9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:05.973958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27b13a-1be9-44ee-9814-c30dc89d8a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:05.974589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27b13a-1be9-44ee-9814-c30dc89d8a3d service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:05.974872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27b13a-1be9-44ee-9814-c30dc89d8a3d service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:05.975146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27b13a-1be9-44ee-9814-c30dc89d8a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:05.976731 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5d27b13a-1be9-44ee-9814-c30dc89d8a3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:05.983628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:06.067314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27b13a-1be9-44ee-9814-c30dc89d8a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:06.068917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27b13a-1be9-44ee-9814-c30dc89d8a3d service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:06.087801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 701/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:07.142533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ed348-9b1a-4843-ad18-9465fa312145 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:07.143105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ed348-9b1a-4843-ad18-9465fa312145 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:07.143105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ed348-9b1a-4843-ad18-9465fa312145 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:07.144418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 731/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:07.150745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2010f-26d8-43c7-a342-e0417ec8bc83 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:07.151193 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2010f-26d8-43c7-a342-e0417ec8bc83 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:07.151306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2010f-26d8-43c7-a342-e0417ec8bc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:07.226871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f2a2010f-26d8-43c7-a342-e0417ec8bc83 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:07.228076 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f2a2010f-26d8-43c7-a342-e0417ec8bc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:07.296092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:07.324717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 702/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:07.477212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ed348-9b1a-4843-ad18-9465fa312145 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:07.478744 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-391ed348-9b1a-4843-ad18-9465fa312145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:07.496228 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:07.623793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ed348-9b1a-4843-ad18-9465fa312145 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:07.711261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:07.738729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7a550-17b6-4828-8e4e-2dae80d18b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:07.739290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7a550-17b6-4828-8e4e-2dae80d18b82 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:07.739551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7a550-17b6-4828-8e4e-2dae80d18b82 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:07.739816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7a550-17b6-4828-8e4e-2dae80d18b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:07.741388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9ab7a550-17b6-4828-8e4e-2dae80d18b82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:07.830461 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7a550-17b6-4828-8e4e-2dae80d18b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:07.832131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7a550-17b6-4828-8e4e-2dae80d18b82 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:07.850813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 732/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:08.905305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211ca8b-cdb9-47d8-a512-fad318b6db85 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:08.905884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211ca8b-cdb9-47d8-a512-fad318b6db85 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:08.905884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211ca8b-cdb9-47d8-a512-fad318b6db85 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:08.907421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 703/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:08.913436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394200ca-5be6-4a38-83dc-daf77c0943b7 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:08.913899 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394200ca-5be6-4a38-83dc-daf77c0943b7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:08.914037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394200ca-5be6-4a38-83dc-daf77c0943b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:08.992833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-394200ca-5be6-4a38-83dc-daf77c0943b7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:08.994053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-394200ca-5be6-4a38-83dc-daf77c0943b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:09.035202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:09.091553 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 733/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:09.244467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211ca8b-cdb9-47d8-a512-fad318b6db85 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:09.245994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0211ca8b-cdb9-47d8-a512-fad318b6db85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:09.396213 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211ca8b-cdb9-47d8-a512-fad318b6db85 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:09.451069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:09.509846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd708709-2965-46db-8192-7e5432531bd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:09.510412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd708709-2965-46db-8192-7e5432531bd9 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:09.510690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd708709-2965-46db-8192-7e5432531bd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:09.510967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd708709-2965-46db-8192-7e5432531bd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:09.512591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dd708709-2965-46db-8192-7e5432531bd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:09.602152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd708709-2965-46db-8192-7e5432531bd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:09.603801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd708709-2965-46db-8192-7e5432531bd9 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:09.624494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 704/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:10.680829 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771456fc-d765-4052-b4ad-72f8487ba554 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:10.681366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771456fc-d765-4052-b4ad-72f8487ba554 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:10.681366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771456fc-d765-4052-b4ad-72f8487ba554 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:10.682641 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 734/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:10.689486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6cc02-8d3f-4c3c-8055-70188c953190 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:10.689923 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6cc02-8d3f-4c3c-8055-70188c953190 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:10.690065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6cc02-8d3f-4c3c-8055-70188c953190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:10.764601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a7d6cc02-8d3f-4c3c-8055-70188c953190 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:10.765793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a7d6cc02-8d3f-4c3c-8055-70188c953190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:10.768491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:10.864506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 705/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:11.011794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771456fc-d765-4052-b4ad-72f8487ba554 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:11.013286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-771456fc-d765-4052-b4ad-72f8487ba554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:11.159711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771456fc-d765-4052-b4ad-72f8487ba554 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:11.187350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:11.275045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e04047-0e27-40a4-a3db-8ecb7afc4fcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:11.275565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e04047-0e27-40a4-a3db-8ecb7afc4fcb service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:11.275836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e04047-0e27-40a4-a3db-8ecb7afc4fcb service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:11.276101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e04047-0e27-40a4-a3db-8ecb7afc4fcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:11.277675 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-61e04047-0e27-40a4-a3db-8ecb7afc4fcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:11.365708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e04047-0e27-40a4-a3db-8ecb7afc4fcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:11.367333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e04047-0e27-40a4-a3db-8ecb7afc4fcb service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:11.386901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 735/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:13.465411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208b66-063f-4415-9407-dfa227f676de None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:13.465928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208b66-063f-4415-9407-dfa227f676de None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:13.466018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208b66-063f-4415-9407-dfa227f676de None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:13.467372 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 706/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:13.472807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999be161-f516-4a4e-a1b0-8f8f9e33a66d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:13.473232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999be161-f516-4a4e-a1b0-8f8f9e33a66d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:13.473349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999be161-f516-4a4e-a1b0-8f8f9e33a66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:13.515741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:13.541578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-999be161-f516-4a4e-a1b0-8f8f9e33a66d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:13.542819 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-999be161-f516-4a4e-a1b0-8f8f9e33a66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:13.639263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 736/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:13.932458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9208b66-063f-4415-9407-dfa227f676de None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:13.933977 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e9208b66-063f-4415-9407-dfa227f676de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:14.044408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9208b66-063f-4415-9407-dfa227f676de None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:14.079310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:14.124343 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f15db-e7d2-4ca6-bc5c-0bbe0327f687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:14.124957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f15db-e7d2-4ca6-bc5c-0bbe0327f687 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:14.125238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f15db-e7d2-4ca6-bc5c-0bbe0327f687 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:14.125509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f15db-e7d2-4ca6-bc5c-0bbe0327f687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:14.127800 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5a7f15db-e7d2-4ca6-bc5c-0bbe0327f687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:14.236849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f15db-e7d2-4ca6-bc5c-0bbe0327f687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:14.238286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f15db-e7d2-4ca6-bc5c-0bbe0327f687 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:14.256305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 707/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:16.577605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaa7e4-27ca-4c4c-a30d-a812f703bdf9 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:16.578186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaa7e4-27ca-4c4c-a30d-a812f703bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:16.578186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaa7e4-27ca-4c4c-a30d-a812f703bdf9 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:16.580357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 737/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:16.585504 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490b606-7e7b-480a-b46b-ba3a314e6378 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:16.585941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490b606-7e7b-480a-b46b-ba3a314e6378 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:16.586090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490b606-7e7b-480a-b46b-ba3a314e6378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:16.652946 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f490b606-7e7b-480a-b46b-ba3a314e6378 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:16.654062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f490b606-7e7b-480a-b46b-ba3a314e6378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:16.667463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:16.750667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 708/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:17.038288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaa7e4-27ca-4c4c-a30d-a812f703bdf9 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:17.040094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-baeaa7e4-27ca-4c4c-a30d-a812f703bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:17.142644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaa7e4-27ca-4c4c-a30d-a812f703bdf9 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:17.155292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:17.215952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3892add-d188-419f-a1a6-66169a6e8009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:17.216551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3892add-d188-419f-a1a6-66169a6e8009 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:17.216825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3892add-d188-419f-a1a6-66169a6e8009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:17.217094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3892add-d188-419f-a1a6-66169a6e8009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:17.218687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c3892add-d188-419f-a1a6-66169a6e8009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:17.327075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3892add-d188-419f-a1a6-66169a6e8009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:17.328428 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3892add-d188-419f-a1a6-66169a6e8009 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:17.346051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 738/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:19.809364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9089c-6823-4c93-af60-f9174c732cea None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:19.809907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9089c-6823-4c93-af60-f9174c732cea None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:19.809907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9089c-6823-4c93-af60-f9174c732cea None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:19.811299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 709/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:19.817920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19c3d8-4189-4870-8e3e-dabacc6ea434 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:19.818330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19c3d8-4189-4870-8e3e-dabacc6ea434 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:19.818498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19c3d8-4189-4870-8e3e-dabacc6ea434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:19.868066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:19.886339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-da19c3d8-4189-4870-8e3e-dabacc6ea434 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:19.887574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-da19c3d8-4189-4870-8e3e-dabacc6ea434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:20.101726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 739/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:20.385132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9089c-6823-4c93-af60-f9174c732cea None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:20.386671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8cd9089c-6823-4c93-af60-f9174c732cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:20.490836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9089c-6823-4c93-af60-f9174c732cea None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:20.531306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:20.566666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3fc37-ffba-4906-b0b3-99bf462479f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:20.567278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3fc37-ffba-4906-b0b3-99bf462479f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:20.567556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3fc37-ffba-4906-b0b3-99bf462479f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:20.567830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3fc37-ffba-4906-b0b3-99bf462479f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:20.569440 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1cb3fc37-ffba-4906-b0b3-99bf462479f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:20.683430 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3fc37-ffba-4906-b0b3-99bf462479f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:20.684793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3fc37-ffba-4906-b0b3-99bf462479f6 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:20.702368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 710/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:22.962642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb20b2-9415-493e-8205-57c01d177a7f None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:22.963183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb20b2-9415-493e-8205-57c01d177a7f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:22.963183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb20b2-9415-493e-8205-57c01d177a7f None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:22.964524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 740/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:22.970516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77299e08-2802-4c23-8480-264751290d26 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:22.970931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77299e08-2802-4c23-8480-264751290d26 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:22.971075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77299e08-2802-4c23-8480-264751290d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:23.037516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-77299e08-2802-4c23-8480-264751290d26 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:23.038876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-77299e08-2802-4c23-8480-264751290d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:23.059945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:23.136471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 711/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:23.424816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb20b2-9415-493e-8205-57c01d177a7f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:23.426320 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a9fb20b2-9415-493e-8205-57c01d177a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:23.528509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb20b2-9415-493e-8205-57c01d177a7f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:23.548725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:23.601697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f72c6-e6db-49b3-ad8b-4060c6ebf299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:23.602291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f72c6-e6db-49b3-ad8b-4060c6ebf299 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:23.602592 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f72c6-e6db-49b3-ad8b-4060c6ebf299 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:23.602860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f72c6-e6db-49b3-ad8b-4060c6ebf299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:23.604412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8f8f72c6-e6db-49b3-ad8b-4060c6ebf299 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:23.712155 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f72c6-e6db-49b3-ad8b-4060c6ebf299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:23.713517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f72c6-e6db-49b3-ad8b-4060c6ebf299 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:23.732000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 741/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:26.039145 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15df06-8a1f-4bf8-bf2d-cd48d46dc057 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:26.039673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15df06-8a1f-4bf8-bf2d-cd48d46dc057 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:26.039673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15df06-8a1f-4bf8-bf2d-cd48d46dc057 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:26.041211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 712/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:26.046525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcdaac-393c-4ed0-bbe3-345e34fba410 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:26.046950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcdaac-393c-4ed0-bbe3-345e34fba410 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:26.047073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcdaac-393c-4ed0-bbe3-345e34fba410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:26.115402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:26.118431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-6bfcdaac-393c-4ed0-bbe3-345e34fba410 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:26.120127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6bfcdaac-393c-4ed0-bbe3-345e34fba410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:26.216333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 742/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:22:26.502521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15df06-8a1f-4bf8-bf2d-cd48d46dc057 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:26.504044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3d15df06-8a1f-4bf8-bf2d-cd48d46dc057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:26.605539 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15df06-8a1f-4bf8-bf2d-cd48d46dc057 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:26.656442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:26.680991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66083079-e42f-4a95-8b5b-ae3ddc4cd19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:26.681598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66083079-e42f-4a95-8b5b-ae3ddc4cd19c service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:26.681879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66083079-e42f-4a95-8b5b-ae3ddc4cd19c service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:26.682153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66083079-e42f-4a95-8b5b-ae3ddc4cd19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:26.683810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-66083079-e42f-4a95-8b5b-ae3ddc4cd19c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:26.793245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66083079-e42f-4a95-8b5b-ae3ddc4cd19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:26.794727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66083079-e42f-4a95-8b5b-ae3ddc4cd19c service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:26.813649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 713/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:29.023894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc5adf-70a0-4f3d-b4d3-769fe06a9697 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:29.024424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc5adf-70a0-4f3d-b4d3-769fe06a9697 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:29.024424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc5adf-70a0-4f3d-b4d3-769fe06a9697 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:29.025775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 743/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:29.031247 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94374cfb-d1c8-4930-a0dd-c4079ba52883 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:29.031696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94374cfb-d1c8-4930-a0dd-c4079ba52883 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:29.031847 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94374cfb-d1c8-4930-a0dd-c4079ba52883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:29.098481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-94374cfb-d1c8-4930-a0dd-c4079ba52883 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:29.099706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-94374cfb-d1c8-4930-a0dd-c4079ba52883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:29.129608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:29.197425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 714/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:29.482300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc5adf-70a0-4f3d-b4d3-769fe06a9697 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:29.483902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-86dc5adf-70a0-4f3d-b4d3-769fe06a9697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:29.586919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc5adf-70a0-4f3d-b4d3-769fe06a9697 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:29.615822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:29.661241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916395f-f38d-444e-abdc-447b0ab5b187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:29.661774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916395f-f38d-444e-abdc-447b0ab5b187 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:29.662055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916395f-f38d-444e-abdc-447b0ab5b187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:29.662324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916395f-f38d-444e-abdc-447b0ab5b187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:29.663933 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-1916395f-f38d-444e-abdc-447b0ab5b187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:29.773397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916395f-f38d-444e-abdc-447b0ab5b187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:29.774864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916395f-f38d-444e-abdc-447b0ab5b187 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:29.793538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 744/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:32.009031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8feb6-4b92-4b26-bd6c-84caa5f7dfc3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:32.009463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8feb6-4b92-4b26-bd6c-84caa5f7dfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:32.009561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8feb6-4b92-4b26-bd6c-84caa5f7dfc3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:32.010953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 715/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:32.017331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895fb8b-cfbd-4474-9a96-2638c04b0964 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:32.017748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895fb8b-cfbd-4474-9a96-2638c04b0964 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:32.018044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895fb8b-cfbd-4474-9a96-2638c04b0964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:32.086214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f895fb8b-cfbd-4474-9a96-2638c04b0964 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:32.087468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f895fb8b-cfbd-4474-9a96-2638c04b0964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:32.095651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:32.187698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 745/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:32.481961 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8feb6-4b92-4b26-bd6c-84caa5f7dfc3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:32.483583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8bd8feb6-4b92-4b26-bd6c-84caa5f7dfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:32.587007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8feb6-4b92-4b26-bd6c-84caa5f7dfc3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:32.642576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:32.660880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cae626-455d-451f-9a7f-0b7e985f728e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:32.661481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cae626-455d-451f-9a7f-0b7e985f728e service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:32.661756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cae626-455d-451f-9a7f-0b7e985f728e service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:32.662019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cae626-455d-451f-9a7f-0b7e985f728e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:32.663615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-98cae626-455d-451f-9a7f-0b7e985f728e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:32.774087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cae626-455d-451f-9a7f-0b7e985f728e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:32.775565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cae626-455d-451f-9a7f-0b7e985f728e service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:32.793494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 716/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:35.083503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803e7ec-cfe5-46c9-a546-2fece6733c59 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:35.084301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803e7ec-cfe5-46c9-a546-2fece6733c59 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:35.084301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803e7ec-cfe5-46c9-a546-2fece6733c59 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:35.085373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 746/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:22:35.090870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a0045-bfa4-4221-969e-e2c46f0dc310 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:35.091333 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a0045-bfa4-4221-969e-e2c46f0dc310 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:35.091444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a0045-bfa4-4221-969e-e2c46f0dc310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:35.157562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ba0a0045-bfa4-4221-969e-e2c46f0dc310 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:35.158800 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ba0a0045-bfa4-4221-969e-e2c46f0dc310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:35.197662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:35.256154 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 717/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:35.544596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803e7ec-cfe5-46c9-a546-2fece6733c59 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:35.546138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8803e7ec-cfe5-46c9-a546-2fece6733c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:35.649329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803e7ec-cfe5-46c9-a546-2fece6733c59 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:35.687660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:35.723221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f55fe-a44a-4612-9f8e-5ce8cda49ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:35.723823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f55fe-a44a-4612-9f8e-5ce8cda49ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:35.724098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f55fe-a44a-4612-9f8e-5ce8cda49ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:35.724368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f55fe-a44a-4612-9f8e-5ce8cda49ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:35.725936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d66f55fe-a44a-4612-9f8e-5ce8cda49ae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:35.834788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f55fe-a44a-4612-9f8e-5ce8cda49ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:35.836214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f55fe-a44a-4612-9f8e-5ce8cda49ae6 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:35.854315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 747/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:38.009812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9beb-311f-4d45-90bc-cf344f957858 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:38.010345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9beb-311f-4d45-90bc-cf344f957858 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:38.010345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9beb-311f-4d45-90bc-cf344f957858 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:38.011661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 718/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:38.017869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff9c3-845d-4487-8270-e295a12db76a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:38.018321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff9c3-845d-4487-8270-e295a12db76a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:38.018458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff9c3-845d-4487-8270-e295a12db76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:38.084950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-1eeff9c3-845d-4487-8270-e295a12db76a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:38.086158 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-1eeff9c3-845d-4487-8270-e295a12db76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:38.104521 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:38.185009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 748/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:38.467327 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b9beb-311f-4d45-90bc-cf344f957858 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:38.469658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b77b9beb-311f-4d45-90bc-cf344f957858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:38.576242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b9beb-311f-4d45-90bc-cf344f957858 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:38.642612 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:38.649469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca616853-e75b-445c-b58a-ebf305062142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:38.650072 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca616853-e75b-445c-b58a-ebf305062142 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:38.650352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca616853-e75b-445c-b58a-ebf305062142 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:38.650658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca616853-e75b-445c-b58a-ebf305062142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:38.652229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ca616853-e75b-445c-b58a-ebf305062142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:38.760717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca616853-e75b-445c-b58a-ebf305062142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:38.762204 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca616853-e75b-445c-b58a-ebf305062142 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:38.780761 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 719/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:40.926692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5b647-7ca5-4e98-9a54-3a678008abdc None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:40.927264 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5b647-7ca5-4e98-9a54-3a678008abdc None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:40.927264 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5b647-7ca5-4e98-9a54-3a678008abdc None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:40.928598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 749/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:22:40.933786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781de16-e30d-49df-bb09-39495be84e7d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:40.934208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781de16-e30d-49df-bb09-39495be84e7d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:40.934371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781de16-e30d-49df-bb09-39495be84e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:41.000947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a781de16-e30d-49df-bb09-39495be84e7d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:22:41.002304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a781de16-e30d-49df-bb09-39495be84e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:41.050140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:41.098275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 720/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:22:41.382222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5b647-7ca5-4e98-9a54-3a678008abdc None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:22:41.384153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-50f5b647-7ca5-4e98-9a54-3a678008abdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:41.487441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5b647-7ca5-4e98-9a54-3a678008abdc None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:22:41.534505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:41.559768 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb90cf-6238-4eec-a1f1-51b892243e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:22:41.560482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb90cf-6238-4eec-a1f1-51b892243e60 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:22:41.560767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb90cf-6238-4eec-a1f1-51b892243e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:22:41.561037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb90cf-6238-4eec-a1f1-51b892243e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:22:41.563141 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-debb90cf-6238-4eec-a1f1-51b892243e60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:22:41.673447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb90cf-6238-4eec-a1f1-51b892243e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:22:41.674836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb90cf-6238-4eec-a1f1-51b892243e60 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:22:41.692874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 750/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:22:51.096789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=22 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:22:51.690708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=66 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:01.633238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8890e6-d6c2-44f8-b0c4-7ded9e17e6d8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:01.633879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8890e6-d6c2-44f8-b0c4-7ded9e17e6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:01.633879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8890e6-d6c2-44f8-b0c4-7ded9e17e6d8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:01.635144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 721/1471] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:23:01.640804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204c482-5fec-4be0-99e9-daf1cd7e9cc7 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:01.641208 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204c482-5fec-4be0-99e9-daf1cd7e9cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:01.641350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204c482-5fec-4be0-99e9-daf1cd7e9cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:01.708263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c204c482-5fec-4be0-99e9-daf1cd7e9cc7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:23:01.709475 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c204c482-5fec-4be0-99e9-daf1cd7e9cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:01.805157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 751/1472] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:23:02.109870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58861524-2f00-4cbe-82a8-03a6f43c485f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:02.110611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58861524-2f00-4cbe-82a8-03a6f43c485f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:02.110900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58861524-2f00-4cbe-82a8-03a6f43c485f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:02.113501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 722/1473] 10.222.0.33 () {54 vars in 966 bytes} [Mon Sep 12 23:23:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:23:02.118807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa051d3-7c12-46c1-8b45-27d3053683c4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:02.119092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa051d3-7c12-46c1-8b45-27d3053683c4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:02.119365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa051d3-7c12-46c1-8b45-27d3053683c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:02.196776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-2fa051d3-7c12-46c1-8b45-27d3053683c4 None None] MFA Rules not processed for user `46f96bbb14c04691ac403271de293224`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:23:02.197979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2fa051d3-7c12-46c1-8b45-27d3053683c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:02.219822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:02.275612 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 752/1474] 10.222.0.33 () {58 vars in 1063 bytes} [Mon Sep 12 23:23:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:23:02.283231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58861524-2f00-4cbe-82a8-03a6f43c485f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:23:02.284890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-58861524-2f00-4cbe-82a8-03a6f43c485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:02.389463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58861524-2f00-4cbe-82a8-03a6f43c485f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:23:02.463699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d4dda-61ab-4326-975d-c61b98300754 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f96bbb14c04691ac403271de293224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:23:02.464305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4dda-61ab-4326-975d-c61b98300754 service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:02.464583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4dda-61ab-4326-975d-c61b98300754 service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:02.464850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4dda-61ab-4326-975d-c61b98300754 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:02.466444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f36d4dda-61ab-4326-975d-c61b98300754 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:02.520540 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:02.577425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d4dda-61ab-4326-975d-c61b98300754 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:23:02.579047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d4dda-61ab-4326-975d-c61b98300754 service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:23:02.597601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 723/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:23:04.851575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f683-d393-4609-bab0-5627c18d1c7d None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:04.852204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f683-d393-4609-bab0-5627c18d1c7d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:04.852204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f683-d393-4609-bab0-5627c18d1c7d None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:04.853606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 753/1476] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:23:04.858901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e0ed7-97ff-4001-949c-bf7da717389b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:04.859982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e0ed7-97ff-4001-949c-bf7da717389b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:04.860311 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e0ed7-97ff-4001-949c-bf7da717389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:04.927557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-615e0ed7-97ff-4001-949c-bf7da717389b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:23:04.928747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-615e0ed7-97ff-4001-949c-bf7da717389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:05.024220 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 724/1477] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:23:05.304712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f683-d393-4609-bab0-5627c18d1c7d None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:23:05.306220 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-1d82f683-d393-4609-bab0-5627c18d1c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:05.431979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f683-d393-4609-bab0-5627c18d1c7d None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:23:05.480529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:05.524933 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d571e2d-bc3a-4bb9-9aea-ed8698a4d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:23:05.525533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d571e2d-bc3a-4bb9-9aea-ed8698a4d37b admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:05.525804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d571e2d-bc3a-4bb9-9aea-ed8698a4d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:05.526068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d571e2d-bc3a-4bb9-9aea-ed8698a4d37b admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:05.526724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d571e2d-bc3a-4bb9-9aea-ed8698a4d37b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:23:05.528436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: WARNING py.warnings [None req-7d571e2d-bc3a-4bb9-9aea-ed8698a4d37b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:23:05.528436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: warnings.warn(msg) Sep 12 23:23:05.528436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: Sep 12 23:23:05.529555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d571e2d-bc3a-4bb9-9aea-ed8698a4d37b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:23:05.549944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 754/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Mon Sep 12 23:23:05 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:23:07.708754 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefc5b6-0b9a-4cd3-8e51-12c8298c583b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:07.709285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefc5b6-0b9a-4cd3-8e51-12c8298c583b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:07.709285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefc5b6-0b9a-4cd3-8e51-12c8298c583b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:07.710635 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 725/1479] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:23:07.716000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8580-2026-4be6-bebc-7065010dbf90 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:07.716442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8580-2026-4be6-bebc-7065010dbf90 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:07.716567 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8580-2026-4be6-bebc-7065010dbf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:07.783527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-2eef8580-2026-4be6-bebc-7065010dbf90 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:23:07.784725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2eef8580-2026-4be6-bebc-7065010dbf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:07.883859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 755/1480] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:23:08.179079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefc5b6-0b9a-4cd3-8e51-12c8298c583b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:23:08.180644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ddefc5b6-0b9a-4cd3-8e51-12c8298c583b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:08.191173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:08.326021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefc5b6-0b9a-4cd3-8e51-12c8298c583b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:23:08.408541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:08.441713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267d413-9a95-4277-998e-cc81720192ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:23:08.442253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d413-9a95-4277-998e-cc81720192ff service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:08.442560 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d413-9a95-4277-998e-cc81720192ff service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:08.442829 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d413-9a95-4277-998e-cc81720192ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:08.444406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3267d413-9a95-4277-998e-cc81720192ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:08.535480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267d413-9a95-4277-998e-cc81720192ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:23:08.537082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267d413-9a95-4277-998e-cc81720192ff service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:23:08.555846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 726/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:23:10.871746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4ec75-95eb-474d-82e6-bf0938b4ab51 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:10.872316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4ec75-95eb-474d-82e6-bf0938b4ab51 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:10.872316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4ec75-95eb-474d-82e6-bf0938b4ab51 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:10.873673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 756/1482] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:23:10.879122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1af61-0fcb-4a21-a021-c5d5e472fed0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:10.879531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1af61-0fcb-4a21-a021-c5d5e472fed0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:10.879696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1af61-0fcb-4a21-a021-c5d5e472fed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:10.945915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b6a1af61-0fcb-4a21-a021-c5d5e472fed0 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:23:10.947143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b6a1af61-0fcb-4a21-a021-c5d5e472fed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:10.993041 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:11.045409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 727/1483] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:23:11.336061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4ec75-95eb-474d-82e6-bf0938b4ab51 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:23:11.337587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-36a4ec75-95eb-474d-82e6-bf0938b4ab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:11.361425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:11.443016 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4ec75-95eb-474d-82e6-bf0938b4ab51 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:23:11.517315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc044c0-5d96-4803-b882-55d80dc2dca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:23:11.517915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc044c0-5d96-4803-b882-55d80dc2dca1 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:11.518193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc044c0-5d96-4803-b882-55d80dc2dca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:11.518492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc044c0-5d96-4803-b882-55d80dc2dca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:11.520097 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3fc044c0-5d96-4803-b882-55d80dc2dca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:11.595407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:11.630342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc044c0-5d96-4803-b882-55d80dc2dca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:23:11.631798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc044c0-5d96-4803-b882-55d80dc2dca1 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:23:11.650003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 757/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:23:13.883189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858416d-f603-4882-bd27-8724e95b8b04 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:13.883788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858416d-f603-4882-bd27-8724e95b8b04 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:13.883788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858416d-f603-4882-bd27-8724e95b8b04 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:13.885091 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 728/1485] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:23:13.890418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc548d-7d19-4087-ae70-e3e35469ae09 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:13.890985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc548d-7d19-4087-ae70-e3e35469ae09 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:13.890985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc548d-7d19-4087-ae70-e3e35469ae09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:13.958052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-debc548d-7d19-4087-ae70-e3e35469ae09 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:23:13.959296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-debc548d-7d19-4087-ae70-e3e35469ae09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:14.056418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 758/1486] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:23:14.355634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858416d-f603-4882-bd27-8724e95b8b04 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:23:14.357163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6858416d-f603-4882-bd27-8724e95b8b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:14.464598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858416d-f603-4882-bd27-8724e95b8b04 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:23:14.536200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:14.537651 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16acf2-0283-4545-bb2a-8f2f0df85f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:23:14.538417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16acf2-0283-4545-bb2a-8f2f0df85f65 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:14.538714 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16acf2-0283-4545-bb2a-8f2f0df85f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:14.539175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16acf2-0283-4545-bb2a-8f2f0df85f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:14.541363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ca16acf2-0283-4545-bb2a-8f2f0df85f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:14.650822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16acf2-0283-4545-bb2a-8f2f0df85f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:23:14.652196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16acf2-0283-4545-bb2a-8f2f0df85f65 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:23:14.670455 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 729/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:23:16.891769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578e6ed-930f-409b-a1f2-1ecafee48ff3 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:16.892341 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578e6ed-930f-409b-a1f2-1ecafee48ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:16.892341 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578e6ed-930f-409b-a1f2-1ecafee48ff3 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:16.893624 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 759/1488] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:23:16.899046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b087f28-febb-4910-8a7c-1e51e52084d1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:16.899492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b087f28-febb-4910-8a7c-1e51e52084d1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:16.899591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b087f28-febb-4910-8a7c-1e51e52084d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:16.965555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0b087f28-febb-4910-8a7c-1e51e52084d1 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:23:16.966785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0b087f28-febb-4910-8a7c-1e51e52084d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:17.019370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:17.064575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 730/1489] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:23:17.361642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578e6ed-930f-409b-a1f2-1ecafee48ff3 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:23:17.363225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a578e6ed-930f-409b-a1f2-1ecafee48ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:17.401258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:17.469384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578e6ed-930f-409b-a1f2-1ecafee48ff3 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:23:17.543407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c59e4d-3434-4eae-ba15-350ecb349268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:23:17.544043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c59e4d-3434-4eae-ba15-350ecb349268 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:17.544318 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c59e4d-3434-4eae-ba15-350ecb349268 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:17.544587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c59e4d-3434-4eae-ba15-350ecb349268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:17.546836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a6c59e4d-3434-4eae-ba15-350ecb349268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:17.626112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:17.654651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c59e4d-3434-4eae-ba15-350ecb349268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:23:17.656579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c59e4d-3434-4eae-ba15-350ecb349268 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:23:17.674788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 760/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:23:20.021173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72ca4-59f6-450f-81c4-d28189ad1651 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:20.021696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72ca4-59f6-450f-81c4-d28189ad1651 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:20.021696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72ca4-59f6-450f-81c4-d28189ad1651 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:20.023008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 731/1491] 10.222.0.33 () {54 vars in 927 bytes} [Mon Sep 12 23:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:23:20.028360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69d37-7f35-44ca-ad86-9a0df37df314 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:20.028826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69d37-7f35-44ca-ad86-9a0df37df314 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:20.028926 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69d37-7f35-44ca-ad86-9a0df37df314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:20.094987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f7a69d37-7f35-44ca-ad86-9a0df37df314 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:23:20.096204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f7a69d37-7f35-44ca-ad86-9a0df37df314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:20.192545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 761/1492] 10.222.0.33 () {58 vars in 1024 bytes} [Mon Sep 12 23:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:23:20.479827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b72ca4-59f6-450f-81c4-d28189ad1651 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:23:20.481372 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b8b72ca4-59f6-450f-81c4-d28189ad1651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:20.586973 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b72ca4-59f6-450f-81c4-d28189ad1651 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:23:20.660346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0493a-8ae5-43b7-be68-9b9f7dfb81bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:23:20.660880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0493a-8ae5-43b7-be68-9b9f7dfb81bb service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:23:20.661161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0493a-8ae5-43b7-be68-9b9f7dfb81bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:23:20.661434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0493a-8ae5-43b7-be68-9b9f7dfb81bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:23:20.663047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f8a0493a-8ae5-43b7-be68-9b9f7dfb81bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:23:20.672404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:20.773689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0493a-8ae5-43b7-be68-9b9f7dfb81bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:23:20.775161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0493a-8ae5-43b7-be68-9b9f7dfb81bb service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:23:20.793848 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 732/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:23:30.191162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=82 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:30.791795 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=50 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:24:35.733258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c3e91-a8b8-426e-a97f-6091ba47cbad None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:35.733837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c3e91-a8b8-426e-a97f-6091ba47cbad None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:35.733837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c3e91-a8b8-426e-a97f-6091ba47cbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:35.812202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-d73c3e91-a8b8-426e-a97f-6091ba47cbad None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:24:35.813419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d73c3e91-a8b8-426e-a97f-6091ba47cbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:35.908119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 762/1494] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:24:35.916411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b1135-fdd9-4fdb-9e3d-66c0387ca3fa None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:35.916888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b1135-fdd9-4fdb-9e3d-66c0387ca3fa None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:35.916989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b1135-fdd9-4fdb-9e3d-66c0387ca3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:35.992636 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ed7b1135-fdd9-4fdb-9e3d-66c0387ca3fa None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:24:35.993753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ed7b1135-fdd9-4fdb-9e3d-66c0387ca3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:36.089375 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 733/1495] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:24:36.094118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c3e91-a8b8-426e-a97f-6091ba47cbad None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:24:36.095346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d73c3e91-a8b8-426e-a97f-6091ba47cbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:36.107374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c3e91-a8b8-426e-a97f-6091ba47cbad None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:24:36.169761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:24:36.203067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3f0c8-7754-46a2-b463-98fdf38fe806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:24:36.203667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3f0c8-7754-46a2-b463-98fdf38fe806 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:36.203942 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3f0c8-7754-46a2-b463-98fdf38fe806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:36.204208 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3f0c8-7754-46a2-b463-98fdf38fe806 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:36.204842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3f0c8-7754-46a2-b463-98fdf38fe806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:24:36.205140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3f0c8-7754-46a2-b463-98fdf38fe806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:24:36.206140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: WARNING py.warnings [None req-cea3f0c8-7754-46a2-b463-98fdf38fe806 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:24:36.206140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: warnings.warn(msg) Sep 12 23:24:36.206140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: Sep 12 23:24:36.207052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3f0c8-7754-46a2-b463-98fdf38fe806 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:24:36.218704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 763/1496] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:24:36.227336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b1135-fdd9-4fdb-9e3d-66c0387ca3fa None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:24:36.236886 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b1135-fdd9-4fdb-9e3d-66c0387ca3fa None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:24:36.297931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:24:36.331039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb5a32-9f9a-4287-8bce-7d170b86439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:24:36.331642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb5a32-9f9a-4287-8bce-7d170b86439a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:36.331928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb5a32-9f9a-4287-8bce-7d170b86439a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:36.332310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb5a32-9f9a-4287-8bce-7d170b86439a admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:36.332972 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb5a32-9f9a-4287-8bce-7d170b86439a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:24:36.334802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-3ddb5a32-9f9a-4287-8bce-7d170b86439a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:24:36.334802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 12 23:24:36.334802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: Sep 12 23:24:36.336008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb5a32-9f9a-4287-8bce-7d170b86439a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:24:36.401871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 734/1497] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:24:36 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:24:36.406579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3f0c8-7754-46a2-b463-98fdf38fe806 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:24:36.408074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cea3f0c8-7754-46a2-b463-98fdf38fe806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:36.441833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3f0c8-7754-46a2-b463-98fdf38fe806 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:24:36.536123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6864b-e575-47ae-839c-e152fb2cbc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:24:36.536715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6864b-e575-47ae-839c-e152fb2cbc3f admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:36.536987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6864b-e575-47ae-839c-e152fb2cbc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:36.537251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6864b-e575-47ae-839c-e152fb2cbc3f admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:36.537874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6864b-e575-47ae-839c-e152fb2cbc3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:24:36.538895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: WARNING py.warnings [None req-c3f6864b-e575-47ae-839c-e152fb2cbc3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:24:36.538895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: warnings.warn(msg) Sep 12 23:24:36.538895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: Sep 12 23:24:36.540093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6864b-e575-47ae-839c-e152fb2cbc3f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:24:36.583850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 764/1498] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:24:36 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:24:36.587896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb5a32-9f9a-4287-8bce-7d170b86439a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:24:36.589439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3ddb5a32-9f9a-4287-8bce-7d170b86439a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:36.651692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb5a32-9f9a-4287-8bce-7d170b86439a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:24:36.736031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:24:36.864336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba698e39-0b67-4c4f-be7b-fb9cd4b925e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:24:36.864867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba698e39-0b67-4c4f-be7b-fb9cd4b925e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:36.865146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba698e39-0b67-4c4f-be7b-fb9cd4b925e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:36.865418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba698e39-0b67-4c4f-be7b-fb9cd4b925e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:36.866065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba698e39-0b67-4c4f-be7b-fb9cd4b925e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:24:36.867097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-ba698e39-0b67-4c4f-be7b-fb9cd4b925e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:24:36.867097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 12 23:24:36.867097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: Sep 12 23:24:36.867980 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba698e39-0b67-4c4f-be7b-fb9cd4b925e6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:24:36.881275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 735/1499] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:24:36.885421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6864b-e575-47ae-839c-e152fb2cbc3f admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:24:36.886940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c3f6864b-e575-47ae-839c-e152fb2cbc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:36.898860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6864b-e575-47ae-839c-e152fb2cbc3f admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:24:36.924499 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:24:36.995162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788e0ff-7de0-4cd3-b0f4-24d1fba8589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:24:36.995772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788e0ff-7de0-4cd3-b0f4-24d1fba8589b admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:36.996053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788e0ff-7de0-4cd3-b0f4-24d1fba8589b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:36.996326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788e0ff-7de0-4cd3-b0f4-24d1fba8589b admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:36.997571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788e0ff-7de0-4cd3-b0f4-24d1fba8589b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:24:36.998739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: WARNING py.warnings [None req-a788e0ff-7de0-4cd3-b0f4-24d1fba8589b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:24:36.998739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: warnings.warn(msg) Sep 12 23:24:36.998739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: Sep 12 23:24:36.999632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788e0ff-7de0-4cd3-b0f4-24d1fba8589b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:24:37.011808 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 765/1500] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:24:37.016785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba698e39-0b67-4c4f-be7b-fb9cd4b925e6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:24:37.018308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ba698e39-0b67-4c4f-be7b-fb9cd4b925e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:37.050353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba698e39-0b67-4c4f-be7b-fb9cd4b925e6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:24:37.144481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e4ffa-792d-44c1-b76d-010f2688c271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:24:37.145067 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e4ffa-792d-44c1-b76d-010f2688c271 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:37.145348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e4ffa-792d-44c1-b76d-010f2688c271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:37.145629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e4ffa-792d-44c1-b76d-010f2688c271 admin admin] PATH_INFO: `/v3/projects/ab9169b27d584aa18116e706cc33138c/users/feab6478422143b5ae2284950ddff6ea/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:37.168291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e4ffa-792d-44c1-b76d-010f2688c271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab9169b27d584aa18116e706cc33138c, user_id=feab6478422143b5ae2284950ddff6ea, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:24:37.169408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-629e4ffa-792d-44c1-b76d-010f2688c271 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:24:37.169408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 12 23:24:37.169408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: Sep 12 23:24:37.171411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e4ffa-792d-44c1-b76d-010f2688c271 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:24:37.195731 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 736/1501] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:24:37 2022] PUT /identity/v3/projects/ab9169b27d584aa18116e706cc33138c/users/feab6478422143b5ae2284950ddff6ea/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:24:37.208471 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a913c49-0059-4e53-8520-5878cecab870 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:37.208783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a913c49-0059-4e53-8520-5878cecab870 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:37.209059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a913c49-0059-4e53-8520-5878cecab870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:37.267864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-8a913c49-0059-4e53-8520-5878cecab870 None None] MFA Rules not processed for user `feab6478422143b5ae2284950ddff6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:24:37.269087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8a913c49-0059-4e53-8520-5878cecab870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:37.345960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 766/1502] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:24:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:24:37.359798 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f430ac-6cee-4d1a-9fa2-b0d1e107f334 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:37.360082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f430ac-6cee-4d1a-9fa2-b0d1e107f334 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:37.360353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f430ac-6cee-4d1a-9fa2-b0d1e107f334 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:37.361670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 737/1503] 10.222.0.33 () {54 vars in 964 bytes} [Mon Sep 12 23:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:24:37.366505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ba3a-7378-4723-88d7-a99057786d6f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:37.366790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ba3a-7378-4723-88d7-a99057786d6f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:37.367061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ba3a-7378-4723-88d7-a99057786d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:37.398972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:24:37.443654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-3a64ba3a-7378-4723-88d7-a99057786d6f None None] MFA Rules not processed for user `4f5d6fe6235447acb395030fb0f0555d`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:24:37.444854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3a64ba3a-7378-4723-88d7-a99057786d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:37.520076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 767/1504] 10.222.0.33 () {58 vars in 1061 bytes} [Mon Sep 12 23:24:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:24:37.527838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f430ac-6cee-4d1a-9fa2-b0d1e107f334 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:24:37.529460 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b6f430ac-6cee-4d1a-9fa2-b0d1e107f334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:37.579425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:24:37.633735 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f430ac-6cee-4d1a-9fa2-b0d1e107f334 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:24:37.706044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3abf11-bbf6-4dff-88f9-bb2bd711db48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:24:37.706606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abf11-bbf6-4dff-88f9-bb2bd711db48 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:37.706883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abf11-bbf6-4dff-88f9-bb2bd711db48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:37.707149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abf11-bbf6-4dff-88f9-bb2bd711db48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:37.708715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3f3abf11-bbf6-4dff-88f9-bb2bd711db48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:37.807459 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3abf11-bbf6-4dff-88f9-bb2bd711db48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:24:37.808891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3abf11-bbf6-4dff-88f9-bb2bd711db48 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:24:37.812505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:24:37.828097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 738/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:24:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:24:37.873656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48fc9a-cd73-42f2-b7b5-830af77ab9e3 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:37.873939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48fc9a-cd73-42f2-b7b5-830af77ab9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:37.874215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48fc9a-cd73-42f2-b7b5-830af77ab9e3 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:37.875519 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 768/1506] 10.222.0.33 () {52 vars in 830 bytes} [Mon Sep 12 23:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:24:37.878995 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3abf11-bbf6-4dff-88f9-bb2bd711db48 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:24:37.880226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3f3abf11-bbf6-4dff-88f9-bb2bd711db48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:37.983399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3abf11-bbf6-4dff-88f9-bb2bd711db48 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:24:38.076828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:24:38.077896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:38.078480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:38.078982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] PATH_INFO: `/v3/users/feab6478422143b5ae2284950ddff6ea` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:38.093915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] RBAC: Authorizing `identity:delete_user(user_id=feab6478422143b5ae2284950ddff6ea)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:24:38.094974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:24:38.094974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 12 23:24:38.094974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: Sep 12 23:24:38.096182 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:24:38.105519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:24:38.162029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feab6478422143b5ae2284950ddff6ea'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:24:38.176250 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feab6478422143b5ae2284950ddff6ea'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:24:38.198664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feab6478422143b5ae2284950ddff6ea'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:24:38.199216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feab6478422143b5ae2284950ddff6ea'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:24:38.199635 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feab6478422143b5ae2284950ddff6ea'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:24:38.213528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 739/1507] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:24:37 2022] DELETE /identity/v3/users/feab6478422143b5ae2284950ddff6ea => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:24:38.218572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324767cc-8dfb-4041-93b8-ae7465324f9e None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:38.219074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324767cc-8dfb-4041-93b8-ae7465324f9e None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:38.219177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324767cc-8dfb-4041-93b8-ae7465324f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:38.275691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-324767cc-8dfb-4041-93b8-ae7465324f9e None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:24:38.276825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-324767cc-8dfb-4041-93b8-ae7465324f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:38.353332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:24:38.366692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 769/1508] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:24:38.376730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:24:38.377953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:38.479673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67caf73-1aca-4494-bb68-23082ff0928b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:24:38.535886 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:24:38.556785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc85019-d0c1-4616-be70-d82f2ccbe5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:24:38.557404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc85019-d0c1-4616-be70-d82f2ccbe5cc service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:38.557678 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc85019-d0c1-4616-be70-d82f2ccbe5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:38.557948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc85019-d0c1-4616-be70-d82f2ccbe5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:38.560071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-afc85019-d0c1-4616-be70-d82f2ccbe5cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:38.668081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc85019-d0c1-4616-be70-d82f2ccbe5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:24:38.670010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc85019-d0c1-4616-be70-d82f2ccbe5cc service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:24:38.688824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 740/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:24:39.191295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324767cc-8dfb-4041-93b8-ae7465324f9e None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:24:39.192537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-324767cc-8dfb-4041-93b8-ae7465324f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:24:39.204504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324767cc-8dfb-4041-93b8-ae7465324f9e None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:24:39.311705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:24:39.312359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:24:39.312591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:24:39.312857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] PATH_INFO: `/v3/projects/ab9169b27d584aa18116e706cc33138c` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:24:39.323403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab9169b27d584aa18116e706cc33138c)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:24:39.324479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: WARNING py.warnings [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:24:39.324479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: warnings.warn(msg) Sep 12 23:24:39.324479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: Sep 12 23:24:39.326471 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:24:39.384938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab9169b27d584aa18116e706cc33138c', 'request_id': 'req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:24:39.399039 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab9169b27d584aa18116e706cc33138c', 'request_id': 'req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:24:39.405182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab9169b27d584aa18116e706cc33138c', 'request_id': 'req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:24:39.431666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] The token cache is being invalidate because project ab9169b27d584aa18116e706cc33138c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:24:39.431952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:24:39.432371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-3e02198d-4db6-48a1-8f13-1ec4fa3683ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:24:39.433830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 770/1510] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:24:39 2022] DELETE /identity/v3/projects/ab9169b27d584aa18116e706cc33138c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:24:48.686690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=62 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:24:49.429644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:26:11.604555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e32a-b93d-45d3-adae-6131a8bff56d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:11.605153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e32a-b93d-45d3-adae-6131a8bff56d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:11.605153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e32a-b93d-45d3-adae-6131a8bff56d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:11.606506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 741/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:26:11.612086 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e16a7-beea-45b4-a33d-264932f3d5f3 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:11.612505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e16a7-beea-45b4-a33d-264932f3d5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:11.612616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e16a7-beea-45b4-a33d-264932f3d5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:11.693537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-089e16a7-beea-45b4-a33d-264932f3d5f3 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:26:11.694688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-089e16a7-beea-45b4-a33d-264932f3d5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:11.797562 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 771/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:26:11.950668 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e32a-b93d-45d3-adae-6131a8bff56d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:26:11.953373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ac58e32a-b93d-45d3-adae-6131a8bff56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:12.076380 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e32a-b93d-45d3-adae-6131a8bff56d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:26:12.082828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb9e94-4934-47ad-a469-4fb824fc936c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:26:12.083433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb9e94-4934-47ad-a469-4fb824fc936c service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:12.083714 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb9e94-4934-47ad-a469-4fb824fc936c service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:12.083987 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb9e94-4934-47ad-a469-4fb824fc936c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:12.091965 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb9e94-4934-47ad-a469-4fb824fc936c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:26:12.093541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb9e94-4934-47ad-a469-4fb824fc936c service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:26:12.102853 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 742/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:26:13.195185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5237c-5b9a-447c-90de-2ac1518385b9 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:13.195767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5237c-5b9a-447c-90de-2ac1518385b9 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:13.195767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5237c-5b9a-447c-90de-2ac1518385b9 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:13.197098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 772/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:26:13.203186 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31907051-fa49-4c07-b73e-97502b650329 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:13.203699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31907051-fa49-4c07-b73e-97502b650329 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:13.203810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31907051-fa49-4c07-b73e-97502b650329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:13.222972 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-31907051-fa49-4c07-b73e-97502b650329 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:26:13.224178 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-31907051-fa49-4c07-b73e-97502b650329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:13.231985 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 743/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:26:13.385097 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5237c-5b9a-447c-90de-2ac1518385b9 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:26:13.399932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5237c-5b9a-447c-90de-2ac1518385b9 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:26:13.405282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6249891-b41e-42b4-80d8-b66e7a1d7b5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:26:13.405909 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249891-b41e-42b4-80d8-b66e7a1d7b5d service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:13.406783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249891-b41e-42b4-80d8-b66e7a1d7b5d service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:13.407052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249891-b41e-42b4-80d8-b66e7a1d7b5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:13.414930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6249891-b41e-42b4-80d8-b66e7a1d7b5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:26:13.416768 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6249891-b41e-42b4-80d8-b66e7a1d7b5d service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:26:13.426049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 773/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:26:13.671256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77440d-8778-420c-b759-6de995659c16 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:13.671689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77440d-8778-420c-b759-6de995659c16 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:13.671944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77440d-8778-420c-b759-6de995659c16 None None] PATH_INFO: `/v3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:13.673380 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 744/1517] 10.222.0.17 () {54 vars in 925 bytes} [Mon Sep 12 23:26:13 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:26:13.681921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5196-f452-4b5a-b5b8-bc5b78e9ade2 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:13.682224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5196-f452-4b5a-b5b8-bc5b78e9ade2 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:13.682513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5196-f452-4b5a-b5b8-bc5b78e9ade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:13.744977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-abdf5196-f452-4b5a-b5b8-bc5b78e9ade2 None None] MFA Rules not processed for user `559a4af215324597b203e6866cb51fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:26:13.746199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-abdf5196-f452-4b5a-b5b8-bc5b78e9ade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:13.762653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:26:13.817436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 774/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Sep 12 23:26:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:26:23.096099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c00dc-4a4e-43d3-9777-f71697ed27e9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:23.096544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c00dc-4a4e-43d3-9777-f71697ed27e9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:23.096653 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c00dc-4a4e-43d3-9777-f71697ed27e9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:23.098150 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 745/1519] 10.222.0.33 () {54 vars in 961 bytes} [Mon Sep 12 23:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:26:23.103254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb32e-c6f6-4b85-a176-0106f1ce4da8 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:23.103709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb32e-c6f6-4b85-a176-0106f1ce4da8 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:23.103821 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb32e-c6f6-4b85-a176-0106f1ce4da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:23.123532 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-9e8bb32e-c6f6-4b85-a176-0106f1ce4da8 None None] MFA Rules not processed for user `559a4af215324597b203e6866cb51fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:26:23.125320 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9e8bb32e-c6f6-4b85-a176-0106f1ce4da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:23.133816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 775/1520] 10.222.0.33 () {58 vars in 1058 bytes} [Mon Sep 12 23:26:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:26:23.141600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c00dc-4a4e-43d3-9777-f71697ed27e9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:26:23.154731 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c00dc-4a4e-43d3-9777-f71697ed27e9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:26:23.159665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ede16-14f1-4e38-abfe-8f1bf37ff573 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '559a4af215324597b203e6866cb51fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:26:23.160260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ede16-14f1-4e38-abfe-8f1bf37ff573 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:23.160538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ede16-14f1-4e38-abfe-8f1bf37ff573 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:23.160809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ede16-14f1-4e38-abfe-8f1bf37ff573 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:23.169243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ede16-14f1-4e38-abfe-8f1bf37ff573 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:26:23.170855 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ede16-14f1-4e38-abfe-8f1bf37ff573 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:26:23.180893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 746/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:26:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:26:24.920487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa611-e48b-4438-a2ce-aeb358c5af7d None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:24.921084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa611-e48b-4438-a2ce-aeb358c5af7d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:24.921084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa611-e48b-4438-a2ce-aeb358c5af7d None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:24.923069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 776/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:26:24.929288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a464577-8002-434d-94f7-1a790cc6bdfb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:24.929709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a464577-8002-434d-94f7-1a790cc6bdfb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:24.929822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a464577-8002-434d-94f7-1a790cc6bdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:24.949271 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6a464577-8002-434d-94f7-1a790cc6bdfb None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:26:24.950512 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6a464577-8002-434d-94f7-1a790cc6bdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:24.958596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 747/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:26:25.113245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa611-e48b-4438-a2ce-aeb358c5af7d None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:26:25.127781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa611-e48b-4438-a2ce-aeb358c5af7d None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:26:25.133143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bc87b-828f-4215-9b2f-8bf4c0068a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:26:25.133736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bc87b-828f-4215-9b2f-8bf4c0068a40 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:25.134015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bc87b-828f-4215-9b2f-8bf4c0068a40 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:25.134285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bc87b-828f-4215-9b2f-8bf4c0068a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:25.142816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bc87b-828f-4215-9b2f-8bf4c0068a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:26:25.144405 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bc87b-828f-4215-9b2f-8bf4c0068a40 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:26:25.153643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 777/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:26:26.225812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc80fd0-8314-4f2a-9e45-03c4b318962e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:26.226365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc80fd0-8314-4f2a-9e45-03c4b318962e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:26.226365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc80fd0-8314-4f2a-9e45-03c4b318962e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:26.227769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 748/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:26:26.234593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c15d0-555c-45fb-b416-761aa9ff249b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:26.235194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c15d0-555c-45fb-b416-761aa9ff249b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:26.235304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c15d0-555c-45fb-b416-761aa9ff249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:26.255229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-3f3c15d0-555c-45fb-b416-761aa9ff249b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:26:26.256431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3f3c15d0-555c-45fb-b416-761aa9ff249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:26.264162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 778/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:26:26.424167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc80fd0-8314-4f2a-9e45-03c4b318962e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:26:26.438867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc80fd0-8314-4f2a-9e45-03c4b318962e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:26:26.445172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95799-af11-4d30-98f5-fc090bd9464f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:26:26.445783 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95799-af11-4d30-98f5-fc090bd9464f service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:26.446057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95799-af11-4d30-98f5-fc090bd9464f service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:26.446325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95799-af11-4d30-98f5-fc090bd9464f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:26.455065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd95799-af11-4d30-98f5-fc090bd9464f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:26:26.456646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd95799-af11-4d30-98f5-fc090bd9464f service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:26:26.465779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 749/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:26:30.517664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb9b3-d632-400c-8596-49f29ebdc502 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:30.518193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb9b3-d632-400c-8596-49f29ebdc502 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:30.518288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb9b3-d632-400c-8596-49f29ebdc502 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:30.519594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 779/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:26:30.524871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954ffd-0c3a-459e-be44-2c27af4b1d44 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:30.525296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954ffd-0c3a-459e-be44-2c27af4b1d44 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:30.525400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954ffd-0c3a-459e-be44-2c27af4b1d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:30.546241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ae954ffd-0c3a-459e-be44-2c27af4b1d44 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:26:30.547466 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ae954ffd-0c3a-459e-be44-2c27af4b1d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:30.555505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 750/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:26:30.863188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbb9b3-d632-400c-8596-49f29ebdc502 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:26:30.864894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-fbdbb9b3-d632-400c-8596-49f29ebdc502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:30.943485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbb9b3-d632-400c-8596-49f29ebdc502 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:26:30.946967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002cff4-2eb5-429a-82e4-0689513461c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:26:30.947565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002cff4-2eb5-429a-82e4-0689513461c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:30.947836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002cff4-2eb5-429a-82e4-0689513461c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:30.948101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002cff4-2eb5-429a-82e4-0689513461c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:30.957424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002cff4-2eb5-429a-82e4-0689513461c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:26:30.958883 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002cff4-2eb5-429a-82e4-0689513461c7 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:26:30.967953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 780/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:26:33.123296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c997a3-2e60-403f-910d-c4d674b92c8b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:33.123869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c997a3-2e60-403f-910d-c4d674b92c8b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:33.123869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c997a3-2e60-403f-910d-c4d674b92c8b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:33.125864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 751/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:26:33.131085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520c4c-2dae-40e7-a15a-b3f2b413a745 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:33.131548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520c4c-2dae-40e7-a15a-b3f2b413a745 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:33.131663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520c4c-2dae-40e7-a15a-b3f2b413a745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:33.151743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-26520c4c-2dae-40e7-a15a-b3f2b413a745 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:26:33.152951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-26520c4c-2dae-40e7-a15a-b3f2b413a745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:33.161063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 781/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:26:33.449181 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c997a3-2e60-403f-910d-c4d674b92c8b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:26:33.460440 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c997a3-2e60-403f-910d-c4d674b92c8b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:26:33.463939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecccbc7-b514-467a-9491-4d7626b1bba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:26:33.464529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecccbc7-b514-467a-9491-4d7626b1bba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:33.464806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecccbc7-b514-467a-9491-4d7626b1bba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:33.465078 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecccbc7-b514-467a-9491-4d7626b1bba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:33.474568 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecccbc7-b514-467a-9491-4d7626b1bba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:26:33.476002 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecccbc7-b514-467a-9491-4d7626b1bba2 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:26:33.485366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 752/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:26:37.411644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986bc66-ebb2-42bc-9986-35204f3af174 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:37.412194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986bc66-ebb2-42bc-9986-35204f3af174 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:37.412303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986bc66-ebb2-42bc-9986-35204f3af174 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:37.413559 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 782/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:26:37.418933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ffc1-643d-4bc8-b7ec-12c4b272de1b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:37.419374 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ffc1-643d-4bc8-b7ec-12c4b272de1b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:37.419479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ffc1-643d-4bc8-b7ec-12c4b272de1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:37.438881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6a95ffc1-643d-4bc8-b7ec-12c4b272de1b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:26:37.440053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6a95ffc1-643d-4bc8-b7ec-12c4b272de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:37.447604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 753/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:26:37.763893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986bc66-ebb2-42bc-9986-35204f3af174 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:26:37.766234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5986bc66-ebb2-42bc-9986-35204f3af174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:37.830599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:26:37.844214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986bc66-ebb2-42bc-9986-35204f3af174 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:26:37.848000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff05c4-712b-4c39-84d5-2ff2af3ec370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:26:37.848600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff05c4-712b-4c39-84d5-2ff2af3ec370 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:37.848875 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff05c4-712b-4c39-84d5-2ff2af3ec370 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:37.849143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff05c4-712b-4c39-84d5-2ff2af3ec370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:37.858665 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff05c4-712b-4c39-84d5-2ff2af3ec370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:26:37.860151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff05c4-712b-4c39-84d5-2ff2af3ec370 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:26:37.869288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 783/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:26:40.015782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc58c1-0c67-4d2b-99e5-2b514c88af59 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:40.016360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc58c1-0c67-4d2b-99e5-2b514c88af59 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:40.016360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc58c1-0c67-4d2b-99e5-2b514c88af59 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:40.017650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 754/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:26:40.022973 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19d15b-1b26-410c-bb6e-eb6aaf54142c None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:40.023420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19d15b-1b26-410c-bb6e-eb6aaf54142c None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:40.023530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19d15b-1b26-410c-bb6e-eb6aaf54142c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:40.043812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-4a19d15b-1b26-410c-bb6e-eb6aaf54142c None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:26:40.045014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4a19d15b-1b26-410c-bb6e-eb6aaf54142c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:40.053546 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 784/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:26:40.358403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc58c1-0c67-4d2b-99e5-2b514c88af59 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:26:40.360121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-28dc58c1-0c67-4d2b-99e5-2b514c88af59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:26:40.367685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:26:40.374048 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc58c1-0c67-4d2b-99e5-2b514c88af59 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:26:40.377685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62c8df-fe16-40a5-bad8-43163f52a4fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:26:40.378292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62c8df-fe16-40a5-bad8-43163f52a4fa service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:26:40.378605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62c8df-fe16-40a5-bad8-43163f52a4fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:26:40.378880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62c8df-fe16-40a5-bad8-43163f52a4fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:26:40.388224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62c8df-fe16-40a5-bad8-43163f52a4fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:26:40.390221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62c8df-fe16-40a5-bad8-43163f52a4fa service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:26:40.399576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 755/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:26:50.038686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=11 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:26:50.395432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:14.967295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d6c1e-a5a3-4594-9106-2673b0bdcd5f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:14.970255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d6c1e-a5a3-4594-9106-2673b0bdcd5f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:14.970255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d6c1e-a5a3-4594-9106-2673b0bdcd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:14.996568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-166d6c1e-a5a3-4594-9106-2673b0bdcd5f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:14.999037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-166d6c1e-a5a3-4594-9106-2673b0bdcd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:15.034320 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 785/1540] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:15.044724 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0447e3-02f6-41be-a72b-86bd6e95d280 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:15.045625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0447e3-02f6-41be-a72b-86bd6e95d280 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:15.045625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0447e3-02f6-41be-a72b-86bd6e95d280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:15.081252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3f0447e3-02f6-41be-a72b-86bd6e95d280 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:15.082494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3f0447e3-02f6-41be-a72b-86bd6e95d280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:15.103049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 756/1541] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:15.109573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d6c1e-a5a3-4594-9106-2673b0bdcd5f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:15.125686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d6c1e-a5a3-4594-9106-2673b0bdcd5f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:15.140778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d1ddf-e654-43e0-887f-281852d936bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:15.141764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d1ddf-e654-43e0-887f-281852d936bd admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:15.142309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d1ddf-e654-43e0-887f-281852d936bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:15.142824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d1ddf-e654-43e0-887f-281852d936bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:15.143699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d1ddf-e654-43e0-887f-281852d936bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:15.150267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d1ddf-e654-43e0-887f-281852d936bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:15.152394 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d1ddf-e654-43e0-887f-281852d936bd admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:15.172966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 786/1542] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:28:15.181590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0447e3-02f6-41be-a72b-86bd6e95d280 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:15.194215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0447e3-02f6-41be-a72b-86bd6e95d280 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:15.202317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9ce8e-dde4-456f-b827-f43e744dd386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:15.202968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9ce8e-dde4-456f-b827-f43e744dd386 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:15.203244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9ce8e-dde4-456f-b827-f43e744dd386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:15.203514 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9ce8e-dde4-456f-b827-f43e744dd386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:15.204162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9ce8e-dde4-456f-b827-f43e744dd386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:15.206076 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9ce8e-dde4-456f-b827-f43e744dd386 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:15.256143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 757/1543] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:15 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:15.260975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d1ddf-e654-43e0-887f-281852d936bd admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:15.275692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d1ddf-e654-43e0-887f-281852d936bd admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:15.396115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6f4f-f8e4-4b7f-892f-383c3da47079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:15.396922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6f4f-f8e4-4b7f-892f-383c3da47079 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:15.397206 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6f4f-f8e4-4b7f-892f-383c3da47079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:15.397480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6f4f-f8e4-4b7f-892f-383c3da47079 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:15.398143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec6f4f-f8e4-4b7f-892f-383c3da47079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:15.400151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec6f4f-f8e4-4b7f-892f-383c3da47079 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:15.456386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 787/1544] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:15 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:15.461061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9ce8e-dde4-456f-b827-f43e744dd386 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:15.479364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9ce8e-dde4-456f-b827-f43e744dd386 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:15.498414 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25132d5-9d01-4e41-81df-e07c07690297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:15.500044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25132d5-9d01-4e41-81df-e07c07690297 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:15.500558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25132d5-9d01-4e41-81df-e07c07690297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:15.501050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25132d5-9d01-4e41-81df-e07c07690297 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:15.501928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25132d5-9d01-4e41-81df-e07c07690297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:15.508099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25132d5-9d01-4e41-81df-e07c07690297 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:15.534613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 758/1545] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:15.542058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6f4f-f8e4-4b7f-892f-383c3da47079 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:15.584831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6f4f-f8e4-4b7f-892f-383c3da47079 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:15.607085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71127da2-0a7d-4099-88d9-3a2d38835638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:15.607713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71127da2-0a7d-4099-88d9-3a2d38835638 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:15.607993 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71127da2-0a7d-4099-88d9-3a2d38835638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:15.608263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71127da2-0a7d-4099-88d9-3a2d38835638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:15.608915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71127da2-0a7d-4099-88d9-3a2d38835638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:15.610929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71127da2-0a7d-4099-88d9-3a2d38835638 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:15.631558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 788/1546] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:15.635576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25132d5-9d01-4e41-81df-e07c07690297 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:15.655740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25132d5-9d01-4e41-81df-e07c07690297 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:15.671809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c0d86-6338-441d-b5d1-1e97152941ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:15.672502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c0d86-6338-441d-b5d1-1e97152941ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:15.672779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c0d86-6338-441d-b5d1-1e97152941ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:15.673124 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c0d86-6338-441d-b5d1-1e97152941ce admin admin] PATH_INFO: `/v3/projects/0a7bb92613294fcfb5deeb741baad1f0/users/a0ada49dfcb54b2b8e551e9d89f831a5/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:15.715407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c0d86-6338-441d-b5d1-1e97152941ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7bb92613294fcfb5deeb741baad1f0, user_id=a0ada49dfcb54b2b8e551e9d89f831a5, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:15.718410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c0d86-6338-441d-b5d1-1e97152941ce admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:15.739386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 759/1547] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:15 2022] PUT /identity/v3/projects/0a7bb92613294fcfb5deeb741baad1f0/users/a0ada49dfcb54b2b8e551e9d89f831a5/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:15.744538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a535df-ef63-45ed-9b0e-8b077b226676 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:15.744828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a535df-ef63-45ed-9b0e-8b077b226676 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:15.745100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a535df-ef63-45ed-9b0e-8b077b226676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:15.786295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b7a535df-ef63-45ed-9b0e-8b077b226676 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:15.790246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b7a535df-ef63-45ed-9b0e-8b077b226676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:15.825929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916300a-3c57-48dc-bc6a-b424f67f4107 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:15.826249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916300a-3c57-48dc-bc6a-b424f67f4107 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:15.828736 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916300a-3c57-48dc-bc6a-b424f67f4107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:15.905510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1916300a-3c57-48dc-bc6a-b424f67f4107 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:15.910402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1916300a-3c57-48dc-bc6a-b424f67f4107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:15.980578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 789/1548] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:15.983758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6366404-1645-46ab-888f-be97910d7e2a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:15.984271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6366404-1645-46ab-888f-be97910d7e2a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:15.984689 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6366404-1645-46ab-888f-be97910d7e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.007329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c6366404-1645-46ab-888f-be97910d7e2a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.008530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c6366404-1645-46ab-888f-be97910d7e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.016963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 760/1549] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.017259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 790/1550] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.018659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c822aaf-b3c8-487d-86d6-e6adc0727784 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.018935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c822aaf-b3c8-487d-86d6-e6adc0727784 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.019149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f0480-f160-41d0-972d-51c3ad506e3f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.019267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c822aaf-b3c8-487d-86d6-e6adc0727784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.019738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f0480-f160-41d0-972d-51c3ad506e3f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.020231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f0480-f160-41d0-972d-51c3ad506e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.040741 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-620f0480-f160-41d0-972d-51c3ad506e3f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.042117 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-620f0480-f160-41d0-972d-51c3ad506e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.044098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-9c822aaf-b3c8-487d-86d6-e6adc0727784 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.045690 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9c822aaf-b3c8-487d-86d6-e6adc0727784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.050973 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 761/1551] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.052074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae23cf0-3ff8-40b1-b797-23adc5a00724 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.052357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae23cf0-3ff8-40b1-b797-23adc5a00724 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.052628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae23cf0-3ff8-40b1-b797-23adc5a00724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.054419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 791/1552] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.055687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0a53-2df7-40da-a0a5-fbd3d8685868 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.055971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0a53-2df7-40da-a0a5-fbd3d8685868 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.056241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0a53-2df7-40da-a0a5-fbd3d8685868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.077746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cb9e0a53-2df7-40da-a0a5-fbd3d8685868 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.079146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cb9e0a53-2df7-40da-a0a5-fbd3d8685868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.082321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9ae23cf0-3ff8-40b1-b797-23adc5a00724 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.083909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ae23cf0-3ff8-40b1-b797-23adc5a00724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.087222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 792/1553] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.088473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e0a53-2df7-40da-a0a5-fbd3d8685868 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.100336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 762/1554] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.101851 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68759114-cb54-4dd7-9f22-c0ba2da51ca1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.102468 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68759114-cb54-4dd7-9f22-c0ba2da51ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.102911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68759114-cb54-4dd7-9f22-c0ba2da51ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.123380 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-68759114-cb54-4dd7-9f22-c0ba2da51ca1 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.124589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-68759114-cb54-4dd7-9f22-c0ba2da51ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.132921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 763/1555] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.134260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63529b2-09c3-4644-baaa-9b3cc8ca9f5a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.134573 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63529b2-09c3-4644-baaa-9b3cc8ca9f5a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.134846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63529b2-09c3-4644-baaa-9b3cc8ca9f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.144045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:16.155480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a63529b2-09c3-4644-baaa-9b3cc8ca9f5a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.156707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a63529b2-09c3-4644-baaa-9b3cc8ca9f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.159919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e0a53-2df7-40da-a0a5-fbd3d8685868 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.163493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbba10c-4cc6-4c37-92ee-ee693ab15b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.164102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbba10c-4cc6-4c37-92ee-ee693ab15b81 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.164381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbba10c-4cc6-4c37-92ee-ee693ab15b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.164616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 764/1556] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.164737 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbba10c-4cc6-4c37-92ee-ee693ab15b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.165775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5d7b7-caa9-416f-b7e4-408a7f9c3025 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.166065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5d7b7-caa9-416f-b7e4-408a7f9c3025 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.166614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5d7b7-caa9-416f-b7e4-408a7f9c3025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.177846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbba10c-4cc6-4c37-92ee-ee693ab15b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.179290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbba10c-4cc6-4c37-92ee-ee693ab15b81 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.185588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6aa5d7b7-caa9-416f-b7e4-408a7f9c3025 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.186801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6aa5d7b7-caa9-416f-b7e4-408a7f9c3025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.189116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 793/1557] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:16.190301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea037ed-92f0-4839-afbc-97c5a6b61786 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.190677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea037ed-92f0-4839-afbc-97c5a6b61786 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.190948 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea037ed-92f0-4839-afbc-97c5a6b61786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.194916 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 765/1558] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.199459 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79cafb-64f8-4cbe-a9be-a7473675e07c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.201120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79cafb-64f8-4cbe-a9be-a7473675e07c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.201120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79cafb-64f8-4cbe-a9be-a7473675e07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.212901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-1ea037ed-92f0-4839-afbc-97c5a6b61786 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.214126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-1ea037ed-92f0-4839-afbc-97c5a6b61786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.223229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3a79cafb-64f8-4cbe-a9be-a7473675e07c None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.224427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3a79cafb-64f8-4cbe-a9be-a7473675e07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.228560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 794/1559] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.228560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad057f-8bcd-4f5a-9939-264d40b0bc78 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.228560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad057f-8bcd-4f5a-9939-264d40b0bc78 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.228560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad057f-8bcd-4f5a-9939-264d40b0bc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.236060 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 766/1560] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.237338 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb596b-6709-4fb4-9f07-13579e411164 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.237600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb596b-6709-4fb4-9f07-13579e411164 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.237863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb596b-6709-4fb4-9f07-13579e411164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.250183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-2dad057f-8bcd-4f5a-9939-264d40b0bc78 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.251445 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2dad057f-8bcd-4f5a-9939-264d40b0bc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.260608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 795/1561] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.263228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c6fb596b-6709-4fb4-9f07-13579e411164 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.264907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c6fb596b-6709-4fb4-9f07-13579e411164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.267776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad057f-8bcd-4f5a-9939-264d40b0bc78 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.274600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 767/1562] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.275383 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb596b-6709-4fb4-9f07-13579e411164 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.281773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad057f-8bcd-4f5a-9939-264d40b0bc78 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.285867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb596b-6709-4fb4-9f07-13579e411164 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.287354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d72c53-3099-482a-aca4-88e0d5226ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.288177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d72c53-3099-482a-aca4-88e0d5226ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.288532 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d72c53-3099-482a-aca4-88e0d5226ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.288853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d72c53-3099-482a-aca4-88e0d5226ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.289682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d72c53-3099-482a-aca4-88e0d5226ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:16.289997 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d72c53-3099-482a-aca4-88e0d5226ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.291803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489663a-7043-4128-8966-3bbca28ecc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.292529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d72c53-3099-482a-aca4-88e0d5226ecc admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.292643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489663a-7043-4128-8966-3bbca28ecc69 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.292643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489663a-7043-4128-8966-3bbca28ecc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.292873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489663a-7043-4128-8966-3bbca28ecc69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.293490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489663a-7043-4128-8966-3bbca28ecc69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:16.293964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489663a-7043-4128-8966-3bbca28ecc69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.295008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-f489663a-7043-4128-8966-3bbca28ecc69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:28:16.295008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 12 23:28:16.295008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: Sep 12 23:28:16.295966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489663a-7043-4128-8966-3bbca28ecc69 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.308153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 796/1563] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:28:16.308574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 768/1564] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:28:16.309481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489663a-7043-4128-8966-3bbca28ecc69 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.309772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d72c53-3099-482a-aca4-88e0d5226ecc admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.320496 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d72c53-3099-482a-aca4-88e0d5226ecc admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.328122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eedd51-354c-4574-a792-8116af1cc8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.328854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eedd51-354c-4574-a792-8116af1cc8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.329132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eedd51-354c-4574-a792-8116af1cc8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.329400 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eedd51-354c-4574-a792-8116af1cc8a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.330040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eedd51-354c-4574-a792-8116af1cc8a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:16.330164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489663a-7043-4128-8966-3bbca28ecc69 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.330342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eedd51-354c-4574-a792-8116af1cc8a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.332034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eedd51-354c-4574-a792-8116af1cc8a8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.335653 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae814c-991f-471a-bbd0-09050c54c7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.336364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae814c-991f-471a-bbd0-09050c54c7bb admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.336719 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae814c-991f-471a-bbd0-09050c54c7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.337073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae814c-991f-471a-bbd0-09050c54c7bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.337777 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae814c-991f-471a-bbd0-09050c54c7bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:16.338185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae814c-991f-471a-bbd0-09050c54c7bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.339992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae814c-991f-471a-bbd0-09050c54c7bb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.349248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 797/1565] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:28:16.350259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eedd51-354c-4574-a792-8116af1cc8a8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.361139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eedd51-354c-4574-a792-8116af1cc8a8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.366687 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 769/1566] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:28:16.368518 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcf10a-df2d-40f0-bc5a-d6f774835a91 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.368957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcf10a-df2d-40f0-bc5a-d6f774835a91 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.369415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcf10a-df2d-40f0-bc5a-d6f774835a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.375247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881c781-d38e-4d93-a84d-805b1b3e208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.376042 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c781-d38e-4d93-a84d-805b1b3e208b admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.376327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c781-d38e-4d93-a84d-805b1b3e208b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.376659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c781-d38e-4d93-a84d-805b1b3e208b admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.377485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c781-d38e-4d93-a84d-805b1b3e208b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:16.377845 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c781-d38e-4d93-a84d-805b1b3e208b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.380579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c781-d38e-4d93-a84d-805b1b3e208b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.398097 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 798/1567] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:28:16.399217 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881c781-d38e-4d93-a84d-805b1b3e208b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.402590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c9dcf10a-df2d-40f0-bc5a-d6f774835a91 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:16.404216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c9dcf10a-df2d-40f0-bc5a-d6f774835a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:16.412289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881c781-d38e-4d93-a84d-805b1b3e208b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.416907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 770/1568] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:16.417752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcf10a-df2d-40f0-bc5a-d6f774835a91 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.419890 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf027b8-37a0-41c4-b055-a3c145a6b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.423466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf027b8-37a0-41c4-b055-a3c145a6b6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.423919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf027b8-37a0-41c4-b055-a3c145a6b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.424388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf027b8-37a0-41c4-b055-a3c145a6b6e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.425085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf027b8-37a0-41c4-b055-a3c145a6b6e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:16.425393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf027b8-37a0-41c4-b055-a3c145a6b6e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.427058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf027b8-37a0-41c4-b055-a3c145a6b6e5 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.428737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcf10a-df2d-40f0-bc5a-d6f774835a91 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.434719 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9bd33-cc7f-4d76-aa9a-44d1e00c98aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.435431 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9bd33-cc7f-4d76-aa9a-44d1e00c98aa admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.435987 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9bd33-cc7f-4d76-aa9a-44d1e00c98aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.436321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9bd33-cc7f-4d76-aa9a-44d1e00c98aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.437371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9bd33-cc7f-4d76-aa9a-44d1e00c98aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.439369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9bd33-cc7f-4d76-aa9a-44d1e00c98aa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.442516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 799/1569] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:28:16.443498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf027b8-37a0-41c4-b055-a3c145a6b6e5 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.448780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:16.456269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf027b8-37a0-41c4-b055-a3c145a6b6e5 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.462887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c774f5c-a41d-493c-82f7-9db6c1c8a728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.463603 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c774f5c-a41d-493c-82f7-9db6c1c8a728 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.463958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c774f5c-a41d-493c-82f7-9db6c1c8a728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.464457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c774f5c-a41d-493c-82f7-9db6c1c8a728 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.465003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c774f5c-a41d-493c-82f7-9db6c1c8a728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.466584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: WARNING py.warnings [None req-9c774f5c-a41d-493c-82f7-9db6c1c8a728 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:28:16.466584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: warnings.warn(msg) Sep 12 23:28:16.466584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: Sep 12 23:28:16.467864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c774f5c-a41d-493c-82f7-9db6c1c8a728 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.479216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 771/1570] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/projects => generated 405 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:16.483004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9bd33-cc7f-4d76-aa9a-44d1e00c98aa admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.499443 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 800/1571] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:16.500688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c774f5c-a41d-493c-82f7-9db6c1c8a728 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.561506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9bd33-cc7f-4d76-aa9a-44d1e00c98aa admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.571333 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcde25-3c0e-4207-9d6c-20dd76876771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.572319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcde25-3c0e-4207-9d6c-20dd76876771 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.572846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcde25-3c0e-4207-9d6c-20dd76876771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.573356 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcde25-3c0e-4207-9d6c-20dd76876771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.573479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c774f5c-a41d-493c-82f7-9db6c1c8a728 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.574293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcde25-3c0e-4207-9d6c-20dd76876771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.576532 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcde25-3c0e-4207-9d6c-20dd76876771 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.578248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779aadb3-16ab-48c7-8536-580c929c1a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.578893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779aadb3-16ab-48c7-8536-580c929c1a61 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.579176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779aadb3-16ab-48c7-8536-580c929c1a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.579451 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779aadb3-16ab-48c7-8536-580c929c1a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.580114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779aadb3-16ab-48c7-8536-580c929c1a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.582177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779aadb3-16ab-48c7-8536-580c929c1a61 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.619304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 801/1572] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:16.619304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779aadb3-16ab-48c7-8536-580c929c1a61 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.625064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 772/1573] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:16.626283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcde25-3c0e-4207-9d6c-20dd76876771 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.682741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:16.708949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcde25-3c0e-4207-9d6c-20dd76876771 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.710815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779aadb3-16ab-48c7-8536-580c929c1a61 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.714458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45258088-563b-4f79-a0e4-e2e79dd9f9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.715082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45258088-563b-4f79-a0e4-e2e79dd9f9ed admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.715982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45258088-563b-4f79-a0e4-e2e79dd9f9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.716478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45258088-563b-4f79-a0e4-e2e79dd9f9ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.717038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96958ea-bab5-4c62-8b47-9c6e042506d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.717262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45258088-563b-4f79-a0e4-e2e79dd9f9ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:16.717572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45258088-563b-4f79-a0e4-e2e79dd9f9ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.717667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96958ea-bab5-4c62-8b47-9c6e042506d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.718265 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96958ea-bab5-4c62-8b47-9c6e042506d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.718455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96958ea-bab5-4c62-8b47-9c6e042506d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.718979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96958ea-bab5-4c62-8b47-9c6e042506d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.719327 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45258088-563b-4f79-a0e4-e2e79dd9f9ed admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.721015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96958ea-bab5-4c62-8b47-9c6e042506d0 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.733893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 773/1574] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:28:16.735337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45258088-563b-4f79-a0e4-e2e79dd9f9ed admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.752524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45258088-563b-4f79-a0e4-e2e79dd9f9ed admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.756474 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 802/1575] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:16.757314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96958ea-bab5-4c62-8b47-9c6e042506d0 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.760678 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10111c1-bbc9-44bb-a894-3b32d95fd1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.761305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10111c1-bbc9-44bb-a894-3b32d95fd1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.761600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10111c1-bbc9-44bb-a894-3b32d95fd1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.762416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10111c1-bbc9-44bb-a894-3b32d95fd1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.762617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10111c1-bbc9-44bb-a894-3b32d95fd1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.764716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10111c1-bbc9-44bb-a894-3b32d95fd1b7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.796764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 774/1576] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/projects => generated 391 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:16.799279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10111c1-bbc9-44bb-a894-3b32d95fd1b7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.832181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96958ea-bab5-4c62-8b47-9c6e042506d0 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.873998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:16.896484 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10111c1-bbc9-44bb-a894-3b32d95fd1b7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.899649 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd24f91-024d-4199-933d-aa935c517ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.900372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd24f91-024d-4199-933d-aa935c517ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.900688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd24f91-024d-4199-933d-aa935c517ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.901036 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd24f91-024d-4199-933d-aa935c517ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.902002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd24f91-024d-4199-933d-aa935c517ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.902251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953fc07-5656-43ef-90f6-729f95f91938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.903039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953fc07-5656-43ef-90f6-729f95f91938 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.903426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953fc07-5656-43ef-90f6-729f95f91938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.903847 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953fc07-5656-43ef-90f6-729f95f91938 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.904104 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd24f91-024d-4199-933d-aa935c517ca9 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.904869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953fc07-5656-43ef-90f6-729f95f91938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.906101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-0953fc07-5656-43ef-90f6-729f95f91938 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:28:16.906101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 12 23:28:16.906101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: Sep 12 23:28:16.908241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953fc07-5656-43ef-90f6-729f95f91938 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.933992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 775/1577] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:16.935473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953fc07-5656-43ef-90f6-729f95f91938 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.936009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 803/1578] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/users => generated 303 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:16.937746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd24f91-024d-4199-933d-aa935c517ca9 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.949621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd24f91-024d-4199-933d-aa935c517ca9 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.953611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953fc07-5656-43ef-90f6-729f95f91938 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:16.956455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f83d41-dbeb-434d-baf3-ca52124e4bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.957251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f83d41-dbeb-434d-baf3-ca52124e4bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.957688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f83d41-dbeb-434d-baf3-ca52124e4bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.957955 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f83d41-dbeb-434d-baf3-ca52124e4bfb admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.958863 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f83d41-dbeb-434d-baf3-ca52124e4bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.960629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c425f9-5c7b-4576-a389-c6ce146da53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:16.961412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c425f9-5c7b-4576-a389-c6ce146da53d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:16.961593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f83d41-dbeb-434d-baf3-ca52124e4bfb admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.961715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c425f9-5c7b-4576-a389-c6ce146da53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:16.961954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c425f9-5c7b-4576-a389-c6ce146da53d admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:16.962740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c425f9-5c7b-4576-a389-c6ce146da53d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:16.965761 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c425f9-5c7b-4576-a389-c6ce146da53d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:16.993889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 776/1579] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/users => generated 284 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:16.995076 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c425f9-5c7b-4576-a389-c6ce146da53d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:16.996574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 804/1580] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/users => generated 292 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:16.998373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f83d41-dbeb-434d-baf3-ca52124e4bfb admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.008987 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c425f9-5c7b-4576-a389-c6ce146da53d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.011358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f83d41-dbeb-434d-baf3-ca52124e4bfb admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.015277 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f80803-8772-41c0-bef8-e07b393b175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.016240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f80803-8772-41c0-bef8-e07b393b175f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.016674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f80803-8772-41c0-bef8-e07b393b175f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.017133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f80803-8772-41c0-bef8-e07b393b175f admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.017597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f9dfc-dcd4-445c-bb7f-41e1766737a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.018232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f80803-8772-41c0-bef8-e07b393b175f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.018364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f9dfc-dcd4-445c-bb7f-41e1766737a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.018660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f9dfc-dcd4-445c-bb7f-41e1766737a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.018917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f9dfc-dcd4-445c-bb7f-41e1766737a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.019544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f9dfc-dcd4-445c-bb7f-41e1766737a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.021283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f80803-8772-41c0-bef8-e07b393b175f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.021664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f9dfc-dcd4-445c-bb7f-41e1766737a8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.053767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 805/1581] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/users => generated 282 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:17.054688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f9dfc-dcd4-445c-bb7f-41e1766737a8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.067826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f9dfc-dcd4-445c-bb7f-41e1766737a8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.069189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 777/1582] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:16 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:17.071679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f80803-8772-41c0-bef8-e07b393b175f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.100888 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:17.146948 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c5c2a-58b1-4038-b23f-0a4be83540eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.147579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c5c2a-58b1-4038-b23f-0a4be83540eb admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.148179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c5c2a-58b1-4038-b23f-0a4be83540eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.148470 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c5c2a-58b1-4038-b23f-0a4be83540eb admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.149207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c5c2a-58b1-4038-b23f-0a4be83540eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.151194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c5c2a-58b1-4038-b23f-0a4be83540eb admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.159281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f80803-8772-41c0-bef8-e07b393b175f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.164419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08016cea-f31c-46c5-961c-cc41a9fb99c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.165157 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08016cea-f31c-46c5-961c-cc41a9fb99c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.165534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08016cea-f31c-46c5-961c-cc41a9fb99c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.165942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08016cea-f31c-46c5-961c-cc41a9fb99c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.167192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08016cea-f31c-46c5-961c-cc41a9fb99c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.170081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08016cea-f31c-46c5-961c-cc41a9fb99c4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.187799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 778/1583] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.189646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08016cea-f31c-46c5-961c-cc41a9fb99c4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.192691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 806/1584] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:17 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:17.194308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c5c2a-58b1-4038-b23f-0a4be83540eb admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.206439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08016cea-f31c-46c5-961c-cc41a9fb99c4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.206684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c5c2a-58b1-4038-b23f-0a4be83540eb admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.211767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a45ef-713e-498a-9efd-b0243836f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.212133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cde34-6fe6-4b35-954f-cf50fd0d1bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.212439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a45ef-713e-498a-9efd-b0243836f592 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.212715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a45ef-713e-498a-9efd-b0243836f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.212988 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a45ef-713e-498a-9efd-b0243836f592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.213564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cde34-6fe6-4b35-954f-cf50fd0d1bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.213696 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a45ef-713e-498a-9efd-b0243836f592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.214160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cde34-6fe6-4b35-954f-cf50fd0d1bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.214953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cde34-6fe6-4b35-954f-cf50fd0d1bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.215934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a45ef-713e-498a-9efd-b0243836f592 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.216630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cde34-6fe6-4b35-954f-cf50fd0d1bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.219108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cde34-6fe6-4b35-954f-cf50fd0d1bf3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.227442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 807/1585] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.228420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a45ef-713e-498a-9efd-b0243836f592 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.232531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 779/1586] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.233775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cde34-6fe6-4b35-954f-cf50fd0d1bf3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.244691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a45ef-713e-498a-9efd-b0243836f592 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.247638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cde34-6fe6-4b35-954f-cf50fd0d1bf3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.254690 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfcd02-0689-4ca2-b1f1-1c8bb05914dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.255447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfcd02-0689-4ca2-b1f1-1c8bb05914dc admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.255733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfcd02-0689-4ca2-b1f1-1c8bb05914dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.256062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfcd02-0689-4ca2-b1f1-1c8bb05914dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.256455 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71297f89-0d8b-4986-a2b6-12b3b1f98656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.256972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfcd02-0689-4ca2-b1f1-1c8bb05914dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.257105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297f89-0d8b-4986-a2b6-12b3b1f98656 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.257365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297f89-0d8b-4986-a2b6-12b3b1f98656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.257644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297f89-0d8b-4986-a2b6-12b3b1f98656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.258595 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71297f89-0d8b-4986-a2b6-12b3b1f98656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.259390 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfcd02-0689-4ca2-b1f1-1c8bb05914dc admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.261285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71297f89-0d8b-4986-a2b6-12b3b1f98656 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.272594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 808/1587] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.273652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfcd02-0689-4ca2-b1f1-1c8bb05914dc admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.280362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 780/1588] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.284363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71297f89-0d8b-4986-a2b6-12b3b1f98656 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.287427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfcd02-0689-4ca2-b1f1-1c8bb05914dc admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.296716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71297f89-0d8b-4986-a2b6-12b3b1f98656 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.301443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a047e2-f9e9-4244-9db8-edbf725c841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.302043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a047e2-f9e9-4244-9db8-edbf725c841b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.302328 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a047e2-f9e9-4244-9db8-edbf725c841b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.302652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a047e2-f9e9-4244-9db8-edbf725c841b admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.303299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a047e2-f9e9-4244-9db8-edbf725c841b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.303642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdefd69-dbdb-45ba-9826-600aa4f2e100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.304258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdefd69-dbdb-45ba-9826-600aa4f2e100 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.304533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdefd69-dbdb-45ba-9826-600aa4f2e100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.304800 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdefd69-dbdb-45ba-9826-600aa4f2e100 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.304911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a047e2-f9e9-4244-9db8-edbf725c841b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.305421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdefd69-dbdb-45ba-9826-600aa4f2e100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.307352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdefd69-dbdb-45ba-9826-600aa4f2e100 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.316189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 781/1589] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.317110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a047e2-f9e9-4244-9db8-edbf725c841b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.332010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a047e2-f9e9-4244-9db8-edbf725c841b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.337923 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eefa4-584f-4d7a-a73b-14bf8c8ee577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.339074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eefa4-584f-4d7a-a73b-14bf8c8ee577 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.339074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eefa4-584f-4d7a-a73b-14bf8c8ee577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.339308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eefa4-584f-4d7a-a73b-14bf8c8ee577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.339881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eefa4-584f-4d7a-a73b-14bf8c8ee577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.342145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 809/1590] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:17 2022] POST /identity/v3/users => generated 290 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:17.342947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eefa4-584f-4d7a-a73b-14bf8c8ee577 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.343263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdefd69-dbdb-45ba-9826-600aa4f2e100 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.355375 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 782/1591] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.356860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eefa4-584f-4d7a-a73b-14bf8c8ee577 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.358174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdefd69-dbdb-45ba-9826-600aa4f2e100 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.368462 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284a998-830f-4539-a5eb-69de817326d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.368462 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284a998-830f-4539-a5eb-69de817326d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.368462 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284a998-830f-4539-a5eb-69de817326d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.368462 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284a998-830f-4539-a5eb-69de817326d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.369232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284a998-830f-4539-a5eb-69de817326d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.369739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284a998-830f-4539-a5eb-69de817326d0 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.377407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eefa4-584f-4d7a-a73b-14bf8c8ee577 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.385440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 810/1592] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.386414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284a998-830f-4539-a5eb-69de817326d0 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.387084 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a50696-5d1f-40b9-bc53-fa0b6d39c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.388838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a50696-5d1f-40b9-bc53-fa0b6d39c7af admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.389463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a50696-5d1f-40b9-bc53-fa0b6d39c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.390160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a50696-5d1f-40b9-bc53-fa0b6d39c7af admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.391220 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a50696-5d1f-40b9-bc53-fa0b6d39c7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.393742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a50696-5d1f-40b9-bc53-fa0b6d39c7af admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.399416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284a998-830f-4539-a5eb-69de817326d0 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.404874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351f0cf-e331-42f0-9d66-f91ff64f8cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.405485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351f0cf-e331-42f0-9d66-f91ff64f8cab admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.405771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351f0cf-e331-42f0-9d66-f91ff64f8cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.406078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351f0cf-e331-42f0-9d66-f91ff64f8cab admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.406932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351f0cf-e331-42f0-9d66-f91ff64f8cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.408630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351f0cf-e331-42f0-9d66-f91ff64f8cab admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.411064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 783/1593] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.412598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a50696-5d1f-40b9-bc53-fa0b6d39c7af admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.426753 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 811/1594] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.426753 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351f0cf-e331-42f0-9d66-f91ff64f8cab admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.430502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a50696-5d1f-40b9-bc53-fa0b6d39c7af admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.438055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351f0cf-e331-42f0-9d66-f91ff64f8cab admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.439696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d3b83-b8a5-48c8-8c28-d00cf216a305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.440723 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d3b83-b8a5-48c8-8c28-d00cf216a305 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.441366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d3b83-b8a5-48c8-8c28-d00cf216a305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.441901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d3b83-b8a5-48c8-8c28-d00cf216a305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.442867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d3b83-b8a5-48c8-8c28-d00cf216a305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.444693 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d3b83-b8a5-48c8-8c28-d00cf216a305 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.448777 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df9b28-3df1-4916-b939-9b78cc8c2f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.450580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9b28-3df1-4916-b939-9b78cc8c2f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.451417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9b28-3df1-4916-b939-9b78cc8c2f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.452034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9b28-3df1-4916-b939-9b78cc8c2f7d admin admin] PATH_INFO: `/v3/projects/db54b7380ccd465a9df7904f2c439c75/users/8b7e7f9af2cd4ac0bebb2a65f08a4398/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.460421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 784/1595] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.461666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d3b83-b8a5-48c8-8c28-d00cf216a305 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.471693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df9b28-3df1-4916-b939-9b78cc8c2f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=db54b7380ccd465a9df7904f2c439c75, user_id=8b7e7f9af2cd4ac0bebb2a65f08a4398, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.473076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: WARNING py.warnings [None req-43df9b28-3df1-4916-b939-9b78cc8c2f7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:28:17.473076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: warnings.warn(msg) Sep 12 23:28:17.473076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: Sep 12 23:28:17.475663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df9b28-3df1-4916-b939-9b78cc8c2f7d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.475979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d3b83-b8a5-48c8-8c28-d00cf216a305 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.482744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dacc9-87aa-4036-9518-6680236e3b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.483699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dacc9-87aa-4036-9518-6680236e3b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.484945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dacc9-87aa-4036-9518-6680236e3b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.484945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dacc9-87aa-4036-9518-6680236e3b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.485418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dacc9-87aa-4036-9518-6680236e3b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.487314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dacc9-87aa-4036-9518-6680236e3b79 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.499083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 812/1596] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:17 2022] PUT /identity/v3/projects/db54b7380ccd465a9df7904f2c439c75/users/8b7e7f9af2cd4ac0bebb2a65f08a4398/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:17.500237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df9b28-3df1-4916-b939-9b78cc8c2f7d admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.501928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 785/1597] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.503581 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dacc9-87aa-4036-9518-6680236e3b79 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.522847 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dacc9-87aa-4036-9518-6680236e3b79 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.540988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:17.588362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df9b28-3df1-4916-b939-9b78cc8c2f7d admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.595293 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9052c61-6686-48f7-a759-a3c261190748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.595977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9052c61-6686-48f7-a759-a3c261190748 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.596425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9052c61-6686-48f7-a759-a3c261190748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.596687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9052c61-6686-48f7-a759-a3c261190748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.597453 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9052c61-6686-48f7-a759-a3c261190748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.599207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9052c61-6686-48f7-a759-a3c261190748 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.612026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 813/1598] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:17.612773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6db909-fac5-4967-9ab4-8bd82e028ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.613023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9052c61-6686-48f7-a759-a3c261190748 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.613836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6db909-fac5-4967-9ab4-8bd82e028ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.614213 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6db909-fac5-4967-9ab4-8bd82e028ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.614601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6db909-fac5-4967-9ab4-8bd82e028ddf admin admin] PATH_INFO: `/v3/projects/6421dab1f7244d1eb80f781a71483470/users/8772fcbb3a594f008b053d8da15f2efa/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.624020 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9052c61-6686-48f7-a759-a3c261190748 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.629577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eb2ab-b995-4199-b0fe-e579324df013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.630585 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eb2ab-b995-4199-b0fe-e579324df013 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.630869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eb2ab-b995-4199-b0fe-e579324df013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.631191 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eb2ab-b995-4199-b0fe-e579324df013 admin admin] PATH_INFO: `/v3/projects/10563cbea5764508af492728c41e6bba/users/dd785c60fff444d1ac6e51210bd60288/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.643244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6db909-fac5-4967-9ab4-8bd82e028ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6421dab1f7244d1eb80f781a71483470, user_id=8772fcbb3a594f008b053d8da15f2efa, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.646766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6db909-fac5-4967-9ab4-8bd82e028ddf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.651376 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eb2ab-b995-4199-b0fe-e579324df013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10563cbea5764508af492728c41e6bba, user_id=dd785c60fff444d1ac6e51210bd60288, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.655053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eb2ab-b995-4199-b0fe-e579324df013 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.674477 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 786/1599] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:17 2022] PUT /identity/v3/projects/6421dab1f7244d1eb80f781a71483470/users/8772fcbb3a594f008b053d8da15f2efa/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:17.675670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6db909-fac5-4967-9ab4-8bd82e028ddf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.676165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 814/1600] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:17 2022] PUT /identity/v3/projects/10563cbea5764508af492728c41e6bba/users/dd785c60fff444d1ac6e51210bd60288/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:17.677213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eb2ab-b995-4199-b0fe-e579324df013 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.682364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:17.766164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6db909-fac5-4967-9ab4-8bd82e028ddf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.772930 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab84dec-366a-41b9-b610-5ebde7761ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.774479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab84dec-366a-41b9-b610-5ebde7761ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.775000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab84dec-366a-41b9-b610-5ebde7761ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.775292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab84dec-366a-41b9-b610-5ebde7761ef0 admin admin] PATH_INFO: `/v3/projects/ab3c0950c2a04d4587340e3a16d8a720/users/52cd8a8425684dd49b2f134dd71ea7cc/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.777700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eb2ab-b995-4199-b0fe-e579324df013 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:17.783920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87f72-2548-436e-a287-9845e957b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:17.788642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87f72-2548-436e-a287-9845e957b2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.791494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87f72-2548-436e-a287-9845e957b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.792065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87f72-2548-436e-a287-9845e957b2c5 admin admin] PATH_INFO: `/v3/projects/70f3698787d64e4394403deab174f397/users/5e09fe95c387440cb7c7dd437a290c26/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.798858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab84dec-366a-41b9-b610-5ebde7761ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3c0950c2a04d4587340e3a16d8a720, user_id=52cd8a8425684dd49b2f134dd71ea7cc, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.802320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab84dec-366a-41b9-b610-5ebde7761ef0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.815334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c87f72-2548-436e-a287-9845e957b2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f3698787d64e4394403deab174f397, user_id=5e09fe95c387440cb7c7dd437a290c26, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:17.818581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c87f72-2548-436e-a287-9845e957b2c5 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:17.826217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 787/1601] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:17 2022] PUT /identity/v3/projects/ab3c0950c2a04d4587340e3a16d8a720/users/52cd8a8425684dd49b2f134dd71ea7cc/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:17.827625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55762c-2c5e-4200-8caa-1c946d925d2b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:17.827903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55762c-2c5e-4200-8caa-1c946d925d2b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:17.828178 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55762c-2c5e-4200-8caa-1c946d925d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:17.836172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 815/1602] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:17 2022] PUT /identity/v3/projects/70f3698787d64e4394403deab174f397/users/5e09fe95c387440cb7c7dd437a290c26/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:17.838620 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87f72-2548-436e-a287-9845e957b2c5 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.855672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fb55762c-2c5e-4200-8caa-1c946d925d2b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:17.857991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fb55762c-2c5e-4200-8caa-1c946d925d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:17.943992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 788/1603] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:17.945011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55762c-2c5e-4200-8caa-1c946d925d2b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:17.956000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87f72-2548-436e-a287-9845e957b2c5 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:18.021292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe9780-4a65-4c30-8696-5086033de8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:18.021292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe9780-4a65-4c30-8696-5086033de8de admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.021292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe9780-4a65-4c30-8696-5086033de8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.021292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe9780-4a65-4c30-8696-5086033de8de admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.023983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe9780-4a65-4c30-8696-5086033de8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:18.023983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe9780-4a65-4c30-8696-5086033de8de admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:18.024262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55762c-2c5e-4200-8caa-1c946d925d2b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:18.024262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277f126-f15e-4013-a0ef-27381d671ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:18.024262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277f126-f15e-4013-a0ef-27381d671ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.024262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277f126-f15e-4013-a0ef-27381d671ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.024604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277f126-f15e-4013-a0ef-27381d671ebc admin admin] PATH_INFO: `/v3/projects/b49f5e8682184d7e95f9be4ecb95c270/users/e3a473b5ad2f43db852f57f83d48240b/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.024687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 816/1604] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:18.024687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ec72-c95d-4252-960c-b4697d255ee8 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.024687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ec72-c95d-4252-960c-b4697d255ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.024687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ec72-c95d-4252-960c-b4697d255ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.025074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277f126-f15e-4013-a0ef-27381d671ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49f5e8682184d7e95f9be4ecb95c270, user_id=e3a473b5ad2f43db852f57f83d48240b, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:18.025074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277f126-f15e-4013-a0ef-27381d671ebc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:18.040984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:18.047536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-0b50ec72-c95d-4252-960c-b4697d255ee8 None None] MFA Rules not processed for user `8772fcbb3a594f008b053d8da15f2efa`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:18.048877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0b50ec72-c95d-4252-960c-b4697d255ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:18.058606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 789/1605] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:17 2022] PUT /identity/v3/projects/b49f5e8682184d7e95f9be4ecb95c270/users/e3a473b5ad2f43db852f57f83d48240b/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:18.061605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051a657-832c-4f11-b16c-4516ea058028 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.062018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051a657-832c-4f11-b16c-4516ea058028 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.062478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051a657-832c-4f11-b16c-4516ea058028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.086472 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5051a657-832c-4f11-b16c-4516ea058028 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:18.089454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5051a657-832c-4f11-b16c-4516ea058028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:18.139724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 817/1606] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:18.141160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ad508-00b9-4e66-9d39-b8a6f07b098e None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.141885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ad508-00b9-4e66-9d39-b8a6f07b098e None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.142296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ad508-00b9-4e66-9d39-b8a6f07b098e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.179951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:18.199166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 790/1607] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:18.200904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e666a-7bb9-401f-bb7c-6ca7ca61145f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.201264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e666a-7bb9-401f-bb7c-6ca7ca61145f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.201425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f02ad508-00b9-4e66-9d39-b8a6f07b098e None None] MFA Rules not processed for user `52cd8a8425684dd49b2f134dd71ea7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:18.201666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e666a-7bb9-401f-bb7c-6ca7ca61145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.202908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f02ad508-00b9-4e66-9d39-b8a6f07b098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:18.233163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-876e666a-7bb9-401f-bb7c-6ca7ca61145f None None] MFA Rules not processed for user `5e09fe95c387440cb7c7dd437a290c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:18.234521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-876e666a-7bb9-401f-bb7c-6ca7ca61145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:18.284792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 818/1608] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:18.285514 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ad508-00b9-4e66-9d39-b8a6f07b098e None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:18.289357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f02ad508-00b9-4e66-9d39-b8a6f07b098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:18.321389 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 791/1609] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:18.322454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e666a-7bb9-401f-bb7c-6ca7ca61145f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:18.335119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e666a-7bb9-401f-bb7c-6ca7ca61145f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:18.339725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af3b5-ba51-4527-a453-7eaea41523da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:18.340607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af3b5-ba51-4527-a453-7eaea41523da admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.340928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af3b5-ba51-4527-a453-7eaea41523da admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.341202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af3b5-ba51-4527-a453-7eaea41523da admin admin] PATH_INFO: `/v3/projects/e1dc5e20d199461eb674a0b5dc8d66ef/users/b13cd0222e264cc8b6212b7c3ce9efb8/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.359717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347af3b5-ba51-4527-a453-7eaea41523da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1dc5e20d199461eb674a0b5dc8d66ef, user_id=b13cd0222e264cc8b6212b7c3ce9efb8, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:18.362564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347af3b5-ba51-4527-a453-7eaea41523da admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:18.363224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ad508-00b9-4e66-9d39-b8a6f07b098e None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:18.367645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd69db2-c616-4c65-86ae-f45ea063ee42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:18.368302 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd69db2-c616-4c65-86ae-f45ea063ee42 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.368599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd69db2-c616-4c65-86ae-f45ea063ee42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.368958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd69db2-c616-4c65-86ae-f45ea063ee42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.377415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 792/1610] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:18 2022] PUT /identity/v3/projects/e1dc5e20d199461eb674a0b5dc8d66ef/users/b13cd0222e264cc8b6212b7c3ce9efb8/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:18.378966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41bd10-919d-4ed8-8926-cbbcecff4a9b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.379399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41bd10-919d-4ed8-8926-cbbcecff4a9b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.379818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41bd10-919d-4ed8-8926-cbbcecff4a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.383585 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd69db2-c616-4c65-86ae-f45ea063ee42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:18.385336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd69db2-c616-4c65-86ae-f45ea063ee42 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:18.397061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 819/1611] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:18.398568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b73cc-4799-4afe-a3bf-acc913a296e4 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.398930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b73cc-4799-4afe-a3bf-acc913a296e4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.399413 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b73cc-4799-4afe-a3bf-acc913a296e4 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.406121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 820/1612] 10.222.0.33 () {54 vars in 962 bytes} [Mon Sep 12 23:28:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:28:18.407111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b73cc-4799-4afe-a3bf-acc913a296e4 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:18.408602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bc41bd10-919d-4ed8-8926-cbbcecff4a9b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:18.410565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bc41bd10-919d-4ed8-8926-cbbcecff4a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:18.477010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b73cc-4799-4afe-a3bf-acc913a296e4 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:18.484923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3dcf9-9155-4e13-8f7c-fa15554881fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:18.485716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3dcf9-9155-4e13-8f7c-fa15554881fa service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.486075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3dcf9-9155-4e13-8f7c-fa15554881fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.486440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3dcf9-9155-4e13-8f7c-fa15554881fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.509206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 793/1613] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:18.510193 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41bd10-919d-4ed8-8926-cbbcecff4a9b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:18.515687 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:18.584223 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41bd10-919d-4ed8-8926-cbbcecff4a9b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:18.584529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:18.589291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b459a-44bd-40ca-9726-ec4168610053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:18.590978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b459a-44bd-40ca-9726-ec4168610053 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.591273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b459a-44bd-40ca-9726-ec4168610053 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.591532 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b459a-44bd-40ca-9726-ec4168610053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.592010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3dcf9-9155-4e13-8f7c-fa15554881fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:18.594434 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3dcf9-9155-4e13-8f7c-fa15554881fa service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:18.607646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 821/1614] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:18.608901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3dcf9-9155-4e13-8f7c-fa15554881fa service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:18.625726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3dcf9-9155-4e13-8f7c-fa15554881fa service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:18.640163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1e5f2-1e15-4f31-9558-9cc6b4ade8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:18.641105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1e5f2-1e15-4f31-9558-9cc6b4ade8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.642139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1e5f2-1e15-4f31-9558-9cc6b4ade8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.642591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1e5f2-1e15-4f31-9558-9cc6b4ade8b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.643452 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1e5f2-1e15-4f31-9558-9cc6b4ade8b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:18.648603 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1e5f2-1e15-4f31-9558-9cc6b4ade8b0 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:18.673861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b459a-44bd-40ca-9726-ec4168610053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:18.676119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b459a-44bd-40ca-9726-ec4168610053 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:18.700512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 822/1615] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:18 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:18.702000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 794/1616] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:18.704438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2a531-d3e7-4a91-99b4-f24ceaedf013 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.705371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feb901-1a02-4f2b-84c5-8e810beea537 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.705799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2a531-d3e7-4a91-99b4-f24ceaedf013 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.706251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feb901-1a02-4f2b-84c5-8e810beea537 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.706523 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feb901-1a02-4f2b-84c5-8e810beea537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.709561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2a531-d3e7-4a91-99b4-f24ceaedf013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.744163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0de2a531-d3e7-4a91-99b4-f24ceaedf013 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:18.745446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0de2a531-d3e7-4a91-99b4-f24ceaedf013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:18.785979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-86feb901-1a02-4f2b-84c5-8e810beea537 None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:18.787656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-86feb901-1a02-4f2b-84c5-8e810beea537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:18.896964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 795/1617] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:18.898702 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2a531-d3e7-4a91-99b4-f24ceaedf013 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:18.927476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 823/1618] 10.222.0.33 () {58 vars in 1059 bytes} [Mon Sep 12 23:28:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:18.928508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feb901-1a02-4f2b-84c5-8e810beea537 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:18.942530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feb901-1a02-4f2b-84c5-8e810beea537 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:18.951358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9a4be-25a5-422e-aac0-5da570a49926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:18.952736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9a4be-25a5-422e-aac0-5da570a49926 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.952736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9a4be-25a5-422e-aac0-5da570a49926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.953373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9a4be-25a5-422e-aac0-5da570a49926 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:18.954186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9a4be-25a5-422e-aac0-5da570a49926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:18.956520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9a4be-25a5-422e-aac0-5da570a49926 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:18.987797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2a531-d3e7-4a91-99b4-f24ceaedf013 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:18.997287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0ae5-40cd-4622-babd-705d755eeae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:18.997287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0ae5-40cd-4622-babd-705d755eeae2 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:18.997287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0ae5-40cd-4622-babd-705d755eeae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:18.998473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0ae5-40cd-4622-babd-705d755eeae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:19.004202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 824/1619] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:18 2022] POST /identity/v3/users => generated 289 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:19.005237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9a4be-25a5-422e-aac0-5da570a49926 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:19.012442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0ae5-40cd-4622-babd-705d755eeae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:19.014617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0ae5-40cd-4622-babd-705d755eeae2 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:19.022095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:19.029422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 796/1620] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:19.030730 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0ae5-40cd-4622-babd-705d755eeae2 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:19.044215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9a4be-25a5-422e-aac0-5da570a49926 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:19.046045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0ae5-40cd-4622-babd-705d755eeae2 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:19.049869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331df22f-066a-4894-82d8-9fab1c7ad5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:19.050506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331df22f-066a-4894-82d8-9fab1c7ad5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:19.050819 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331df22f-066a-4894-82d8-9fab1c7ad5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:19.051774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331df22f-066a-4894-82d8-9fab1c7ad5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:19.053183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7533a-e82c-4e0e-b893-8d7e6a3b977f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:19.053955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7533a-e82c-4e0e-b893-8d7e6a3b977f service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:19.054334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7533a-e82c-4e0e-b893-8d7e6a3b977f service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:19.054706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7533a-e82c-4e0e-b893-8d7e6a3b977f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:19.069669 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331df22f-066a-4894-82d8-9fab1c7ad5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:19.072128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331df22f-066a-4894-82d8-9fab1c7ad5d0 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:19.085300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 825/1621] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:19.086697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331df22f-066a-4894-82d8-9fab1c7ad5d0 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:19.097408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331df22f-066a-4894-82d8-9fab1c7ad5d0 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:19.104159 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca03e94-a77c-426e-8e5f-ed685552d9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:19.104781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03e94-a77c-426e-8e5f-ed685552d9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:19.105062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03e94-a77c-426e-8e5f-ed685552d9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:19.105339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03e94-a77c-426e-8e5f-ed685552d9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:19.106940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca03e94-a77c-426e-8e5f-ed685552d9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:19.108745 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca03e94-a77c-426e-8e5f-ed685552d9c5 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:19.139521 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 826/1622] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:19.140714 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca03e94-a77c-426e-8e5f-ed685552d9c5 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:19.183169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca03e94-a77c-426e-8e5f-ed685552d9c5 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:19.192916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af6d97-7c91-4682-b08c-74a72aab28ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:19.194247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af6d97-7c91-4682-b08c-74a72aab28ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:19.194988 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af6d97-7c91-4682-b08c-74a72aab28ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:19.195834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af6d97-7c91-4682-b08c-74a72aab28ca admin admin] PATH_INFO: `/v3/projects/df0e8b855d754967a7e5fa5962fb3c58/users/2dc5bedda3484df0aebb635e79a7fe3c/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:19.204763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7533a-e82c-4e0e-b893-8d7e6a3b977f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:19.206422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7533a-e82c-4e0e-b893-8d7e6a3b977f service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:19.224266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af6d97-7c91-4682-b08c-74a72aab28ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0e8b855d754967a7e5fa5962fb3c58, user_id=2dc5bedda3484df0aebb635e79a7fe3c, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:19.228715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af6d97-7c91-4682-b08c-74a72aab28ca admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:19.233849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 797/1623] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:19.254931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 827/1624] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:19 2022] PUT /identity/v3/projects/df0e8b855d754967a7e5fa5962fb3c58/users/2dc5bedda3484df0aebb635e79a7fe3c/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:19.255903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7533a-e82c-4e0e-b893-8d7e6a3b977f service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:19.272672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7533a-e82c-4e0e-b893-8d7e6a3b977f service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:19.462779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cee90a-0733-477f-be89-56f270a0776a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:19.463893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cee90a-0733-477f-be89-56f270a0776a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:19.466233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cee90a-0733-477f-be89-56f270a0776a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:19.466967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cee90a-0733-477f-be89-56f270a0776a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:19.467644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cee90a-0733-477f-be89-56f270a0776a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:19.472630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cee90a-0733-477f-be89-56f270a0776a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:19.508862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af6d97-7c91-4682-b08c-74a72aab28ca admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:19.521806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 798/1625] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:19.524991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af6d97-7c91-4682-b08c-74a72aab28ca admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:19.532314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c56c9-e525-4685-a08d-f8ed6b80dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:19.532998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c56c9-e525-4685-a08d-f8ed6b80dd3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:19.533277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c56c9-e525-4685-a08d-f8ed6b80dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:19.533547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c56c9-e525-4685-a08d-f8ed6b80dd3a admin admin] PATH_INFO: `/v3/projects/df0e8b855d754967a7e5fa5962fb3c58/users/2dc5bedda3484df0aebb635e79a7fe3c/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:19.535834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c56c9-e525-4685-a08d-f8ed6b80dd3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0e8b855d754967a7e5fa5962fb3c58, user_id=2dc5bedda3484df0aebb635e79a7fe3c, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:19.539851 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c56c9-e525-4685-a08d-f8ed6b80dd3a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:19.567246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd478a-5f38-4d76-a2e3-ad0c53a2d0d2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:19.567686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd478a-5f38-4d76-a2e3-ad0c53a2d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:19.567980 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd478a-5f38-4d76-a2e3-ad0c53a2d0d2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:19.569650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 799/1627] 10.222.0.33 () {54 vars in 912 bytes} [Mon Sep 12 23:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:28:19.570837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e846bd-efc5-4e91-b857-661e3887e410 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:19.571241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e846bd-efc5-4e91-b857-661e3887e410 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:19.571579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e846bd-efc5-4e91-b857-661e3887e410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:19.574403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 828/1627] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:19 2022] PUT /identity/v3/projects/df0e8b855d754967a7e5fa5962fb3c58/users/2dc5bedda3484df0aebb635e79a7fe3c/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:19.579782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db713f3-0e6e-4b54-95a0-f54deff32221 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:19.580079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db713f3-0e6e-4b54-95a0-f54deff32221 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:19.580403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db713f3-0e6e-4b54-95a0-f54deff32221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:19.644489 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-4db713f3-0e6e-4b54-95a0-f54deff32221 None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:19.650647 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4db713f3-0e6e-4b54-95a0-f54deff32221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:19.652558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f0e846bd-efc5-4e91-b857-661e3887e410 None None] MFA Rules not processed for user `2dc5bedda3484df0aebb635e79a7fe3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:19.656238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f0e846bd-efc5-4e91-b857-661e3887e410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:19.726131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:19.861182 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 800/1628] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:19.861516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 829/1629] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:28:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:19.868871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e846bd-efc5-4e91-b857-661e3887e410 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:19.916648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:19.948399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db713f3-0e6e-4b54-95a0-f54deff32221 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:20.099503 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e846bd-efc5-4e91-b857-661e3887e410 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:20.117017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd040619-9126-4b32-94f6-fc0e359cdebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:20.120504 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd040619-9126-4b32-94f6-fc0e359cdebd service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:20.120977 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd040619-9126-4b32-94f6-fc0e359cdebd service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:20.121248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd040619-9126-4b32-94f6-fc0e359cdebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:20.161416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd040619-9126-4b32-94f6-fc0e359cdebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:20.175409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd040619-9126-4b32-94f6-fc0e359cdebd service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:20.179853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db713f3-0e6e-4b54-95a0-f54deff32221 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:20.193840 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc48473-9460-4b1f-9166-0a0f48709252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:20.195683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48473-9460-4b1f-9166-0a0f48709252 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:20.197432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48473-9460-4b1f-9166-0a0f48709252 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:20.197729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48473-9460-4b1f-9166-0a0f48709252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:20.210556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 801/1630] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:20.229142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc48473-9460-4b1f-9166-0a0f48709252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:20.230331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc48473-9460-4b1f-9166-0a0f48709252 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:20.256032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 830/1631] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:21.414607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99301e-4033-45ca-ac47-3bfb9d2895fb None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:21.415194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99301e-4033-45ca-ac47-3bfb9d2895fb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:21.415396 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99301e-4033-45ca-ac47-3bfb9d2895fb None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:21.417431 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 802/1632] 10.222.0.33 () {54 vars in 962 bytes} [Mon Sep 12 23:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:28:21.437144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78b534-e556-4c17-8362-b6cf47ee71a9 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:21.438096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78b534-e556-4c17-8362-b6cf47ee71a9 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:21.438582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78b534-e556-4c17-8362-b6cf47ee71a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:21.499757 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-8c78b534-e556-4c17-8362-b6cf47ee71a9 None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:21.510569 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8c78b534-e556-4c17-8362-b6cf47ee71a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:21.552078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 831/1633] 10.222.0.33 () {58 vars in 1059 bytes} [Mon Sep 12 23:28:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:21.558564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917d9d9-e2c3-4f62-af73-8cfefb0dceef None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:21.559123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917d9d9-e2c3-4f62-af73-8cfefb0dceef None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:21.559585 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917d9d9-e2c3-4f62-af73-8cfefb0dceef None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:21.561465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 803/1634] 10.222.0.33 () {54 vars in 912 bytes} [Mon Sep 12 23:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:28:21.567046 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cd237-2bf2-48e0-a4fe-a0c4441a291d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:21.567336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cd237-2bf2-48e0-a4fe-a0c4441a291d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:21.567611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cd237-2bf2-48e0-a4fe-a0c4441a291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:21.587181 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917d9d9-e2c3-4f62-af73-8cfefb0dceef None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:21.618707 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-884cd237-2bf2-48e0-a4fe-a0c4441a291d None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:21.620945 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-884cd237-2bf2-48e0-a4fe-a0c4441a291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:21.645598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 832/1635] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:28:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:21.660691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cd237-2bf2-48e0-a4fe-a0c4441a291d None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:21.677073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cd237-2bf2-48e0-a4fe-a0c4441a291d None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:21.688323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f67d29-217f-4be1-b2b2-82f473683b4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:21.688962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f67d29-217f-4be1-b2b2-82f473683b4f service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:21.689241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f67d29-217f-4be1-b2b2-82f473683b4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:21.689516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f67d29-217f-4be1-b2b2-82f473683b4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:21.719584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f67d29-217f-4be1-b2b2-82f473683b4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:21.721058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f67d29-217f-4be1-b2b2-82f473683b4f service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:21.736491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917d9d9-e2c3-4f62-af73-8cfefb0dceef None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:21.752403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 833/1636] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:28:21.767249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:21.769144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:21.770536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:21.771680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] PATH_INFO: `/v3/users/5e09fe95c387440cb7c7dd437a290c26` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:21.778860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e09fe95c387440cb7c7dd437a290c26)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:21.789970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:21.932420 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e09fe95c387440cb7c7dd437a290c26'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:21.956001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e09fe95c387440cb7c7dd437a290c26'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:21.994666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e09fe95c387440cb7c7dd437a290c26'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:21.995863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e09fe95c387440cb7c7dd437a290c26'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:21.997892 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e09fe95c387440cb7c7dd437a290c26'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:22.055199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 804/1637] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:21 2022] DELETE /identity/v3/users/5e09fe95c387440cb7c7dd437a290c26 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:28:22.057073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7260ff6-02cc-48eb-82fc-8db375752b8f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:22.057073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7260ff6-02cc-48eb-82fc-8db375752b8f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:22.057073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7260ff6-02cc-48eb-82fc-8db375752b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:22.083829 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b7260ff6-02cc-48eb-82fc-8db375752b8f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:22.085072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b7260ff6-02cc-48eb-82fc-8db375752b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:22.279806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 834/1638] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:22.321073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:22.323007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:22.456710 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:22.486570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb7a98-7f05-4490-8861-eec2eb3ffb5d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:22.504061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91df3d-ea4e-4cd9-8bb3-9633d533cd10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:22.504772 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91df3d-ea4e-4cd9-8bb3-9633d533cd10 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:22.504985 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91df3d-ea4e-4cd9-8bb3-9633d533cd10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:22.505438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91df3d-ea4e-4cd9-8bb3-9633d533cd10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:22.535417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91df3d-ea4e-4cd9-8bb3-9633d533cd10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:22.537073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91df3d-ea4e-4cd9-8bb3-9633d533cd10 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:22.559972 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 805/1639] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:22.825447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca173a7-a309-4bc9-aad2-15e24ad3cba8 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:22.826148 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca173a7-a309-4bc9-aad2-15e24ad3cba8 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:22.826148 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca173a7-a309-4bc9-aad2-15e24ad3cba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:22.921290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-fca173a7-a309-4bc9-aad2-15e24ad3cba8 None None] MFA Rules not processed for user `dd785c60fff444d1ac6e51210bd60288`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:22.923069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-fca173a7-a309-4bc9-aad2-15e24ad3cba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:23.006770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:23.090679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 835/1640] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:22 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:23.095722 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91df3d-ea4e-4cd9-8bb3-9633d533cd10 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:23.097888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6a91df3d-ea4e-4cd9-8bb3-9633d533cd10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:23.124351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91df3d-ea4e-4cd9-8bb3-9633d533cd10 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:23.132603 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983e6d9-54c6-4684-b157-f986b3904e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:23.133289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983e6d9-54c6-4684-b157-f986b3904e3c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:23.133733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983e6d9-54c6-4684-b157-f986b3904e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:23.134156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983e6d9-54c6-4684-b157-f986b3904e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:23.135090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983e6d9-54c6-4684-b157-f986b3904e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:23.137579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983e6d9-54c6-4684-b157-f986b3904e3c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:23.199133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 806/1641] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:23 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:23.200659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca173a7-a309-4bc9-aad2-15e24ad3cba8 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:23.213766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca173a7-a309-4bc9-aad2-15e24ad3cba8 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:23.300753 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb4a51-7053-484c-a59b-747cd031c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:23.315448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb4a51-7053-484c-a59b-747cd031c15a admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:23.316457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb4a51-7053-484c-a59b-747cd031c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:23.316886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb4a51-7053-484c-a59b-747cd031c15a admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:23.319132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb4a51-7053-484c-a59b-747cd031c15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:23.321441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb4a51-7053-484c-a59b-747cd031c15a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:23.358065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 836/1642] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:23 2022] POST /identity/v3/users => generated 308 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:28:23.365043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983e6d9-54c6-4684-b157-f986b3904e3c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:23.392907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983e6d9-54c6-4684-b157-f986b3904e3c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:23.419856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adf997-ebc7-471c-92bb-dfe77a53b9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:23.420503 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adf997-ebc7-471c-92bb-dfe77a53b9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:23.420784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adf997-ebc7-471c-92bb-dfe77a53b9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:23.421060 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adf997-ebc7-471c-92bb-dfe77a53b9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:23.421719 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adf997-ebc7-471c-92bb-dfe77a53b9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:23.423437 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adf997-ebc7-471c-92bb-dfe77a53b9e4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:23.451770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb4a51-7053-484c-a59b-747cd031c15a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:23.453865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 807/1643] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:23.473219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb4a51-7053-484c-a59b-747cd031c15a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:23.479734 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d245b5d-63f0-4fe9-86a7-97c98eea700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:23.480431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d245b5d-63f0-4fe9-86a7-97c98eea700e admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:23.481134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d245b5d-63f0-4fe9-86a7-97c98eea700e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:23.481526 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d245b5d-63f0-4fe9-86a7-97c98eea700e admin admin] PATH_INFO: `/v3/projects/2a0fd9f809864e6e98da609125c6ab30/users/347008014350466083ea33542f0affac/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:23.534065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d245b5d-63f0-4fe9-86a7-97c98eea700e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0fd9f809864e6e98da609125c6ab30, user_id=347008014350466083ea33542f0affac, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:23.543547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d245b5d-63f0-4fe9-86a7-97c98eea700e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:23.578950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 837/1644] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:23 2022] PUT /identity/v3/projects/2a0fd9f809864e6e98da609125c6ab30/users/347008014350466083ea33542f0affac/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:23.582982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adf997-ebc7-471c-92bb-dfe77a53b9e4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:23.609905 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adf997-ebc7-471c-92bb-dfe77a53b9e4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:23.764936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513abde7-49bd-471b-82f7-d796689de356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:23.765590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513abde7-49bd-471b-82f7-d796689de356 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:23.765875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513abde7-49bd-471b-82f7-d796689de356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:23.768350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513abde7-49bd-471b-82f7-d796689de356 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:23.769049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513abde7-49bd-471b-82f7-d796689de356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:23.773249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513abde7-49bd-471b-82f7-d796689de356 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:23.806365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 808/1645] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:23.806910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d245b5d-63f0-4fe9-86a7-97c98eea700e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:23.821216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d245b5d-63f0-4fe9-86a7-97c98eea700e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:23.838930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ce187-093a-44e0-913d-24673ad31a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:23.839732 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce187-093a-44e0-913d-24673ad31a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:23.840215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce187-093a-44e0-913d-24673ad31a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:23.840595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce187-093a-44e0-913d-24673ad31a96 admin admin] PATH_INFO: `/v3/projects/2a0fd9f809864e6e98da609125c6ab30/users/347008014350466083ea33542f0affac/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:23.847632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ce187-093a-44e0-913d-24673ad31a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0fd9f809864e6e98da609125c6ab30, user_id=347008014350466083ea33542f0affac, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:23.855436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ce187-093a-44e0-913d-24673ad31a96 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:23.877381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 838/1646] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:23 2022] PUT /identity/v3/projects/2a0fd9f809864e6e98da609125c6ab30/users/347008014350466083ea33542f0affac/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:24.257289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513abde7-49bd-471b-82f7-d796689de356 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:24.259419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-513abde7-49bd-471b-82f7-d796689de356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:24.298633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513abde7-49bd-471b-82f7-d796689de356 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:24.416039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:24.417975 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:24.419793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:24.420223 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] PATH_INFO: `/v3/projects/70f3698787d64e4394403deab174f397` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:24.421710 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f3698787d64e4394403deab174f397)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:24.423488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:28:24.423488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 12 23:28:24.423488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: Sep 12 23:28:24.426455 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:24.536617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f3698787d64e4394403deab174f397', 'request_id': 'req-9a4c1083-9dba-4d65-95ae-641ef43dde8d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:24.538964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:24.553991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f3698787d64e4394403deab174f397', 'request_id': 'req-9a4c1083-9dba-4d65-95ae-641ef43dde8d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:24.604989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f3698787d64e4394403deab174f397', 'request_id': 'req-9a4c1083-9dba-4d65-95ae-641ef43dde8d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:24.643611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] The token cache is being invalidate because project 70f3698787d64e4394403deab174f397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:28:24.644334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:24.650408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:24.656750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 809/1647] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:28:24 2022] DELETE /identity/v3/projects/70f3698787d64e4394403deab174f397 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:24.661167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ce187-093a-44e0-913d-24673ad31a96 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:24.663180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2a2ce187-093a-44e0-913d-24673ad31a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:24.691773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ce187-093a-44e0-913d-24673ad31a96 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:24.823580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fa161-dc7c-4049-8d00-40349024b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:24.824876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa161-dc7c-4049-8d00-40349024b38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:24.825595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa161-dc7c-4049-8d00-40349024b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:24.826541 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa161-dc7c-4049-8d00-40349024b38b admin admin] PATH_INFO: `/v3/users/2dc5bedda3484df0aebb635e79a7fe3c` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:24.830059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fa161-dc7c-4049-8d00-40349024b38b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc5bedda3484df0aebb635e79a7fe3c)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:24.835249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: WARNING py.warnings [None req-849fa161-dc7c-4049-8d00-40349024b38b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:28:24.835249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: warnings.warn(msg) Sep 12 23:28:24.835249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: Sep 12 23:28:24.837087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fa161-dc7c-4049-8d00-40349024b38b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:24.923411 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:24.964635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-849fa161-dc7c-4049-8d00-40349024b38b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc5bedda3484df0aebb635e79a7fe3c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:24.984613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-849fa161-dc7c-4049-8d00-40349024b38b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc5bedda3484df0aebb635e79a7fe3c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:25.011867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-849fa161-dc7c-4049-8d00-40349024b38b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc5bedda3484df0aebb635e79a7fe3c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:25.013179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-849fa161-dc7c-4049-8d00-40349024b38b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc5bedda3484df0aebb635e79a7fe3c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:25.014035 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-849fa161-dc7c-4049-8d00-40349024b38b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc5bedda3484df0aebb635e79a7fe3c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:25.042299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 839/1648] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:24 2022] DELETE /identity/v3/users/2dc5bedda3484df0aebb635e79a7fe3c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:26.200935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:26.218170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c1083-9dba-4d65-95ae-641ef43dde8d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:26.385973 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:26.388112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:26.388571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:26.389144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa admin admin] PATH_INFO: `/v3/projects/df0e8b855d754967a7e5fa5962fb3c58` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:26.390750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0e8b855d754967a7e5fa5962fb3c58)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:26.393762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:26.495455 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0e8b855d754967a7e5fa5962fb3c58', 'request_id': 'req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:26.515629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0e8b855d754967a7e5fa5962fb3c58', 'request_id': 'req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:26.525143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0e8b855d754967a7e5fa5962fb3c58', 'request_id': 'req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:26.560014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1304c67-918d-4339-8f80-ae61c072371a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:26.560536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1304c67-918d-4339-8f80-ae61c072371a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:26.560630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa admin admin] The token cache is being invalidate because project df0e8b855d754967a7e5fa5962fb3c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:28:26.560707 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1304c67-918d-4339-8f80-ae61c072371a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:26.560799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:26.562427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-97aa9f50-62aa-4ce2-8d11-1cfecba9a6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:26.572142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 810/1649] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:28:26 2022] DELETE /identity/v3/projects/df0e8b855d754967a7e5fa5962fb3c58 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:26.574290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf68be6-4e45-4614-9b1b-9443cf8140fe None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:26.575269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf68be6-4e45-4614-9b1b-9443cf8140fe None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:26.575784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf68be6-4e45-4614-9b1b-9443cf8140fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:26.628547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-baf68be6-4e45-4614-9b1b-9443cf8140fe None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:26.631996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-baf68be6-4e45-4614-9b1b-9443cf8140fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:26.688414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-d1304c67-918d-4339-8f80-ae61c072371a None None] MFA Rules not processed for user `a0ada49dfcb54b2b8e551e9d89f831a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:26.692449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d1304c67-918d-4339-8f80-ae61c072371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:26.736192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 811/1650] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:28:26.740639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53be5b-0402-4a83-98e1-5550f00dea7d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:26.742073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53be5b-0402-4a83-98e1-5550f00dea7d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:26.742566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53be5b-0402-4a83-98e1-5550f00dea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:26.793689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8e53be5b-0402-4a83-98e1-5550f00dea7d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:26.795523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8e53be5b-0402-4a83-98e1-5550f00dea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:26.818902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 812/1651] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:26.821310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53be5b-0402-4a83-98e1-5550f00dea7d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:26.831882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:26.844133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53be5b-0402-4a83-98e1-5550f00dea7d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:26.853026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4699dd-1fcb-4a08-b918-c0a5c3f96207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:26.853723 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4699dd-1fcb-4a08-b918-c0a5c3f96207 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:26.853996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4699dd-1fcb-4a08-b918-c0a5c3f96207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:26.854269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4699dd-1fcb-4a08-b918-c0a5c3f96207 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:26.855038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4699dd-1fcb-4a08-b918-c0a5c3f96207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:26.855353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4699dd-1fcb-4a08-b918-c0a5c3f96207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:26.857770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4699dd-1fcb-4a08-b918-c0a5c3f96207 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:26.888283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 813/1652] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:28:26.889005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4699dd-1fcb-4a08-b918-c0a5c3f96207 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:26.892628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2d4699dd-1fcb-4a08-b918-c0a5c3f96207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:26.906107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 840/1653] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:26.907606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1304c67-918d-4339-8f80-ae61c072371a None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:26.919876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4699dd-1fcb-4a08-b918-c0a5c3f96207 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:26.926863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:26.927907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:26.927907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:26.928411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] PATH_INFO: `/v3/users/8772fcbb3a594f008b053d8da15f2efa` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:26.929720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8772fcbb3a594f008b053d8da15f2efa)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:26.932499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:26.950368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1304c67-918d-4339-8f80-ae61c072371a None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:26.955582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66066fb-33e8-40d4-90e6-e0d15dbd3f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:26.956442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66066fb-33e8-40d4-90e6-e0d15dbd3f32 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:26.956909 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66066fb-33e8-40d4-90e6-e0d15dbd3f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:26.957376 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66066fb-33e8-40d4-90e6-e0d15dbd3f32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:26.958183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66066fb-33e8-40d4-90e6-e0d15dbd3f32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:26.961884 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66066fb-33e8-40d4-90e6-e0d15dbd3f32 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:27.013377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 841/1654] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:26 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:27.015779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66066fb-33e8-40d4-90e6-e0d15dbd3f32 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:27.019788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d66066fb-33e8-40d4-90e6-e0d15dbd3f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:27.043543 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8772fcbb3a594f008b053d8da15f2efa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:27.061100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8772fcbb3a594f008b053d8da15f2efa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:27.088165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8772fcbb3a594f008b053d8da15f2efa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:27.089221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8772fcbb3a594f008b053d8da15f2efa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:27.090756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8772fcbb3a594f008b053d8da15f2efa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:27.141949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 814/1655] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:26 2022] DELETE /identity/v3/users/8772fcbb3a594f008b053d8da15f2efa => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:27.143187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:27.147129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:27.158698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66066fb-33e8-40d4-90e6-e0d15dbd3f32 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:27.176535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:27.259734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29255c-57a1-44f9-8f75-91475a4607c0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:27.265866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a076cc-e459-4ca6-a82c-5658f9218e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:27.266568 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a076cc-e459-4ca6-a82c-5658f9218e02 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:27.266943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a076cc-e459-4ca6-a82c-5658f9218e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:27.267316 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a076cc-e459-4ca6-a82c-5658f9218e02 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:27.268170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a076cc-e459-4ca6-a82c-5658f9218e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:27.270911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a076cc-e459-4ca6-a82c-5658f9218e02 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:27.303030 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a4106-407a-465c-94a7-8ba112411b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:27.303959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4106-407a-465c-94a7-8ba112411b70 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:27.304446 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4106-407a-465c-94a7-8ba112411b70 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:27.304864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4106-407a-465c-94a7-8ba112411b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:27.306974 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-590a4106-407a-465c-94a7-8ba112411b70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:27.314174 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 815/1656] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:27 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:27.319043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafe331-5ab1-47db-bfed-fd0ce00d6c81 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:27.320706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafe331-5ab1-47db-bfed-fd0ce00d6c81 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:27.321111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafe331-5ab1-47db-bfed-fd0ce00d6c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:27.367751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6fafe331-5ab1-47db-bfed-fd0ce00d6c81 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:27.369133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6fafe331-5ab1-47db-bfed-fd0ce00d6c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:27.384701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 816/1657] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:27.385990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470e4f6-dd9d-4402-abf3-fb134fa89a10 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:27.386275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470e4f6-dd9d-4402-abf3-fb134fa89a10 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:27.386557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470e4f6-dd9d-4402-abf3-fb134fa89a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:27.435482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a4106-407a-465c-94a7-8ba112411b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:27.437123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a4106-407a-465c-94a7-8ba112411b70 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:27.452090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 842/1658] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:27.452969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a4106-407a-465c-94a7-8ba112411b70 service nova] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:27.465414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a4106-407a-465c-94a7-8ba112411b70 service nova] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:27.465994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2470e4f6-dd9d-4402-abf3-fb134fa89a10 None None] MFA Rules not processed for user `347008014350466083ea33542f0affac`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:27.467271 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2470e4f6-dd9d-4402-abf3-fb134fa89a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:27.471609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fb20a-8521-4c7b-93ea-b05589143629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:27.472233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fb20a-8521-4c7b-93ea-b05589143629 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:27.472510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fb20a-8521-4c7b-93ea-b05589143629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:27.472779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fb20a-8521-4c7b-93ea-b05589143629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:27.473517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fb20a-8521-4c7b-93ea-b05589143629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:27.475805 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fb20a-8521-4c7b-93ea-b05589143629 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:27.491920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 843/1659] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:27.492860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fb20a-8521-4c7b-93ea-b05589143629 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:27.494835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ec0fb20a-8521-4c7b-93ea-b05589143629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:27.584058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:27.672987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fb20a-8521-4c7b-93ea-b05589143629 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:27.688389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b3fdd-feb8-4399-bebb-fb2427a15ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:27.689097 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b3fdd-feb8-4399-bebb-fb2427a15ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:27.689377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b3fdd-feb8-4399-bebb-fb2427a15ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:27.689646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b3fdd-feb8-4399-bebb-fb2427a15ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:27.722203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 817/1660] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:27 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:27.722203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470e4f6-dd9d-4402-abf3-fb134fa89a10 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:27.722497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b3fdd-feb8-4399-bebb-fb2427a15ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:27.722497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b3fdd-feb8-4399-bebb-fb2427a15ea1 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:27.744187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 844/1661] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:27.745427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470e4f6-dd9d-4402-abf3-fb134fa89a10 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:27.763275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd80cb4-36cf-455b-8193-ceb013aa7d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:27.763936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd80cb4-36cf-455b-8193-ceb013aa7d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:27.764225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd80cb4-36cf-455b-8193-ceb013aa7d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:27.764505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd80cb4-36cf-455b-8193-ceb013aa7d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:27.765260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd80cb4-36cf-455b-8193-ceb013aa7d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:27.767241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd80cb4-36cf-455b-8193-ceb013aa7d47 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:27.792579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 818/1662] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:27.794733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b3fdd-feb8-4399-bebb-fb2427a15ea1 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:27.805036 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b3fdd-feb8-4399-bebb-fb2427a15ea1 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:27.825247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd658732-fdd1-42ab-89ca-839f3e68311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:27.826011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658732-fdd1-42ab-89ca-839f3e68311f admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:27.826276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658732-fdd1-42ab-89ca-839f3e68311f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:27.826578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658732-fdd1-42ab-89ca-839f3e68311f admin admin] PATH_INFO: `/v3/projects/61edf81b88c54fd498630bf32cf6c28c/users/bc78a6f2bc4743fe8a276911af47869b/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:27.857699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd658732-fdd1-42ab-89ca-839f3e68311f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61edf81b88c54fd498630bf32cf6c28c, user_id=bc78a6f2bc4743fe8a276911af47869b, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:27.860237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd658732-fdd1-42ab-89ca-839f3e68311f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:27.905966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 845/1663] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:27 2022] PUT /identity/v3/projects/61edf81b88c54fd498630bf32cf6c28c/users/bc78a6f2bc4743fe8a276911af47869b/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:27.916175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cc866-b042-458e-b96f-89898fe46054 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:27.916726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cc866-b042-458e-b96f-89898fe46054 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:27.917009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cc866-b042-458e-b96f-89898fe46054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:27.975676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-aa7cc866-b042-458e-b96f-89898fe46054 None None] MFA Rules not processed for user `bc78a6f2bc4743fe8a276911af47869b`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:27.977086 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aa7cc866-b042-458e-b96f-89898fe46054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:28.155473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 819/1664] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:28.159851 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd658732-fdd1-42ab-89ca-839f3e68311f admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:28.201872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:28.303261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd658732-fdd1-42ab-89ca-839f3e68311f admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:28.323283 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d341a4-777a-4fbc-9a21-5670e62833e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:28.323919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d341a4-777a-4fbc-9a21-5670e62833e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:28.324196 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d341a4-777a-4fbc-9a21-5670e62833e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:28.325055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d341a4-777a-4fbc-9a21-5670e62833e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:28.325641 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d341a4-777a-4fbc-9a21-5670e62833e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:28.327846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d341a4-777a-4fbc-9a21-5670e62833e8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:28.395508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 846/1665] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:28 2022] POST /identity/v3/projects => generated 367 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:28.399647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cc866-b042-458e-b96f-89898fe46054 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:28.423342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cc866-b042-458e-b96f-89898fe46054 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:28.634458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091eb285-8c7b-4d26-b811-2a3ec82f6c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:28.639009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091eb285-8c7b-4d26-b811-2a3ec82f6c6e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:28.640683 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091eb285-8c7b-4d26-b811-2a3ec82f6c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:28.641359 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091eb285-8c7b-4d26-b811-2a3ec82f6c6e admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:28.645203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091eb285-8c7b-4d26-b811-2a3ec82f6c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:28.649337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091eb285-8c7b-4d26-b811-2a3ec82f6c6e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:28.697509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 820/1666] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:28 2022] POST /identity/v3/users => generated 290 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:28.700435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d341a4-777a-4fbc-9a21-5670e62833e8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:28.716376 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d341a4-777a-4fbc-9a21-5670e62833e8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:28.728827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ea7c3-61d0-43cc-be04-c1f0cab15c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:28.729518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ea7c3-61d0-43cc-be04-c1f0cab15c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:28.729796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ea7c3-61d0-43cc-be04-c1f0cab15c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:28.730065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ea7c3-61d0-43cc-be04-c1f0cab15c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:28.732008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ea7c3-61d0-43cc-be04-c1f0cab15c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:28.749329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ea7c3-61d0-43cc-be04-c1f0cab15c07 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:28.832449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091eb285-8c7b-4d26-b811-2a3ec82f6c6e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:28.834976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 847/1667] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:28.881399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091eb285-8c7b-4d26-b811-2a3ec82f6c6e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:28.905840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d05ab-236e-41c7-83f1-90b2add704dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:28.912082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d05ab-236e-41c7-83f1-90b2add704dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:28.912543 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d05ab-236e-41c7-83f1-90b2add704dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:28.913425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d05ab-236e-41c7-83f1-90b2add704dd admin admin] PATH_INFO: `/v3/projects/518e2f23d3f141518d74d0add7fba505/users/8eab955aad1d4c89992407c05f3fdeab/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:28.968549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d05ab-236e-41c7-83f1-90b2add704dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=518e2f23d3f141518d74d0add7fba505, user_id=8eab955aad1d4c89992407c05f3fdeab, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:28.972051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d05ab-236e-41c7-83f1-90b2add704dd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:29.001766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 821/1668] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:28 2022] PUT /identity/v3/projects/518e2f23d3f141518d74d0add7fba505/users/8eab955aad1d4c89992407c05f3fdeab/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:29.005744 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ea7c3-61d0-43cc-be04-c1f0cab15c07 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:29.024079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ea7c3-61d0-43cc-be04-c1f0cab15c07 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:29.261124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629499a5-418c-4f99-8eef-118b1d5d5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:29.262307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629499a5-418c-4f99-8eef-118b1d5d5da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:29.262755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629499a5-418c-4f99-8eef-118b1d5d5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:29.263151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629499a5-418c-4f99-8eef-118b1d5d5da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:29.264317 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629499a5-418c-4f99-8eef-118b1d5d5da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:29.266126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629499a5-418c-4f99-8eef-118b1d5d5da7 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:29.300816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 848/1669] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:28:29.305631 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d05ab-236e-41c7-83f1-90b2add704dd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:29.319768 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d05ab-236e-41c7-83f1-90b2add704dd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:29.334787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fff10-ccdc-41b6-958a-559fed0cd702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:29.338786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fff10-ccdc-41b6-958a-559fed0cd702 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:29.339671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fff10-ccdc-41b6-958a-559fed0cd702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:29.340555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fff10-ccdc-41b6-958a-559fed0cd702 admin admin] PATH_INFO: `/v3/projects/518e2f23d3f141518d74d0add7fba505/users/8eab955aad1d4c89992407c05f3fdeab/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:29.347227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fff10-ccdc-41b6-958a-559fed0cd702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=518e2f23d3f141518d74d0add7fba505, user_id=8eab955aad1d4c89992407c05f3fdeab, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:29.359837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fff10-ccdc-41b6-958a-559fed0cd702 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:29.380433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:29.391781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 822/1670] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:29 2022] PUT /identity/v3/projects/518e2f23d3f141518d74d0add7fba505/users/8eab955aad1d4c89992407c05f3fdeab/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:28:29.402991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087918-198e-4cae-b0e9-c16d826d398c None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:29.403348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087918-198e-4cae-b0e9-c16d826d398c None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:29.403625 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087918-198e-4cae-b0e9-c16d826d398c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:29.483458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-49087918-198e-4cae-b0e9-c16d826d398c None None] MFA Rules not processed for user `8eab955aad1d4c89992407c05f3fdeab`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:29.484730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-49087918-198e-4cae-b0e9-c16d826d398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:29.660424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 849/1671] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:29.661888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fff10-ccdc-41b6-958a-559fed0cd702 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:29.663473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-312fff10-ccdc-41b6-958a-559fed0cd702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:29.673653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087918-198e-4cae-b0e9-c16d826d398c None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:29.675078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-49087918-198e-4cae-b0e9-c16d826d398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:29.696875 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:29.804415 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087918-198e-4cae-b0e9-c16d826d398c None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:29.818322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c587ce-81b8-49b9-a9e4-8dc486c6a3ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:29.818936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c587ce-81b8-49b9-a9e4-8dc486c6a3ce service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:29.819217 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c587ce-81b8-49b9-a9e4-8dc486c6a3ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:29.819492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c587ce-81b8-49b9-a9e4-8dc486c6a3ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:29.820245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fff10-ccdc-41b6-958a-559fed0cd702 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:29.836528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:29.837243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:29.837526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:29.837798 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b admin admin] PATH_INFO: `/v3/projects/6421dab1f7244d1eb80f781a71483470` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:29.840716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6421dab1f7244d1eb80f781a71483470)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:29.846456 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:29.848961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c587ce-81b8-49b9-a9e4-8dc486c6a3ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:29.850606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c587ce-81b8-49b9-a9e4-8dc486c6a3ce service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:29.873427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 850/1672] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:29.966329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6421dab1f7244d1eb80f781a71483470', 'request_id': 'req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:29.984570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6421dab1f7244d1eb80f781a71483470', 'request_id': 'req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:29.994597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6421dab1f7244d1eb80f781a71483470', 'request_id': 'req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:30.021900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b admin admin] The token cache is being invalidate because project 6421dab1f7244d1eb80f781a71483470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:28:30.023178 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:30.024114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d46a5713-3b86-40ef-8de9-4dd5d0002c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:30.035058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 823/1673] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:28:29 2022] DELETE /identity/v3/projects/6421dab1f7244d1eb80f781a71483470 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:30.045091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97435e84-1d9d-4966-ade5-e6332b93c752 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:30.045091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97435e84-1d9d-4966-ade5-e6332b93c752 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:30.045091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97435e84-1d9d-4966-ade5-e6332b93c752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:30.084595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-97435e84-1d9d-4966-ade5-e6332b93c752 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:30.086243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-97435e84-1d9d-4966-ade5-e6332b93c752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:30.253438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 851/1674] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:30.262180 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a129a-e7a8-41cb-ace2-f185b20a15d6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:30.262649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a129a-e7a8-41cb-ace2-f185b20a15d6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:30.263123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a129a-e7a8-41cb-ace2-f185b20a15d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:30.319210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2f4a129a-e7a8-41cb-ace2-f185b20a15d6 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:30.320674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2f4a129a-e7a8-41cb-ace2-f185b20a15d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:30.333173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 824/1675] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:30.337211 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97435e84-1d9d-4966-ade5-e6332b93c752 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:30.351979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97435e84-1d9d-4966-ade5-e6332b93c752 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:30.367761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe78a4-1ade-4f9e-bbdb-3b63b5daf877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:30.368739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe78a4-1ade-4f9e-bbdb-3b63b5daf877 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:30.369189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe78a4-1ade-4f9e-bbdb-3b63b5daf877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:30.369647 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe78a4-1ade-4f9e-bbdb-3b63b5daf877 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:30.374979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe78a4-1ade-4f9e-bbdb-3b63b5daf877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:30.375503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe78a4-1ade-4f9e-bbdb-3b63b5daf877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:30.377508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe78a4-1ade-4f9e-bbdb-3b63b5daf877 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:30.414860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 852/1676] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:28:30.421005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a129a-e7a8-41cb-ace2-f185b20a15d6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:30.432942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a129a-e7a8-41cb-ace2-f185b20a15d6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:30.439657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15876ee-693f-432a-b6ed-7ab4315425f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:30.441737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15876ee-693f-432a-b6ed-7ab4315425f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:30.442129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15876ee-693f-432a-b6ed-7ab4315425f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:30.443525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15876ee-693f-432a-b6ed-7ab4315425f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:30.444297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15876ee-693f-432a-b6ed-7ab4315425f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:30.454168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15876ee-693f-432a-b6ed-7ab4315425f3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:30.516991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 825/1677] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:30 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:30.520898 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe78a4-1ade-4f9e-bbdb-3b63b5daf877 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:30.535558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe78a4-1ade-4f9e-bbdb-3b63b5daf877 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:30.699574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da85a4-8222-4ef5-b38d-9879509ed5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:30.701214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da85a4-8222-4ef5-b38d-9879509ed5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:30.701504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da85a4-8222-4ef5-b38d-9879509ed5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:30.701792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da85a4-8222-4ef5-b38d-9879509ed5c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:30.702548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da85a4-8222-4ef5-b38d-9879509ed5c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:30.704495 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da85a4-8222-4ef5-b38d-9879509ed5c3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:30.793955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15876ee-693f-432a-b6ed-7ab4315425f3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:30.797391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 853/1678] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:30 2022] POST /identity/v3/users => generated 302 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:30.822777 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15876ee-693f-432a-b6ed-7ab4315425f3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:30.847241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eedc76-3b62-48f6-b83e-862bb57ff1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:30.851528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eedc76-3b62-48f6-b83e-862bb57ff1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:30.852989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eedc76-3b62-48f6-b83e-862bb57ff1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:30.853555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eedc76-3b62-48f6-b83e-862bb57ff1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:30.857495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eedc76-3b62-48f6-b83e-862bb57ff1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:30.862202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eedc76-3b62-48f6-b83e-862bb57ff1f9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:30.907172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da85a4-8222-4ef5-b38d-9879509ed5c3 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:30.916997 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 826/1679] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:28:30.924505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da85a4-8222-4ef5-b38d-9879509ed5c3 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:30.949968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f70be-e1d8-4364-8fc2-1e0988bcd66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:30.950838 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f70be-e1d8-4364-8fc2-1e0988bcd66f admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:30.951095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f70be-e1d8-4364-8fc2-1e0988bcd66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:30.951374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f70be-e1d8-4364-8fc2-1e0988bcd66f admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:30.952038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f70be-e1d8-4364-8fc2-1e0988bcd66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:30.956154 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f70be-e1d8-4364-8fc2-1e0988bcd66f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:31.011043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eedc76-3b62-48f6-b83e-862bb57ff1f9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:31.021718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 854/1680] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:31.026968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eedc76-3b62-48f6-b83e-862bb57ff1f9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:31.043754 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bb9af-ce1e-4218-bf27-d65504b2331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:31.045741 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bb9af-ce1e-4218-bf27-d65504b2331e admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:31.046197 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bb9af-ce1e-4218-bf27-d65504b2331e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:31.046653 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bb9af-ce1e-4218-bf27-d65504b2331e admin admin] PATH_INFO: `/v3/projects/874f84dbd5d54ab981987c123e1e45da/users/b9e8efe2defb4a1698adb0f4dae5b38b/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:31.084438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bb9af-ce1e-4218-bf27-d65504b2331e admin admin] RBAC: Authorizing `identity:create_grant(project_id=874f84dbd5d54ab981987c123e1e45da, user_id=b9e8efe2defb4a1698adb0f4dae5b38b, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:31.094083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bb9af-ce1e-4218-bf27-d65504b2331e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:31.134520 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 827/1681] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:31 2022] PUT /identity/v3/projects/874f84dbd5d54ab981987c123e1e45da/users/b9e8efe2defb4a1698adb0f4dae5b38b/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:31.138882 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30da890-fd96-4ea6-acc8-34d8c4698487 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:31.139356 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30da890-fd96-4ea6-acc8-34d8c4698487 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:31.139794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30da890-fd96-4ea6-acc8-34d8c4698487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:31.210658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b30da890-fd96-4ea6-acc8-34d8c4698487 None None] MFA Rules not processed for user `b9e8efe2defb4a1698adb0f4dae5b38b`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:31.213124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b30da890-fd96-4ea6-acc8-34d8c4698487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:31.224460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:31.377442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531cf3-9762-4b1a-8ab9-178eaf2bf4d5 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:31.377442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531cf3-9762-4b1a-8ab9-178eaf2bf4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:31.377442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531cf3-9762-4b1a-8ab9-178eaf2bf4d5 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:31.381632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 828/1682] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:28:31.388324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 855/1683] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:31 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:31.389796 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531cf3-9762-4b1a-8ab9-178eaf2bf4d5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:31.467272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b995-036d-4157-8c63-f1b742994e19 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:31.467585 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b995-036d-4157-8c63-f1b742994e19 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:31.467954 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b995-036d-4157-8c63-f1b742994e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:31.524460 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:31.543849 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ec05b995-036d-4157-8c63-f1b742994e19 None None] MFA Rules not processed for user `559a4af215324597b203e6866cb51fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:31.545084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ec05b995-036d-4157-8c63-f1b742994e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:31.695974 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 856/1684] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:28:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:31.714152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531cf3-9762-4b1a-8ab9-178eaf2bf4d5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:31.736446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6bf81-b3d5-4d41-830b-a779f9cc3465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:31.737516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6bf81-b3d5-4d41-830b-a779f9cc3465 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:31.737988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6bf81-b3d5-4d41-830b-a779f9cc3465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:31.738466 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6bf81-b3d5-4d41-830b-a779f9cc3465 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:31.739293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6bf81-b3d5-4d41-830b-a779f9cc3465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:31.745127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05b995-036d-4157-8c63-f1b742994e19 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:31.746963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ec05b995-036d-4157-8c63-f1b742994e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:31.747729 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6bf81-b3d5-4d41-830b-a779f9cc3465 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:31.783385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05b995-036d-4157-8c63-f1b742994e19 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:31.819044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f02670-51bf-477f-a7e1-b23932ac79a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '559a4af215324597b203e6866cb51fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:31.819689 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f02670-51bf-477f-a7e1-b23932ac79a5 service placement] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:31.819963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f02670-51bf-477f-a7e1-b23932ac79a5 service placement] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:31.820249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f02670-51bf-477f-a7e1-b23932ac79a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:31.828348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 829/1685] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:31 2022] POST /identity/v3/projects => generated 405 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:31.829896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6bf81-b3d5-4d41-830b-a779f9cc3465 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:31.832942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3ec6bf81-b3d5-4d41-830b-a779f9cc3465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:31.858204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f02670-51bf-477f-a7e1-b23932ac79a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:31.860045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f02670-51bf-477f-a7e1-b23932ac79a5 service placement] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:31.909925 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 857/1686] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:28:31.911790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f02670-51bf-477f-a7e1-b23932ac79a5 service placement] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:31.960747 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f02670-51bf-477f-a7e1-b23932ac79a5 service placement] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:31.997429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6bf81-b3d5-4d41-830b-a779f9cc3465 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:32.006116 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7c44a-d0cb-46a8-8518-b0fe3b5d2af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:32.006824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7c44a-d0cb-46a8-8518-b0fe3b5d2af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:32.007108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7c44a-d0cb-46a8-8518-b0fe3b5d2af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:32.007386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7c44a-d0cb-46a8-8518-b0fe3b5d2af7 admin admin] PATH_INFO: `/v3/users/52cd8a8425684dd49b2f134dd71ea7cc` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:32.009887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7c44a-d0cb-46a8-8518-b0fe3b5d2af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52cd8a8425684dd49b2f134dd71ea7cc)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:32.013936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7c44a-d0cb-46a8-8518-b0fe3b5d2af7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:32.190884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-67b7c44a-d0cb-46a8-8518-b0fe3b5d2af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52cd8a8425684dd49b2f134dd71ea7cc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:32.207342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9c506-c053-47de-b574-7189ba6e7a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:32.212629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9c506-c053-47de-b574-7189ba6e7a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:32.213005 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9c506-c053-47de-b574-7189ba6e7a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:32.213352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9c506-c053-47de-b574-7189ba6e7a7c admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:32.216682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9c506-c053-47de-b574-7189ba6e7a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:32.218980 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-67b7c44a-d0cb-46a8-8518-b0fe3b5d2af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52cd8a8425684dd49b2f134dd71ea7cc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:32.219906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9c506-c053-47de-b574-7189ba6e7a7c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:32.268705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-67b7c44a-d0cb-46a8-8518-b0fe3b5d2af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52cd8a8425684dd49b2f134dd71ea7cc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:32.270497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-67b7c44a-d0cb-46a8-8518-b0fe3b5d2af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52cd8a8425684dd49b2f134dd71ea7cc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:32.272086 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-67b7c44a-d0cb-46a8-8518-b0fe3b5d2af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52cd8a8425684dd49b2f134dd71ea7cc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:32.293097 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 858/1687] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:31 2022] POST /identity/v3/users => generated 309 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:32.306867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 830/1688] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:31 2022] DELETE /identity/v3/users/52cd8a8425684dd49b2f134dd71ea7cc => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:32.312202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401666f-48f8-411f-b0d4-8c484dc6fe75 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:32.312543 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401666f-48f8-411f-b0d4-8c484dc6fe75 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:32.312756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401666f-48f8-411f-b0d4-8c484dc6fe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:32.313423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9c506-c053-47de-b574-7189ba6e7a7c admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:32.321903 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-78d9c506-c053-47de-b574-7189ba6e7a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:32.365868 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9c506-c053-47de-b574-7189ba6e7a7c admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:32.411945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4401666f-48f8-411f-b0d4-8c484dc6fe75 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:32.413187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4401666f-48f8-411f-b0d4-8c484dc6fe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:32.418708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:32.493563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:32.582091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd318-4439-47c7-87d8-598aa82c960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:32.582424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd318-4439-47c7-87d8-598aa82c960a admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:32.582749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd318-4439-47c7-87d8-598aa82c960a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:32.583024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd318-4439-47c7-87d8-598aa82c960a admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:32.583688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfd318-4439-47c7-87d8-598aa82c960a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:32.585406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfd318-4439-47c7-87d8-598aa82c960a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:32.622786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 859/1689] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:32.623733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd318-4439-47c7-87d8-598aa82c960a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:32.643283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 831/1690] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:32.645290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd318-4439-47c7-87d8-598aa82c960a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:32.665136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f6d3d-bf7b-49c9-ad32-61237ae7b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:32.665865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f6d3d-bf7b-49c9-ad32-61237ae7b370 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:32.666098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f6d3d-bf7b-49c9-ad32-61237ae7b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:32.666678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f6d3d-bf7b-49c9-ad32-61237ae7b370 admin admin] PATH_INFO: `/v3/projects/7ab9d6b2b4164520bdbf4dac573c4cea/users/afe7ca93e9ec441ea9862f9e0b7598cb/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:32.706992 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f6d3d-bf7b-49c9-ad32-61237ae7b370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab9d6b2b4164520bdbf4dac573c4cea, user_id=afe7ca93e9ec441ea9862f9e0b7598cb, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:32.709825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f6d3d-bf7b-49c9-ad32-61237ae7b370 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:32.735942 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 860/1691] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:32 2022] PUT /identity/v3/projects/7ab9d6b2b4164520bdbf4dac573c4cea/users/afe7ca93e9ec441ea9862f9e0b7598cb/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:32.740051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401666f-48f8-411f-b0d4-8c484dc6fe75 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:32.756094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401666f-48f8-411f-b0d4-8c484dc6fe75 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:32.865293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edfd6a-746e-4cfd-aa42-ea8210d63baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:32.865956 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edfd6a-746e-4cfd-aa42-ea8210d63baa admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:32.866476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edfd6a-746e-4cfd-aa42-ea8210d63baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:32.866646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edfd6a-746e-4cfd-aa42-ea8210d63baa admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:32.867470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edfd6a-746e-4cfd-aa42-ea8210d63baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:32.869176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edfd6a-746e-4cfd-aa42-ea8210d63baa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:32.886670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 832/1692] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:32.890443 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f6d3d-bf7b-49c9-ad32-61237ae7b370 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:32.908860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f6d3d-bf7b-49c9-ad32-61237ae7b370 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:32.918509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ee1be-77bf-4f2c-bca4-e664a439f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:32.920037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ee1be-77bf-4f2c-bca4-e664a439f579 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:32.920936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ee1be-77bf-4f2c-bca4-e664a439f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:32.921677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ee1be-77bf-4f2c-bca4-e664a439f579 admin admin] PATH_INFO: `/v3/projects/7ab9d6b2b4164520bdbf4dac573c4cea/users/afe7ca93e9ec441ea9862f9e0b7598cb/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:32.939659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ee1be-77bf-4f2c-bca4-e664a439f579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab9d6b2b4164520bdbf4dac573c4cea, user_id=afe7ca93e9ec441ea9862f9e0b7598cb, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:32.950480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ee1be-77bf-4f2c-bca4-e664a439f579 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:32.968626 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 861/1693] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:32 2022] PUT /identity/v3/projects/7ab9d6b2b4164520bdbf4dac573c4cea/users/afe7ca93e9ec441ea9862f9e0b7598cb/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:32.979758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559027a-f732-4974-bb45-5ce9f1fe30ab None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:32.980045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559027a-f732-4974-bb45-5ce9f1fe30ab None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:32.980538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559027a-f732-4974-bb45-5ce9f1fe30ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:33.030003 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c559027a-f732-4974-bb45-5ce9f1fe30ab None None] MFA Rules not processed for user `afe7ca93e9ec441ea9862f9e0b7598cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:33.031439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c559027a-f732-4974-bb45-5ce9f1fe30ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:33.073340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ee1be-77bf-4f2c-bca4-e664a439f579 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:33.077026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7f4ee1be-77bf-4f2c-bca4-e664a439f579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:33.266633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 833/1694] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:32 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:33.279511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559027a-f732-4974-bb45-5ce9f1fe30ab None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:33.286771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c559027a-f732-4974-bb45-5ce9f1fe30ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:33.302123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ee1be-77bf-4f2c-bca4-e664a439f579 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:33.325138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68778f-6629-45e2-afab-e831eb76384a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:33.326584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68778f-6629-45e2-afab-e831eb76384a service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:33.326862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68778f-6629-45e2-afab-e831eb76384a service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:33.327129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68778f-6629-45e2-afab-e831eb76384a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:33.537257 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559027a-f732-4974-bb45-5ce9f1fe30ab None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:33.552564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166985b-3f3d-402e-8149-e7cfb284dcaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:33.564849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166985b-3f3d-402e-8149-e7cfb284dcaf service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:33.565174 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166985b-3f3d-402e-8149-e7cfb284dcaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:33.565470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166985b-3f3d-402e-8149-e7cfb284dcaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:33.576525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68778f-6629-45e2-afab-e831eb76384a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:33.577998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68778f-6629-45e2-afab-e831eb76384a service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:33.587364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:33.594161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166985b-3f3d-402e-8149-e7cfb284dcaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:33.595713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166985b-3f3d-402e-8149-e7cfb284dcaf service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:33.598632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 862/1695] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:33.601044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68778f-6629-45e2-afab-e831eb76384a service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:33.606280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8a68778f-6629-45e2-afab-e831eb76384a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:33.626589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 834/1696] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:33 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:33.655975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68778f-6629-45e2-afab-e831eb76384a service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:33.673767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:33.674117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:33.674436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:33.674843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] PATH_INFO: `/v3/users/bc78a6f2bc4743fe8a276911af47869b` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:33.676683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc78a6f2bc4743fe8a276911af47869b)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:33.680187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:33.727691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:33.797485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc78a6f2bc4743fe8a276911af47869b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:33.808339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc78a6f2bc4743fe8a276911af47869b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:33.846527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc78a6f2bc4743fe8a276911af47869b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:33.860546 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc78a6f2bc4743fe8a276911af47869b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:33.862930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc78a6f2bc4743fe8a276911af47869b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:33.888718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 863/1697] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:33 2022] DELETE /identity/v3/users/bc78a6f2bc4743fe8a276911af47869b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:33.894427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0a65d-c869-48b4-8aa6-e54ded9dc775 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:33.894933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0a65d-c869-48b4-8aa6-e54ded9dc775 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:33.895023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0a65d-c869-48b4-8aa6-e54ded9dc775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:33.925953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:33.929752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:33.952382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-01a0a65d-c869-48b4-8aa6-e54ded9dc775 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:33.955710 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-01a0a65d-c869-48b4-8aa6-e54ded9dc775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:34.103664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a5505-50d3-40c0-acdc-78f235df9350 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:34.115574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f9b94-da30-4444-8157-483e997188f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:34.116240 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f9b94-da30-4444-8157-483e997188f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:34.116877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f9b94-da30-4444-8157-483e997188f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:34.117165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f9b94-da30-4444-8157-483e997188f5 admin admin] PATH_INFO: `/v3/users/b9e8efe2defb4a1698adb0f4dae5b38b` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:34.119564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f9b94-da30-4444-8157-483e997188f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e8efe2defb4a1698adb0f4dae5b38b)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:34.141224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f9b94-da30-4444-8157-483e997188f5 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:34.149619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 835/1698] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:34.217469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f82f9b94-da30-4444-8157-483e997188f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e8efe2defb4a1698adb0f4dae5b38b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:34.226008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f82f9b94-da30-4444-8157-483e997188f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e8efe2defb4a1698adb0f4dae5b38b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:34.245186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f82f9b94-da30-4444-8157-483e997188f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e8efe2defb4a1698adb0f4dae5b38b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:34.247096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f82f9b94-da30-4444-8157-483e997188f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e8efe2defb4a1698adb0f4dae5b38b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:34.247885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f82f9b94-da30-4444-8157-483e997188f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e8efe2defb4a1698adb0f4dae5b38b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:34.252028 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0a65d-c869-48b4-8aa6-e54ded9dc775 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:34.254190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-01a0a65d-c869-48b4-8aa6-e54ded9dc775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:34.316487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 864/1699] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:33 2022] DELETE /identity/v3/users/b9e8efe2defb4a1698adb0f4dae5b38b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:34.323911 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f05005-6b55-4109-916d-904f2593b7d2 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:34.328050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f05005-6b55-4109-916d-904f2593b7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:34.335216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f05005-6b55-4109-916d-904f2593b7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:34.389855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-44f05005-6b55-4109-916d-904f2593b7d2 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:34.396370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-44f05005-6b55-4109-916d-904f2593b7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:34.431331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:34.451497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0a65d-c869-48b4-8aa6-e54ded9dc775 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:34.542510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 865/1700] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:34.577226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee74461-cef6-471c-9a91-d683264e1ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:34.577863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee74461-cef6-471c-9a91-d683264e1ced service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:34.578148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee74461-cef6-471c-9a91-d683264e1ced service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:34.580082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee74461-cef6-471c-9a91-d683264e1ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:34.586189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fee74461-cef6-471c-9a91-d683264e1ced service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:34.606591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee74461-cef6-471c-9a91-d683264e1ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:34.608250 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee74461-cef6-471c-9a91-d683264e1ced service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:34.622553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 836/1701] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:34.673325 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f05005-6b55-4109-916d-904f2593b7d2 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:34.674967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-44f05005-6b55-4109-916d-904f2593b7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:34.690343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f05005-6b55-4109-916d-904f2593b7d2 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:34.694929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e78d5-6b03-4da0-981d-c3b8bb9b2990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:34.695563 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e78d5-6b03-4da0-981d-c3b8bb9b2990 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:34.695846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e78d5-6b03-4da0-981d-c3b8bb9b2990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:34.696117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e78d5-6b03-4da0-981d-c3b8bb9b2990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:34.719853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e78d5-6b03-4da0-981d-c3b8bb9b2990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:34.722781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e78d5-6b03-4da0-981d-c3b8bb9b2990 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:34.722967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb66535-65fb-4837-9d17-e01e840bc1e9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:34.722967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb66535-65fb-4837-9d17-e01e840bc1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:34.727470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb66535-65fb-4837-9d17-e01e840bc1e9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:34.727470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 837/1702] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:28:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:28:34.770314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 866/1703] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:34.820529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e78fb-80d2-46a4-baaf-2c65bded33af None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:34.820774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e78fb-80d2-46a4-baaf-2c65bded33af None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:34.821020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e78fb-80d2-46a4-baaf-2c65bded33af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:34.867093 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-861e78fb-80d2-46a4-baaf-2c65bded33af None None] MFA Rules not processed for user `559a4af215324597b203e6866cb51fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:34.868952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-861e78fb-80d2-46a4-baaf-2c65bded33af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:35.008861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:35.034026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 838/1704] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:28:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:35.072973 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e78d5-6b03-4da0-981d-c3b8bb9b2990 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:35.078740 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-392e78d5-6b03-4da0-981d-c3b8bb9b2990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:35.119866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e78d5-6b03-4da0-981d-c3b8bb9b2990 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:35.134680 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c103e79-593e-4712-8892-440ed5e5c7a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '559a4af215324597b203e6866cb51fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:35.135348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c103e79-593e-4712-8892-440ed5e5c7a1 service placement] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:35.135695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c103e79-593e-4712-8892-440ed5e5c7a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:35.135991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c103e79-593e-4712-8892-440ed5e5c7a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:35.151761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c103e79-593e-4712-8892-440ed5e5c7a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:35.153625 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c103e79-593e-4712-8892-440ed5e5c7a1 service placement] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:35.163474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e78fb-80d2-46a4-baaf-2c65bded33af None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:35.164941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-861e78fb-80d2-46a4-baaf-2c65bded33af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:35.193492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e78fb-80d2-46a4-baaf-2c65bded33af None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:35.207850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 867/1705] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:35.215885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fdd05-058b-4f4d-8573-cd18c3f7ca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:35.216516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fdd05-058b-4f4d-8573-cd18c3f7ca99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:35.216797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fdd05-058b-4f4d-8573-cd18c3f7ca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:35.217068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fdd05-058b-4f4d-8573-cd18c3f7ca99 admin admin] PATH_INFO: `/v3/projects/ab3c0950c2a04d4587340e3a16d8a720` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:35.219074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fdd05-058b-4f4d-8573-cd18c3f7ca99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3c0950c2a04d4587340e3a16d8a720)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:35.221192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fdd05-058b-4f4d-8573-cd18c3f7ca99 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:35.223604 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c103e79-593e-4712-8892-440ed5e5c7a1 service placement] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:35.227477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9c103e79-593e-4712-8892-440ed5e5c7a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:35.279184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c103e79-593e-4712-8892-440ed5e5c7a1 service placement] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:35.292748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a9bf5-1a4a-4a9d-8329-f2eedae03c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:35.293925 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a9bf5-1a4a-4a9d-8329-f2eedae03c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:35.294199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a9bf5-1a4a-4a9d-8329-f2eedae03c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:35.294493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a9bf5-1a4a-4a9d-8329-f2eedae03c71 admin admin] PATH_INFO: `/v3/users/dd785c60fff444d1ac6e51210bd60288` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:35.297325 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a9bf5-1a4a-4a9d-8329-f2eedae03c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd785c60fff444d1ac6e51210bd60288)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:35.299180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a9bf5-1a4a-4a9d-8329-f2eedae03c71 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:35.370771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-556fdd05-058b-4f4d-8573-cd18c3f7ca99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3c0950c2a04d4587340e3a16d8a720', 'request_id': 'req-556fdd05-058b-4f4d-8573-cd18c3f7ca99'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:35.384059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-556fdd05-058b-4f4d-8573-cd18c3f7ca99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3c0950c2a04d4587340e3a16d8a720', 'request_id': 'req-556fdd05-058b-4f4d-8573-cd18c3f7ca99'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:35.408744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-556fdd05-058b-4f4d-8573-cd18c3f7ca99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3c0950c2a04d4587340e3a16d8a720', 'request_id': 'req-556fdd05-058b-4f4d-8573-cd18c3f7ca99'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:35.435822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-556fdd05-058b-4f4d-8573-cd18c3f7ca99 admin admin] The token cache is being invalidate because project ab3c0950c2a04d4587340e3a16d8a720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:28:35.436398 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-556fdd05-058b-4f4d-8573-cd18c3f7ca99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:35.438993 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-556fdd05-058b-4f4d-8573-cd18c3f7ca99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:35.441433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-ef7a9bf5-1a4a-4a9d-8329-f2eedae03c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd785c60fff444d1ac6e51210bd60288'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:35.447019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 839/1706] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:28:35 2022] DELETE /identity/v3/projects/ab3c0950c2a04d4587340e3a16d8a720 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:35.451698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-ef7a9bf5-1a4a-4a9d-8329-f2eedae03c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd785c60fff444d1ac6e51210bd60288'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:35.452683 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c3a49-582f-4061-85d9-67b867ed870b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:35.453888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c3a49-582f-4061-85d9-67b867ed870b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:35.453888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c3a49-582f-4061-85d9-67b867ed870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:35.486241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-ef7a9bf5-1a4a-4a9d-8329-f2eedae03c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd785c60fff444d1ac6e51210bd60288'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:35.487122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-ef7a9bf5-1a4a-4a9d-8329-f2eedae03c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd785c60fff444d1ac6e51210bd60288'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:35.487773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-ef7a9bf5-1a4a-4a9d-8329-f2eedae03c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd785c60fff444d1ac6e51210bd60288'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:35.496499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9d9c3a49-582f-4061-85d9-67b867ed870b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:35.497721 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9d9c3a49-582f-4061-85d9-67b867ed870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:35.530939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 868/1707] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:35 2022] DELETE /identity/v3/users/dd785c60fff444d1ac6e51210bd60288 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:35.653473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb78956-3fc6-4c58-8ab6-36b7798cc768 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:35.653641 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb78956-3fc6-4c58-8ab6-36b7798cc768 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:35.653929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb78956-3fc6-4c58-8ab6-36b7798cc768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:35.657291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 840/1708] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:28:35.697601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-acb78956-3fc6-4c58-8ab6-36b7798cc768 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:35.699297 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-acb78956-3fc6-4c58-8ab6-36b7798cc768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:35.887470 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 869/1709] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:35.894689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c3a49-582f-4061-85d9-67b867ed870b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:35.913307 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c3a49-582f-4061-85d9-67b867ed870b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:35.977907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef476a-0267-405d-a02f-41fbaef800d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:35.978636 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef476a-0267-405d-a02f-41fbaef800d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:35.979042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef476a-0267-405d-a02f-41fbaef800d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:35.979158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef476a-0267-405d-a02f-41fbaef800d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:35.979819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef476a-0267-405d-a02f-41fbaef800d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:35.980107 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef476a-0267-405d-a02f-41fbaef800d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:35.996752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef476a-0267-405d-a02f-41fbaef800d3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:36.056575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 841/1710] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:28:36.061264 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb78956-3fc6-4c58-8ab6-36b7798cc768 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:36.077042 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:36.082114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb78956-3fc6-4c58-8ab6-36b7798cc768 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:36.101877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28175526-e8a4-4056-af83-e18caa1f6683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:36.102582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28175526-e8a4-4056-af83-e18caa1f6683 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:36.103006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28175526-e8a4-4056-af83-e18caa1f6683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:36.103285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28175526-e8a4-4056-af83-e18caa1f6683 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:36.103967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28175526-e8a4-4056-af83-e18caa1f6683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:36.106044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28175526-e8a4-4056-af83-e18caa1f6683 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:36.172038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 870/1711] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:36 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:36.172984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef476a-0267-405d-a02f-41fbaef800d3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:36.187145 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef476a-0267-405d-a02f-41fbaef800d3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:36.369262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103ad5e-d5aa-4c82-a1ac-89426194cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:36.370162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103ad5e-d5aa-4c82-a1ac-89426194cbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:36.370589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103ad5e-d5aa-4c82-a1ac-89426194cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:36.371112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103ad5e-d5aa-4c82-a1ac-89426194cbf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:36.372161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103ad5e-d5aa-4c82-a1ac-89426194cbf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:36.382255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103ad5e-d5aa-4c82-a1ac-89426194cbf1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:36.410417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:36.463649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 842/1712] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:36 2022] POST /identity/v3/users => generated 288 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:36.465983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28175526-e8a4-4056-af83-e18caa1f6683 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:36.477592 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28175526-e8a4-4056-af83-e18caa1f6683 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:36.484894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4b300-86fc-4806-9c67-e1d4198a4576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:36.485831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b300-86fc-4806-9c67-e1d4198a4576 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:36.486474 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b300-86fc-4806-9c67-e1d4198a4576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:36.486905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b300-86fc-4806-9c67-e1d4198a4576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:36.487726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4b300-86fc-4806-9c67-e1d4198a4576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:36.489497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4b300-86fc-4806-9c67-e1d4198a4576 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:36.509922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103ad5e-d5aa-4c82-a1ac-89426194cbf1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:36.518249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 871/1713] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:36.527098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103ad5e-d5aa-4c82-a1ac-89426194cbf1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:36.541647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddeff0-a77f-4803-b976-27d044188e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:36.542738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddeff0-a77f-4803-b976-27d044188e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:36.543569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddeff0-a77f-4803-b976-27d044188e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:36.544186 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddeff0-a77f-4803-b976-27d044188e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:36.545109 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddeff0-a77f-4803-b976-27d044188e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:36.547207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddeff0-a77f-4803-b976-27d044188e3b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:36.566878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4b300-86fc-4806-9c67-e1d4198a4576 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:36.575029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 843/1714] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:36.580039 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4b300-86fc-4806-9c67-e1d4198a4576 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:36.586170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc4163-459b-4abb-be86-c8c28532e755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:36.587176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc4163-459b-4abb-be86-c8c28532e755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:36.587601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc4163-459b-4abb-be86-c8c28532e755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:36.588336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc4163-459b-4abb-be86-c8c28532e755 admin admin] PATH_INFO: `/v3/projects/c7eb3712d23a4632b157fa725c96ca9b/users/d60aa97dff6e408e95483a56889c104f/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:36.630980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc4163-459b-4abb-be86-c8c28532e755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7eb3712d23a4632b157fa725c96ca9b, user_id=d60aa97dff6e408e95483a56889c104f, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:36.635723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc4163-459b-4abb-be86-c8c28532e755 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:36.672265 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 872/1715] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:36 2022] PUT /identity/v3/projects/c7eb3712d23a4632b157fa725c96ca9b/users/d60aa97dff6e408e95483a56889c104f/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:36.686238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b04a6-821d-4469-b7bf-07b9d2ddd4bc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:36.686780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b04a6-821d-4469-b7bf-07b9d2ddd4bc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:36.687411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b04a6-821d-4469-b7bf-07b9d2ddd4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:36.742637 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bb2b04a6-821d-4469-b7bf-07b9d2ddd4bc None None] MFA Rules not processed for user `d60aa97dff6e408e95483a56889c104f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:36.749781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bb2b04a6-821d-4469-b7bf-07b9d2ddd4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:36.844778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc4163-459b-4abb-be86-c8c28532e755 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:36.847889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c3dc4163-459b-4abb-be86-c8c28532e755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:36.947978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 844/1716] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:36.957164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b04a6-821d-4469-b7bf-07b9d2ddd4bc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:37.046349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc4163-459b-4abb-be86-c8c28532e755 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:37.059399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:37.060213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:37.060482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:37.064800 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] PATH_INFO: `/v3/projects/61edf81b88c54fd498630bf32cf6c28c` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:37.067308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=61edf81b88c54fd498630bf32cf6c28c)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:37.069276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:37.083376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b04a6-821d-4469-b7bf-07b9d2ddd4bc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:37.116153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a561b2-f398-4bc1-8ab8-fc784f03c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:37.117081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a561b2-f398-4bc1-8ab8-fc784f03c89f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:37.117520 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a561b2-f398-4bc1-8ab8-fc784f03c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:37.117947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a561b2-f398-4bc1-8ab8-fc784f03c89f admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:37.121647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a561b2-f398-4bc1-8ab8-fc784f03c89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:37.147846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a561b2-f398-4bc1-8ab8-fc784f03c89f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:37.244345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 845/1717] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:36 2022] POST /identity/v3/projects => generated 375 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:37.244345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a561b2-f398-4bc1-8ab8-fc784f03c89f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:37.246946 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61edf81b88c54fd498630bf32cf6c28c', 'request_id': 'req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.247524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-89a561b2-f398-4bc1-8ab8-fc784f03c89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:37.271112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61edf81b88c54fd498630bf32cf6c28c', 'request_id': 'req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.303560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61edf81b88c54fd498630bf32cf6c28c', 'request_id': 'req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.349671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] The token cache is being invalidate because project 61edf81b88c54fd498630bf32cf6c28c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:28:37.351117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.354847 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.363764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:37.364038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 873/1718] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:28:36 2022] DELETE /identity/v3/projects/61edf81b88c54fd498630bf32cf6c28c => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:37.365994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:37.373064 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:37.380597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a561b2-f398-4bc1-8ab8-fc784f03c89f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:37.396285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:37.396901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:37.398620 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:37.399024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] PATH_INFO: `/v3/projects/10563cbea5764508af492728c41e6bba` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:37.401243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10563cbea5764508af492728c41e6bba)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:37.404053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:37.485349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:37.529149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10563cbea5764508af492728c41e6bba', 'request_id': 'req-e99483d5-2ecd-4560-846d-0a181a9ea757'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.557045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10563cbea5764508af492728c41e6bba', 'request_id': 'req-e99483d5-2ecd-4560-846d-0a181a9ea757'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.563925 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3ef5b-3199-43cb-a610-ba055b5a3f9a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:37.575395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10563cbea5764508af492728c41e6bba', 'request_id': 'req-e99483d5-2ecd-4560-846d-0a181a9ea757'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.593721 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] The token cache is being invalidate because project 10563cbea5764508af492728c41e6bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:28:37.594255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.595291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.597652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 846/1719] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:28:37 2022] DELETE /identity/v3/projects/10563cbea5764508af492728c41e6bba => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:37.598835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:37.601306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:37.686499 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:37.687454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:37.687820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:37.688165 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] PATH_INFO: `/v3/projects/874f84dbd5d54ab981987c123e1e45da` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:37.705808 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=874f84dbd5d54ab981987c123e1e45da)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:37.711223 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:37.756549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99483d5-2ecd-4560-846d-0a181a9ea757 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:37.768037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00c25b-1cfc-4aff-bb8e-27c4a6912977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:37.768679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00c25b-1cfc-4aff-bb8e-27c4a6912977 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:37.768960 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00c25b-1cfc-4aff-bb8e-27c4a6912977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:37.769254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00c25b-1cfc-4aff-bb8e-27c4a6912977 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:37.769907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00c25b-1cfc-4aff-bb8e-27c4a6912977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:37.772686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00c25b-1cfc-4aff-bb8e-27c4a6912977 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:37.824574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874f84dbd5d54ab981987c123e1e45da', 'request_id': 'req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.832880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 847/1720] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:37 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:37.834551 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00c25b-1cfc-4aff-bb8e-27c4a6912977 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:37.836619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4a00c25b-1cfc-4aff-bb8e-27c4a6912977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:37.839923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874f84dbd5d54ab981987c123e1e45da', 'request_id': 'req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.851795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874f84dbd5d54ab981987c123e1e45da', 'request_id': 'req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.875172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00c25b-1cfc-4aff-bb8e-27c4a6912977 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:37.879453 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] The token cache is being invalidate because project 874f84dbd5d54ab981987c123e1e45da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:28:37.879964 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.881298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:37.883936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 874/1721] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:28:37 2022] DELETE /identity/v3/projects/874f84dbd5d54ab981987c123e1e45da => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:37.884874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:37.886730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:38.036469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6bd8f-a101-4b0b-a5db-79c29042cf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:38.037124 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6bd8f-a101-4b0b-a5db-79c29042cf55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:38.037404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6bd8f-a101-4b0b-a5db-79c29042cf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:38.037678 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6bd8f-a101-4b0b-a5db-79c29042cf55 admin admin] PATH_INFO: `/v3/users/8eab955aad1d4c89992407c05f3fdeab` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:38.044108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6bd8f-a101-4b0b-a5db-79c29042cf55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eab955aad1d4c89992407c05f3fdeab)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:38.051846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6bd8f-a101-4b0b-a5db-79c29042cf55 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:38.086703 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63b2a9-5034-4b0d-81c7-7d28ec4e6c3b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:38.099435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:38.107326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:38.108000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:38.108287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:38.108554 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] PATH_INFO: `/v3/users/347008014350466083ea33542f0affac` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:38.110212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=347008014350466083ea33542f0affac)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:38.112681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:38.152539 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:38.171087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2fb6bd8f-a101-4b0b-a5db-79c29042cf55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eab955aad1d4c89992407c05f3fdeab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.182919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2fb6bd8f-a101-4b0b-a5db-79c29042cf55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eab955aad1d4c89992407c05f3fdeab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.212644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2fb6bd8f-a101-4b0b-a5db-79c29042cf55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eab955aad1d4c89992407c05f3fdeab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.215992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2fb6bd8f-a101-4b0b-a5db-79c29042cf55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eab955aad1d4c89992407c05f3fdeab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.217185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2fb6bd8f-a101-4b0b-a5db-79c29042cf55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eab955aad1d4c89992407c05f3fdeab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.231918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347008014350466083ea33542f0affac'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.242629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347008014350466083ea33542f0affac'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.252704 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 848/1722] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:37 2022] DELETE /identity/v3/users/8eab955aad1d4c89992407c05f3fdeab => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:38.255493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a19ca-3c40-4294-9647-a4c8cc78cbf9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:38.256050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a19ca-3c40-4294-9647-a4c8cc78cbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:38.256755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a19ca-3c40-4294-9647-a4c8cc78cbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:38.274653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347008014350466083ea33542f0affac'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.275417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347008014350466083ea33542f0affac'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.276040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347008014350466083ea33542f0affac'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.309066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c04a19ca-3c40-4294-9647-a4c8cc78cbf9 None None] MFA Rules not processed for user `8b7e7f9af2cd4ac0bebb2a65f08a4398`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:38.311644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c04a19ca-3c40-4294-9647-a4c8cc78cbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:38.327860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 875/1723] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:37 2022] DELETE /identity/v3/users/347008014350466083ea33542f0affac => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:38.331562 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:38.337537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:38.454726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 849/1724] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:38.457326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a19ca-3c40-4294-9647-a4c8cc78cbf9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:38.464276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c04a19ca-3c40-4294-9647-a4c8cc78cbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:38.574926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a19ca-3c40-4294-9647-a4c8cc78cbf9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:38.577971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84211e-a10a-4035-819b-9a26efeac5f5 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:38.580133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:38.580941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:38.581285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:38.581676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] PATH_INFO: `/v3/users/afe7ca93e9ec441ea9862f9e0b7598cb` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:38.584299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe7ca93e9ec441ea9862f9e0b7598cb)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:38.586278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:38.597910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860251e-e38b-4591-a0c2-57c6b5990dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:38.598580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860251e-e38b-4591-a0c2-57c6b5990dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:38.598862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860251e-e38b-4591-a0c2-57c6b5990dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:38.599136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860251e-e38b-4591-a0c2-57c6b5990dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:38.599840 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860251e-e38b-4591-a0c2-57c6b5990dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:38.601460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860251e-e38b-4591-a0c2-57c6b5990dd3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:38.638156 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 876/1725] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:38.641184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504ba67-2173-4988-b4cf-62d5e0a92e71 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:38.641494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504ba67-2173-4988-b4cf-62d5e0a92e71 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:38.641900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504ba67-2173-4988-b4cf-62d5e0a92e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:38.647338 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:38.709087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-0504ba67-2173-4988-b4cf-62d5e0a92e71 None None] MFA Rules not processed for user `a0ada49dfcb54b2b8e551e9d89f831a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:38.710684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0504ba67-2173-4988-b4cf-62d5e0a92e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:38.711102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe7ca93e9ec441ea9862f9e0b7598cb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.741472 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe7ca93e9ec441ea9862f9e0b7598cb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.766835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe7ca93e9ec441ea9862f9e0b7598cb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.769342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe7ca93e9ec441ea9862f9e0b7598cb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.770569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe7ca93e9ec441ea9862f9e0b7598cb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:38.844924 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 850/1726] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:38 2022] DELETE /identity/v3/users/afe7ca93e9ec441ea9862f9e0b7598cb => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:38.846105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:38.849301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:38.854548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 877/1727] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:38.858962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221271ac-f342-41b2-bd84-5c0f59b30dbd None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:38.859256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221271ac-f342-41b2-bd84-5c0f59b30dbd None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:38.859537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221271ac-f342-41b2-bd84-5c0f59b30dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:38.940804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-221271ac-f342-41b2-bd84-5c0f59b30dbd None None] MFA Rules not processed for user `b13cd0222e264cc8b6212b7c3ce9efb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:38.945410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-221271ac-f342-41b2-bd84-5c0f59b30dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:39.007375 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:39.055205 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cd4e1-e714-4cc2-b542-c914cb448343 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:39.063343 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cca98-3b69-48df-a93c-2087a170dbf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:39.063999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cca98-3b69-48df-a93c-2087a170dbf6 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:39.064329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cca98-3b69-48df-a93c-2087a170dbf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:39.065357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cca98-3b69-48df-a93c-2087a170dbf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:39.067694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fb1cca98-3b69-48df-a93c-2087a170dbf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:39.150944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 878/1728] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:39.151823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221271ac-f342-41b2-bd84-5c0f59b30dbd None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:39.156253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-221271ac-f342-41b2-bd84-5c0f59b30dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:39.195676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cca98-3b69-48df-a93c-2087a170dbf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:39.197593 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cca98-3b69-48df-a93c-2087a170dbf6 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:39.209394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 851/1729] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:39.210896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0522655-bd32-4da0-a4bc-5fcb35c7f777 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:39.211209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0522655-bd32-4da0-a4bc-5fcb35c7f777 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:39.211613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0522655-bd32-4da0-a4bc-5fcb35c7f777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:39.284885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e0522655-bd32-4da0-a4bc-5fcb35c7f777 None None] MFA Rules not processed for user `e3a473b5ad2f43db852f57f83d48240b`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:39.286203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e0522655-bd32-4da0-a4bc-5fcb35c7f777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:39.322968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221271ac-f342-41b2-bd84-5c0f59b30dbd None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:39.338995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9663d-f583-48ea-9e6f-936b5786102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:39.344197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9663d-f583-48ea-9e6f-936b5786102a admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:39.344513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9663d-f583-48ea-9e6f-936b5786102a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:39.344846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9663d-f583-48ea-9e6f-936b5786102a admin admin] PATH_INFO: `/v3/projects/eee20329f8bb4ed4b1964d8462240421/users/1847cf45ce5f43d8931b0fcc92fb170b/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:39.382047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:39.404125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9663d-f583-48ea-9e6f-936b5786102a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee20329f8bb4ed4b1964d8462240421, user_id=1847cf45ce5f43d8931b0fcc92fb170b, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:39.412465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9663d-f583-48ea-9e6f-936b5786102a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:39.478893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 879/1730] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:39 2022] PUT /identity/v3/projects/eee20329f8bb4ed4b1964d8462240421/users/1847cf45ce5f43d8931b0fcc92fb170b/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:39.480008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9663d-f583-48ea-9e6f-936b5786102a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:39.482772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b7c9663d-f583-48ea-9e6f-936b5786102a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:39.492677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 852/1731] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:39.495291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0522655-bd32-4da0-a4bc-5fcb35c7f777 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:39.497779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e0522655-bd32-4da0-a4bc-5fcb35c7f777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:39.527606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0522655-bd32-4da0-a4bc-5fcb35c7f777 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:39.632343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9663d-f583-48ea-9e6f-936b5786102a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:39.646032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9562cb9-ea7b-465a-9ec7-025a584c3a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:39.646727 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562cb9-ea7b-465a-9ec7-025a584c3a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:39.647027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562cb9-ea7b-465a-9ec7-025a584c3a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:39.647261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562cb9-ea7b-465a-9ec7-025a584c3a27 admin admin] PATH_INFO: `/v3/projects/2a0fd9f809864e6e98da609125c6ab30` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:39.649071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9562cb9-ea7b-465a-9ec7-025a584c3a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0fd9f809864e6e98da609125c6ab30)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:39.652039 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9562cb9-ea7b-465a-9ec7-025a584c3a27 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:39.673201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:39.673919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:39.674212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:39.674558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] PATH_INFO: `/v3/projects/518e2f23d3f141518d74d0add7fba505` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:39.676166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=518e2f23d3f141518d74d0add7fba505)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:39.679270 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:39.752506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f9562cb9-ea7b-465a-9ec7-025a584c3a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0fd9f809864e6e98da609125c6ab30', 'request_id': 'req-f9562cb9-ea7b-465a-9ec7-025a584c3a27'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:39.753905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:39.766738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f9562cb9-ea7b-465a-9ec7-025a584c3a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0fd9f809864e6e98da609125c6ab30', 'request_id': 'req-f9562cb9-ea7b-465a-9ec7-025a584c3a27'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:39.783628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f9562cb9-ea7b-465a-9ec7-025a584c3a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0fd9f809864e6e98da609125c6ab30', 'request_id': 'req-f9562cb9-ea7b-465a-9ec7-025a584c3a27'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:39.789158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518e2f23d3f141518d74d0add7fba505', 'request_id': 'req-29dc18e2-d586-4ff5-b308-d5a3a03223c9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:39.805235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518e2f23d3f141518d74d0add7fba505', 'request_id': 'req-29dc18e2-d586-4ff5-b308-d5a3a03223c9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:39.815251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518e2f23d3f141518d74d0add7fba505', 'request_id': 'req-29dc18e2-d586-4ff5-b308-d5a3a03223c9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:39.817578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f9562cb9-ea7b-465a-9ec7-025a584c3a27 admin admin] The token cache is being invalidate because project 2a0fd9f809864e6e98da609125c6ab30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:28:39.818043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f9562cb9-ea7b-465a-9ec7-025a584c3a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:39.821147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f9562cb9-ea7b-465a-9ec7-025a584c3a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:39.828703 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 880/1732] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:28:39 2022] DELETE /identity/v3/projects/2a0fd9f809864e6e98da609125c6ab30 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:39.828972 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] The token cache is being invalidate because project 518e2f23d3f141518d74d0add7fba505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:28:39.829515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:39.832355 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fee17-9e4e-48d8-924e-b645f4cdabd4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:39.832653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fee17-9e4e-48d8-924e-b645f4cdabd4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:39.832968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fee17-9e4e-48d8-924e-b645f4cdabd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:39.833075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:39.838910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 853/1733] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:28:39 2022] DELETE /identity/v3/projects/518e2f23d3f141518d74d0add7fba505 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:39.838910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:39.841113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:39.906334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-8c2fee17-9e4e-48d8-924e-b645f4cdabd4 None None] MFA Rules not processed for user `b13cd0222e264cc8b6212b7c3ce9efb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:39.909137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8c2fee17-9e4e-48d8-924e-b645f4cdabd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:39.973964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc18e2-d586-4ff5-b308-d5a3a03223c9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:39.982577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3337af-c2e8-4ede-8e1f-f71daad31f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:39.983217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3337af-c2e8-4ede-8e1f-f71daad31f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:39.983495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3337af-c2e8-4ede-8e1f-f71daad31f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:39.983882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3337af-c2e8-4ede-8e1f-f71daad31f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:39.984538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3337af-c2e8-4ede-8e1f-f71daad31f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:39.986170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3337af-c2e8-4ede-8e1f-f71daad31f00 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:39.987833 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:39.991971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 881/1734] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:39.993410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec79337-bc51-4414-a864-4f30736983e4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:39.993830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec79337-bc51-4414-a864-4f30736983e4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:39.994187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec79337-bc51-4414-a864-4f30736983e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:40.005827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 854/1735] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:40.007763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3337af-c2e8-4ede-8e1f-f71daad31f00 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:40.010528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3e3337af-c2e8-4ede-8e1f-f71daad31f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:40.029258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3337af-c2e8-4ede-8e1f-f71daad31f00 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:40.032569 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-aec79337-bc51-4414-a864-4f30736983e4 None None] MFA Rules not processed for user `e3a473b5ad2f43db852f57f83d48240b`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:40.033916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-aec79337-bc51-4414-a864-4f30736983e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:40.036166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:40.037158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:40.037436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:40.037717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a admin admin] PATH_INFO: `/v3/projects/7ab9d6b2b4164520bdbf4dac573c4cea` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:40.039661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab9d6b2b4164520bdbf4dac573c4cea)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:40.041934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:40.117108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab9d6b2b4164520bdbf4dac573c4cea', 'request_id': 'req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:40.126999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab9d6b2b4164520bdbf4dac573c4cea', 'request_id': 'req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:40.143801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab9d6b2b4164520bdbf4dac573c4cea', 'request_id': 'req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:40.167325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a admin admin] The token cache is being invalidate because project 7ab9d6b2b4164520bdbf4dac573c4cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:28:40.168406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:40.169328 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1691e284-6fbd-4a75-aa77-ffc8a7f6885a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:40.171123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 855/1736] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:28:40 2022] DELETE /identity/v3/projects/7ab9d6b2b4164520bdbf4dac573c4cea => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:40.174214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959161ce-eca5-4517-9f85-83a76fd4e846 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:40.174214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959161ce-eca5-4517-9f85-83a76fd4e846 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:40.174214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959161ce-eca5-4517-9f85-83a76fd4e846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:40.201830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 882/1737] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:40.207034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-959161ce-eca5-4517-9f85-83a76fd4e846 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:40.207642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca42b2f-95f9-448a-b1fd-63d1e124b70f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:40.207642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca42b2f-95f9-448a-b1fd-63d1e124b70f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:40.207931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca42b2f-95f9-448a-b1fd-63d1e124b70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:40.209426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-959161ce-eca5-4517-9f85-83a76fd4e846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:40.266572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cca42b2f-95f9-448a-b1fd-63d1e124b70f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:40.272486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cca42b2f-95f9-448a-b1fd-63d1e124b70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:40.293243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 856/1738] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:40.294492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959161ce-eca5-4517-9f85-83a76fd4e846 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:40.296005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-959161ce-eca5-4517-9f85-83a76fd4e846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:40.422771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 883/1739] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:40.422771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca42b2f-95f9-448a-b1fd-63d1e124b70f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:40.422771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cca42b2f-95f9-448a-b1fd-63d1e124b70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:40.462519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959161ce-eca5-4517-9f85-83a76fd4e846 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:40.472190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca42b2f-95f9-448a-b1fd-63d1e124b70f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:40.475106 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc48f1-83a8-43bc-bac2-e06e34b774c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:40.478779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418b9bd-cbd0-41d0-9693-9ff435b65436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:40.479475 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418b9bd-cbd0-41d0-9693-9ff435b65436 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:40.479759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418b9bd-cbd0-41d0-9693-9ff435b65436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:40.480564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418b9bd-cbd0-41d0-9693-9ff435b65436 admin admin] PATH_INFO: `/v3/projects/eee20329f8bb4ed4b1964d8462240421/users/1847cf45ce5f43d8931b0fcc92fb170b/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:40.483067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418b9bd-cbd0-41d0-9693-9ff435b65436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee20329f8bb4ed4b1964d8462240421, user_id=1847cf45ce5f43d8931b0fcc92fb170b, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:40.487212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc48f1-83a8-43bc-bac2-e06e34b774c9 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:40.487521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc48f1-83a8-43bc-bac2-e06e34b774c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:40.487841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418b9bd-cbd0-41d0-9693-9ff435b65436 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:40.487945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc48f1-83a8-43bc-bac2-e06e34b774c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:40.490346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-88dc48f1-83a8-43bc-bac2-e06e34b774c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:40.508901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 884/1740] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:40 2022] PUT /identity/v3/projects/eee20329f8bb4ed4b1964d8462240421/users/1847cf45ce5f43d8931b0fcc92fb170b/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:40.512827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f218a7-2cb1-496b-befd-793dbed5933c None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:40.513073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f218a7-2cb1-496b-befd-793dbed5933c None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:40.513352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f218a7-2cb1-496b-befd-793dbed5933c None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:40.515123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:40.520866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 885/1741] 10.222.0.33 () {54 vars in 912 bytes} [Mon Sep 12 23:28:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:28:40.525084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b150c9-fe30-46ff-bee8-8e69e3555f97 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:40.525399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b150c9-fe30-46ff-bee8-8e69e3555f97 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:40.526106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b150c9-fe30-46ff-bee8-8e69e3555f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:40.567432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-90b150c9-fe30-46ff-bee8-8e69e3555f97 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:40.568686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-90b150c9-fe30-46ff-bee8-8e69e3555f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:40.598124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:40.633747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc48f1-83a8-43bc-bac2-e06e34b774c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:40.635624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc48f1-83a8-43bc-bac2-e06e34b774c9 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:40.657059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 857/1742] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:40.658922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bffe7-7704-46d0-8af1-3e5b5477652f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:40.659215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bffe7-7704-46d0-8af1-3e5b5477652f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:40.659496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bffe7-7704-46d0-8af1-3e5b5477652f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:40.700502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6a7bffe7-7704-46d0-8af1-3e5b5477652f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:40.701805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6a7bffe7-7704-46d0-8af1-3e5b5477652f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:40.707321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 886/1743] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:40.708733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d45035-36f5-4647-bcfb-bea1c9ee7a04 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:40.709268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d45035-36f5-4647-bcfb-bea1c9ee7a04 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:40.709651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d45035-36f5-4647-bcfb-bea1c9ee7a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:40.737203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 858/1744] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:40.737390 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-a3d45035-36f5-4647-bcfb-bea1c9ee7a04 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:40.738410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a3d45035-36f5-4647-bcfb-bea1c9ee7a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:40.739251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e898a-9a4d-43e0-ae67-31dad0b748d4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:40.740138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e898a-9a4d-43e0-ae67-31dad0b748d4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:40.741993 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e898a-9a4d-43e0-ae67-31dad0b748d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:40.752966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 887/1745] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:40.752966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fe10f-b101-4f4f-905d-36adf45d392c None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:40.752966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fe10f-b101-4f4f-905d-36adf45d392c None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:40.752966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fe10f-b101-4f4f-905d-36adf45d392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:40.830931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-706e898a-9a4d-43e0-ae67-31dad0b748d4 None None] MFA Rules not processed for user `1847cf45ce5f43d8931b0fcc92fb170b`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:40.835448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-706e898a-9a4d-43e0-ae67-31dad0b748d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:40.871370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-744fe10f-b101-4f4f-905d-36adf45d392c None None] MFA Rules not processed for user `b1d4b0f322c741c5b69b922071aab3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:40.874351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-744fe10f-b101-4f4f-905d-36adf45d392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:41.019125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 859/1746] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:41.019125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf8bca-c205-4db4-afec-ca25be76d3d8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:41.019392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf8bca-c205-4db4-afec-ca25be76d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:41.019674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf8bca-c205-4db4-afec-ca25be76d3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:41.041929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 888/1747] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:28:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:41.045451 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fe10f-b101-4f4f-905d-36adf45d392c None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:41.070958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5caf8bca-c205-4db4-afec-ca25be76d3d8 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:41.072426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5caf8bca-c205-4db4-afec-ca25be76d3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:41.074184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fe10f-b101-4f4f-905d-36adf45d392c None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:41.085137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9324213-d31f-45f5-a404-bc34e6d1cc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:41.085777 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9324213-d31f-45f5-a404-bc34e6d1cc2d admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:41.091375 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9324213-d31f-45f5-a404-bc34e6d1cc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:41.091736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9324213-d31f-45f5-a404-bc34e6d1cc2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:41.092529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9324213-d31f-45f5-a404-bc34e6d1cc2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:41.092846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9324213-d31f-45f5-a404-bc34e6d1cc2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:41.095462 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 860/1748] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:41.095592 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9324213-d31f-45f5-a404-bc34e6d1cc2d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:41.099595 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf8bca-c205-4db4-afec-ca25be76d3d8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:41.124663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf8bca-c205-4db4-afec-ca25be76d3d8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:41.131962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 889/1749] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:28:41.131962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9324213-d31f-45f5-a404-bc34e6d1cc2d admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:41.135892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a9324213-d31f-45f5-a404-bc34e6d1cc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:41.142642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c67432-7a50-40cf-bbef-d8d07a1b480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:41.143529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c67432-7a50-40cf-bbef-d8d07a1b480c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:41.144049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c67432-7a50-40cf-bbef-d8d07a1b480c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:41.144556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c67432-7a50-40cf-bbef-d8d07a1b480c admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:41.145426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c67432-7a50-40cf-bbef-d8d07a1b480c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:41.145936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c67432-7a50-40cf-bbef-d8d07a1b480c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:41.148412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c67432-7a50-40cf-bbef-d8d07a1b480c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:41.190188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 861/1750] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:28:41.191362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c67432-7a50-40cf-bbef-d8d07a1b480c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:41.212130 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c67432-7a50-40cf-bbef-d8d07a1b480c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:41.228884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277c3e0-0bfe-4c81-85c2-b31c1a2234fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:41.229932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277c3e0-0bfe-4c81-85c2-b31c1a2234fd admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:41.230487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277c3e0-0bfe-4c81-85c2-b31c1a2234fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:41.231061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277c3e0-0bfe-4c81-85c2-b31c1a2234fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:41.231928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277c3e0-0bfe-4c81-85c2-b31c1a2234fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:28:41.232484 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277c3e0-0bfe-4c81-85c2-b31c1a2234fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:41.234349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277c3e0-0bfe-4c81-85c2-b31c1a2234fd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:41.258563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 862/1751] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:28:41.259744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277c3e0-0bfe-4c81-85c2-b31c1a2234fd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:41.283534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277c3e0-0bfe-4c81-85c2-b31c1a2234fd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:41.295427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ceadf-853b-4a74-a668-a81a3d1f725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:41.296517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ceadf-853b-4a74-a668-a81a3d1f725b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:41.297045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ceadf-853b-4a74-a668-a81a3d1f725b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:41.297430 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ceadf-853b-4a74-a668-a81a3d1f725b admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:41.298183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ceadf-853b-4a74-a668-a81a3d1f725b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:41.300260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ceadf-853b-4a74-a668-a81a3d1f725b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:41.312656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9324213-d31f-45f5-a404-bc34e6d1cc2d admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:41.321248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94113-0a47-414f-8692-88242ec204ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:41.321969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94113-0a47-414f-8692-88242ec204ae service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:41.322177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94113-0a47-414f-8692-88242ec204ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:41.322458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94113-0a47-414f-8692-88242ec204ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:41.326414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-1ed94113-0a47-414f-8692-88242ec204ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:41.361748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 863/1752] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:41 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:41.362875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ceadf-853b-4a74-a668-a81a3d1f725b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:41.366747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9f8ceadf-853b-4a74-a668-a81a3d1f725b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:41.411327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:41.447398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed94113-0a47-414f-8692-88242ec204ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:41.453622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed94113-0a47-414f-8692-88242ec204ae service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:41.480685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:41.483623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 890/1753] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:41.496534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94113-0a47-414f-8692-88242ec204ae service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:41.510322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94113-0a47-414f-8692-88242ec204ae service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:41.528893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ceadf-853b-4a74-a668-a81a3d1f725b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:41.554726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6c53a-c870-413b-80ea-11c368fe1268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:41.555366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6c53a-c870-413b-80ea-11c368fe1268 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:41.555643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6c53a-c870-413b-80ea-11c368fe1268 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:41.555914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6c53a-c870-413b-80ea-11c368fe1268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:41.583865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6c53a-c870-413b-80ea-11c368fe1268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:41.589940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6c53a-c870-413b-80ea-11c368fe1268 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:41.611083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 864/1754] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:41.616779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6c53a-c870-413b-80ea-11c368fe1268 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:41.672712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b34af3-5b26-4b42-847a-6a45d44a3be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:41.673631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b34af3-5b26-4b42-847a-6a45d44a3be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:41.674052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b34af3-5b26-4b42-847a-6a45d44a3be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:41.674491 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b34af3-5b26-4b42-847a-6a45d44a3be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:41.675468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b34af3-5b26-4b42-847a-6a45d44a3be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:41.677740 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b34af3-5b26-4b42-847a-6a45d44a3be3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:41.735467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 891/1755] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:41 2022] POST /identity/v3/projects => generated 375 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:41.737120 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ee3ed-b3c1-418b-9c2d-eb7fc61b5dab None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:41.746893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ee3ed-b3c1-418b-9c2d-eb7fc61b5dab None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:41.747459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ee3ed-b3c1-418b-9c2d-eb7fc61b5dab None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:41.749058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 892/1756] 10.222.0.33 () {54 vars in 912 bytes} [Mon Sep 12 23:28:41 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:28:41.749943 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ee3ed-b3c1-418b-9c2d-eb7fc61b5dab None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:41.760089 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6c53a-c870-413b-80ea-11c368fe1268 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:41.867825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbafdc-12ab-4753-8f4e-0bd3aca29e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:41.870494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbafdc-12ab-4753-8f4e-0bd3aca29e31 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:41.871830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbafdc-12ab-4753-8f4e-0bd3aca29e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:41.873608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbafdc-12ab-4753-8f4e-0bd3aca29e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:41.874755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbafdc-12ab-4753-8f4e-0bd3aca29e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:41.878076 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbafdc-12ab-4753-8f4e-0bd3aca29e31 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:41.885182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ee3ed-b3c1-418b-9c2d-eb7fc61b5dab None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:41.895541 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291c061-b022-4c97-af90-03ab8f8cfd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:41.897644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291c061-b022-4c97-af90-03ab8f8cfd59 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:41.897944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291c061-b022-4c97-af90-03ab8f8cfd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:41.898222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291c061-b022-4c97-af90-03ab8f8cfd59 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:41.899098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291c061-b022-4c97-af90-03ab8f8cfd59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:41.905430 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291c061-b022-4c97-af90-03ab8f8cfd59 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:41.924934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 865/1757] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:41 2022] POST /identity/v3/projects => generated 363 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:41.926019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbafdc-12ab-4753-8f4e-0bd3aca29e31 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:41.952629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 893/1758] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:41 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:41.952629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af72100-f3da-4a6a-b785-df10e0bbe3ed None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:41.958500 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af72100-f3da-4a6a-b785-df10e0bbe3ed None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:41.959015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af72100-f3da-4a6a-b785-df10e0bbe3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.005049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-9af72100-f3da-4a6a-b785-df10e0bbe3ed None None] MFA Rules not processed for user `b1d4b0f322c741c5b69b922071aab3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:42.007580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9af72100-f3da-4a6a-b785-df10e0bbe3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:42.053644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbafdc-12ab-4753-8f4e-0bd3aca29e31 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:42.067169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f805a46-b009-4b9b-ad88-4208ee9c6446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:42.070006 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f805a46-b009-4b9b-ad88-4208ee9c6446 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.070303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f805a46-b009-4b9b-ad88-4208ee9c6446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.070921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f805a46-b009-4b9b-ad88-4208ee9c6446 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.071581 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f805a46-b009-4b9b-ad88-4208ee9c6446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:42.075161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f805a46-b009-4b9b-ad88-4208ee9c6446 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:42.120361 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 866/1759] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:41 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:42.122589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f805a46-b009-4b9b-ad88-4208ee9c6446 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:42.132908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 894/1760] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:28:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:42.133782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af72100-f3da-4a6a-b785-df10e0bbe3ed None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:42.136732 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:42.157864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f805a46-b009-4b9b-ad88-4208ee9c6446 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:42.180505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3e8a7-6b51-4530-8544-80046cfb565e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:42.182450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3e8a7-6b51-4530-8544-80046cfb565e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.182743 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3e8a7-6b51-4530-8544-80046cfb565e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.183027 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3e8a7-6b51-4530-8544-80046cfb565e admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.184409 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af72100-f3da-4a6a-b785-df10e0bbe3ed None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:42.188500 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3e8a7-6b51-4530-8544-80046cfb565e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:42.193969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3e8a7-6b51-4530-8544-80046cfb565e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:42.204767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c48c7-a5aa-4fd8-87e8-b89474151007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:42.205418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c48c7-a5aa-4fd8-87e8-b89474151007 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.205698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c48c7-a5aa-4fd8-87e8-b89474151007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.205972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c48c7-a5aa-4fd8-87e8-b89474151007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.208422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c48c7-a5aa-4fd8-87e8-b89474151007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:42.216904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c48c7-a5aa-4fd8-87e8-b89474151007 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:42.231694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:42.252017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 895/1761] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:42.252801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c48c7-a5aa-4fd8-87e8-b89474151007 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:42.270713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 867/1762] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:42 2022] POST /identity/v3/users => generated 282 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:42.270713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3e8a7-6b51-4530-8544-80046cfb565e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:42.275656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c48c7-a5aa-4fd8-87e8-b89474151007 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:42.280253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3e8a7-6b51-4530-8544-80046cfb565e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:42.281154 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04839607-a0e3-4425-abf7-63a7fa15730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:42.281786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04839607-a0e3-4425-abf7-63a7fa15730a admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.282076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04839607-a0e3-4425-abf7-63a7fa15730a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.282351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04839607-a0e3-4425-abf7-63a7fa15730a admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.283225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04839607-a0e3-4425-abf7-63a7fa15730a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:42.285485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04839607-a0e3-4425-abf7-63a7fa15730a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:42.296010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2555e3-12c5-48b5-a20d-57ac23710966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:42.296619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2555e3-12c5-48b5-a20d-57ac23710966 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.296902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2555e3-12c5-48b5-a20d-57ac23710966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.297155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2555e3-12c5-48b5-a20d-57ac23710966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.298022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2555e3-12c5-48b5-a20d-57ac23710966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:42.300016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2555e3-12c5-48b5-a20d-57ac23710966 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:42.303831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 896/1763] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:42.303831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04839607-a0e3-4425-abf7-63a7fa15730a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:42.313834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04839607-a0e3-4425-abf7-63a7fa15730a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:42.319708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e9fab-f13b-4080-a201-e5f3f7cb0e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:42.320387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e9fab-f13b-4080-a201-e5f3f7cb0e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.320674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e9fab-f13b-4080-a201-e5f3f7cb0e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.321050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e9fab-f13b-4080-a201-e5f3f7cb0e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.321718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e9fab-f13b-4080-a201-e5f3f7cb0e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:42.327026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e9fab-f13b-4080-a201-e5f3f7cb0e2c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:42.338274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 868/1764] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:42.338274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2555e3-12c5-48b5-a20d-57ac23710966 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:42.349492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 897/1765] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:42.350373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e9fab-f13b-4080-a201-e5f3f7cb0e2c admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:42.356329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2555e3-12c5-48b5-a20d-57ac23710966 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:42.365447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e9fab-f13b-4080-a201-e5f3f7cb0e2c admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:42.370595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba80c5e-f92b-4e1a-948f-1b338a4ffa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:42.371343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba80c5e-f92b-4e1a-948f-1b338a4ffa1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.371697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba80c5e-f92b-4e1a-948f-1b338a4ffa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.371977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba80c5e-f92b-4e1a-948f-1b338a4ffa1a admin admin] PATH_INFO: `/v3/projects/498baf1b77d54c4e9677c6c6155bc0c1/users/68d4af040a7c45b7ae4a882d6cbfd4ab/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.375098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0067168-555d-4a55-bac2-6407bd030554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:42.375767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0067168-555d-4a55-bac2-6407bd030554 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.376051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0067168-555d-4a55-bac2-6407bd030554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.376319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0067168-555d-4a55-bac2-6407bd030554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.380266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0067168-555d-4a55-bac2-6407bd030554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:42.381952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0067168-555d-4a55-bac2-6407bd030554 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:42.409952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba80c5e-f92b-4e1a-948f-1b338a4ffa1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=498baf1b77d54c4e9677c6c6155bc0c1, user_id=68d4af040a7c45b7ae4a882d6cbfd4ab, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:42.413040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba80c5e-f92b-4e1a-948f-1b338a4ffa1a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:42.438760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 869/1766] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:42.438760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0067168-555d-4a55-bac2-6407bd030554 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:42.447464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 898/1767] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:42 2022] PUT /identity/v3/projects/498baf1b77d54c4e9677c6c6155bc0c1/users/68d4af040a7c45b7ae4a882d6cbfd4ab/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:42.448522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba80c5e-f92b-4e1a-948f-1b338a4ffa1a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:42.469015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0067168-555d-4a55-bac2-6407bd030554 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:42.557589 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba80c5e-f92b-4e1a-948f-1b338a4ffa1a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:42.563348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a30598-6392-4b05-bef4-7f34be1f2ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:42.564034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a30598-6392-4b05-bef4-7f34be1f2ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.564316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a30598-6392-4b05-bef4-7f34be1f2ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.564922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a30598-6392-4b05-bef4-7f34be1f2ebf admin admin] PATH_INFO: `/v3/projects/eca7effeb67a4519bb745537a007a907/users/7e95dfb00f7c4253a73bfcebbc0523b4/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.607094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a30598-6392-4b05-bef4-7f34be1f2ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca7effeb67a4519bb745537a007a907, user_id=7e95dfb00f7c4253a73bfcebbc0523b4, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:42.610864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a30598-6392-4b05-bef4-7f34be1f2ebf admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:42.627325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98a63b-d01f-46b7-840e-57d4ceb98ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:42.628204 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98a63b-d01f-46b7-840e-57d4ceb98ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.628559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98a63b-d01f-46b7-840e-57d4ceb98ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.628933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98a63b-d01f-46b7-840e-57d4ceb98ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.629837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98a63b-d01f-46b7-840e-57d4ceb98ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:42.631888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98a63b-d01f-46b7-840e-57d4ceb98ed3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:42.649857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 870/1768] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:42.651263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d09f-576c-4548-9c22-463f66a43f4b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.651564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d09f-576c-4548-9c22-463f66a43f4b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.652765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d09f-576c-4548-9c22-463f66a43f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.654344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 899/1769] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:42 2022] PUT /identity/v3/projects/eca7effeb67a4519bb745537a007a907/users/7e95dfb00f7c4253a73bfcebbc0523b4/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:42.656174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744d0d-d209-4a67-bbac-0d4050f5bcf4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.656695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744d0d-d209-4a67-bbac-0d4050f5bcf4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.657130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744d0d-d209-4a67-bbac-0d4050f5bcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.690517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c5744d0d-d209-4a67-bbac-0d4050f5bcf4 None None] MFA Rules not processed for user `8b7e7f9af2cd4ac0bebb2a65f08a4398`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:42.691865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4277d09f-576c-4548-9c22-463f66a43f4b None None] MFA Rules not processed for user `68d4af040a7c45b7ae4a882d6cbfd4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:42.692216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c5744d0d-d209-4a67-bbac-0d4050f5bcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:42.694066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4277d09f-576c-4548-9c22-463f66a43f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:42.801850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 900/1770] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:42.804116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744d0d-d209-4a67-bbac-0d4050f5bcf4 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:42.851942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 871/1771] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:42.855967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277d09f-576c-4548-9c22-463f66a43f4b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:42.897429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:42.919752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744d0d-d209-4a67-bbac-0d4050f5bcf4 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:42.926585 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267ff2a-cee3-4080-9670-ce6a701e112a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:42.927330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267ff2a-cee3-4080-9670-ce6a701e112a service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.927526 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267ff2a-cee3-4080-9670-ce6a701e112a service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.927806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267ff2a-cee3-4080-9670-ce6a701e112a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.933221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:42.939120 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267ff2a-cee3-4080-9670-ce6a701e112a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:42.940652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267ff2a-cee3-4080-9670-ce6a701e112a service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:42.951081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277d09f-576c-4548-9c22-463f66a43f4b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:42.952887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 901/1772] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:42.954490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5346314-551f-44ad-be39-98c1eb0a5171 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.954870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5346314-551f-44ad-be39-98c1eb0a5171 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.955146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5346314-551f-44ad-be39-98c1eb0a5171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.958087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3df91-68ad-4da7-a471-923f772ced82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:42.959491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3df91-68ad-4da7-a471-923f772ced82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:42.959876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3df91-68ad-4da7-a471-923f772ced82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:42.960249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3df91-68ad-4da7-a471-923f772ced82 admin admin] PATH_INFO: `/v3/projects/0892e8936aac4520b5fe8f64dd3dc24a/users/e00de88599524774b529972a8eb76ac5/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:42.985146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3df91-68ad-4da7-a471-923f772ced82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0892e8936aac4520b5fe8f64dd3dc24a, user_id=e00de88599524774b529972a8eb76ac5, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:42.988563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3df91-68ad-4da7-a471-923f772ced82 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:42.994718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-a5346314-551f-44ad-be39-98c1eb0a5171 None None] MFA Rules not processed for user `7e95dfb00f7c4253a73bfcebbc0523b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:42.997251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a5346314-551f-44ad-be39-98c1eb0a5171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:43.009078 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 872/1773] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:42 2022] PUT /identity/v3/projects/0892e8936aac4520b5fe8f64dd3dc24a/users/e00de88599524774b529972a8eb76ac5/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:43.010559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3df91-68ad-4da7-a471-923f772ced82 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:43.108378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 902/1774] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:43.112054 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5346314-551f-44ad-be39-98c1eb0a5171 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:43.115087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a5346314-551f-44ad-be39-98c1eb0a5171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:43.136720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3df91-68ad-4da7-a471-923f772ced82 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:43.149977 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c94ef-d392-42f3-96de-51ee8c87f422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:43.154991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c94ef-d392-42f3-96de-51ee8c87f422 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:43.155280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c94ef-d392-42f3-96de-51ee8c87f422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:43.155561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c94ef-d392-42f3-96de-51ee8c87f422 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:43.156239 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c94ef-d392-42f3-96de-51ee8c87f422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:43.158243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c94ef-d392-42f3-96de-51ee8c87f422 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:43.211883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 873/1775] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:43 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:43.211883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b391ded-2bd5-4d78-81a2-43ce12ae551a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:43.211883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b391ded-2bd5-4d78-81a2-43ce12ae551a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:43.211883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b391ded-2bd5-4d78-81a2-43ce12ae551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:43.260303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7b391ded-2bd5-4d78-81a2-43ce12ae551a None None] MFA Rules not processed for user `e00de88599524774b529972a8eb76ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:43.261941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7b391ded-2bd5-4d78-81a2-43ce12ae551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:43.267186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5346314-551f-44ad-be39-98c1eb0a5171 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:43.391494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 874/1776] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:43.392608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b391ded-2bd5-4d78-81a2-43ce12ae551a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:43.393914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7b391ded-2bd5-4d78-81a2-43ce12ae551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:43.464745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:43.477524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3541da-1844-4d58-b61b-eb71fb9fee42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:43.478232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3541da-1844-4d58-b61b-eb71fb9fee42 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:43.478536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3541da-1844-4d58-b61b-eb71fb9fee42 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:43.478732 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3541da-1844-4d58-b61b-eb71fb9fee42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:43.486699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6e3541da-1844-4d58-b61b-eb71fb9fee42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:43.507874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:43.515920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b391ded-2bd5-4d78-81a2-43ce12ae551a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:43.542478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a9a59-b2ff-4a8d-8d2e-3fbf7c8e4855 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '559a4af215324597b203e6866cb51fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:43.543351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a9a59-b2ff-4a8d-8d2e-3fbf7c8e4855 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:43.543634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a9a59-b2ff-4a8d-8d2e-3fbf7c8e4855 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:43.544150 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a9a59-b2ff-4a8d-8d2e-3fbf7c8e4855 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:43.547189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b06a9a59-b2ff-4a8d-8d2e-3fbf7c8e4855 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:43.579007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a9a59-b2ff-4a8d-8d2e-3fbf7c8e4855 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:43.584732 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a9a59-b2ff-4a8d-8d2e-3fbf7c8e4855 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:43.586846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3541da-1844-4d58-b61b-eb71fb9fee42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:43.595198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3541da-1844-4d58-b61b-eb71fb9fee42 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:43.613844 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 903/1777] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:43.615475 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3541da-1844-4d58-b61b-eb71fb9fee42 service nova] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:43.631875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 875/1778] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:43.645832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a9a59-b2ff-4a8d-8d2e-3fbf7c8e4855 service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:43.827096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3541da-1844-4d58-b61b-eb71fb9fee42 service nova] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:43.834547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140e4af-a8b9-4f48-85a5-3eb0602085cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:43.835328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140e4af-a8b9-4f48-85a5-3eb0602085cf admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:43.835742 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140e4af-a8b9-4f48-85a5-3eb0602085cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:43.838362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140e4af-a8b9-4f48-85a5-3eb0602085cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:43.838521 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140e4af-a8b9-4f48-85a5-3eb0602085cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:43.847369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140e4af-a8b9-4f48-85a5-3eb0602085cf admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:43.949607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 904/1779] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:43 2022] POST /identity/v3/projects => generated 377 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:43.951315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140e4af-a8b9-4f48-85a5-3eb0602085cf admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:43.962701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a9a59-b2ff-4a8d-8d2e-3fbf7c8e4855 service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:44.195290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140e4af-a8b9-4f48-85a5-3eb0602085cf admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:44.202779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9410601-deb4-4d27-bdb2-34c8d89bec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:44.203423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9410601-deb4-4d27-bdb2-34c8d89bec53 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:44.203783 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9410601-deb4-4d27-bdb2-34c8d89bec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:44.204001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9410601-deb4-4d27-bdb2-34c8d89bec53 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:44.205392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9410601-deb4-4d27-bdb2-34c8d89bec53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:44.207402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9410601-deb4-4d27-bdb2-34c8d89bec53 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:44.211773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb73b66-f9f1-4efe-9ed3-f999f18926ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:44.212408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb73b66-f9f1-4efe-9ed3-f999f18926ef admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:44.212688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb73b66-f9f1-4efe-9ed3-f999f18926ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:44.212960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb73b66-f9f1-4efe-9ed3-f999f18926ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:44.215155 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb73b66-f9f1-4efe-9ed3-f999f18926ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:44.216605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb73b66-f9f1-4efe-9ed3-f999f18926ef admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:44.253066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 876/1780] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:43 2022] POST /identity/v3/users => generated 296 bytes in 608 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:44.253943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9410601-deb4-4d27-bdb2-34c8d89bec53 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:44.275164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9410601-deb4-4d27-bdb2-34c8d89bec53 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:44.283053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 905/1781] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:28:43 2022] POST /identity/v3/projects => generated 363 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:44.283053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb73b66-f9f1-4efe-9ed3-f999f18926ef admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:44.295172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5372d-5bc6-486a-9243-2a8d457635a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:44.295805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5372d-5bc6-486a-9243-2a8d457635a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:44.296064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5372d-5bc6-486a-9243-2a8d457635a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:44.296344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5372d-5bc6-486a-9243-2a8d457635a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:44.296989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5372d-5bc6-486a-9243-2a8d457635a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:44.299116 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5372d-5bc6-486a-9243-2a8d457635a2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:44.337061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:44.357978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 877/1782] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:44 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:44.358978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5372d-5bc6-486a-9243-2a8d457635a2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:44.387015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5372d-5bc6-486a-9243-2a8d457635a2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:44.434327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb73b66-f9f1-4efe-9ed3-f999f18926ef admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:44.446243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb65986-3a1e-44ad-83fe-6c3fefbdb450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:44.447180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb65986-3a1e-44ad-83fe-6c3fefbdb450 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:44.447530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb65986-3a1e-44ad-83fe-6c3fefbdb450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:44.447979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb65986-3a1e-44ad-83fe-6c3fefbdb450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:44.450054 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb65986-3a1e-44ad-83fe-6c3fefbdb450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:44.454177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb65986-3a1e-44ad-83fe-6c3fefbdb450 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:44.492858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 906/1783] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:44.493912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb65986-3a1e-44ad-83fe-6c3fefbdb450 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:44.505608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:44.519074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd6efc-d48a-4e6b-980c-490993157109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:44.520028 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd6efc-d48a-4e6b-980c-490993157109 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:44.520388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd6efc-d48a-4e6b-980c-490993157109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:44.520825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd6efc-d48a-4e6b-980c-490993157109 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:44.521572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd6efc-d48a-4e6b-980c-490993157109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:44.524807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd6efc-d48a-4e6b-980c-490993157109 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:44.540649 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb65986-3a1e-44ad-83fe-6c3fefbdb450 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:44.548006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714074d1-2d18-4ddb-99ff-fdeb676fdeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:44.549346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714074d1-2d18-4ddb-99ff-fdeb676fdeca admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:44.549773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714074d1-2d18-4ddb-99ff-fdeb676fdeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:44.550053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714074d1-2d18-4ddb-99ff-fdeb676fdeca admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:44.551053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714074d1-2d18-4ddb-99ff-fdeb676fdeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:44.553364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714074d1-2d18-4ddb-99ff-fdeb676fdeca admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:44.572622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 878/1784] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:28:44 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:28:44.574689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd6efc-d48a-4e6b-980c-490993157109 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:44.575312 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 907/1785] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:44.577380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714074d1-2d18-4ddb-99ff-fdeb676fdeca admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:44.592695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714074d1-2d18-4ddb-99ff-fdeb676fdeca admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:44.598946 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c187d0-b78b-4390-91e9-127d562d5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:44.599624 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c187d0-b78b-4390-91e9-127d562d5ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:44.599918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c187d0-b78b-4390-91e9-127d562d5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:44.600198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c187d0-b78b-4390-91e9-127d562d5ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:44.600865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c187d0-b78b-4390-91e9-127d562d5ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:44.602800 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c187d0-b78b-4390-91e9-127d562d5ae8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:44.607848 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd6efc-d48a-4e6b-980c-490993157109 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:44.613084 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb88ed-11d1-4e5d-9885-39d6e7871e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:44.613763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb88ed-11d1-4e5d-9885-39d6e7871e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:44.614043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb88ed-11d1-4e5d-9885-39d6e7871e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:44.614318 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb88ed-11d1-4e5d-9885-39d6e7871e74 admin admin] PATH_INFO: `/v3/projects/5509d60309ad4dd68e18c496fcbb35ff/users/7ae27ac9d97a43e59acb9881366a9948/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:44.619280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 908/1786] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:44.619280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c187d0-b78b-4390-91e9-127d562d5ae8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:44.633214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c187d0-b78b-4390-91e9-127d562d5ae8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:44.641780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fad809-b51e-4237-b96b-0c6d6e060743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:44.642495 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fad809-b51e-4237-b96b-0c6d6e060743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:44.642793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fad809-b51e-4237-b96b-0c6d6e060743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:44.643060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fad809-b51e-4237-b96b-0c6d6e060743 admin admin] PATH_INFO: `/v3/projects/20198d1be39740e897d94987a02f60e1/users/4bf49e8124f44dff9d52c86d5ba8c3fd/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:44.649546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb88ed-11d1-4e5d-9885-39d6e7871e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5509d60309ad4dd68e18c496fcbb35ff, user_id=7ae27ac9d97a43e59acb9881366a9948, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:44.651983 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb88ed-11d1-4e5d-9885-39d6e7871e74 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:44.675746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fad809-b51e-4237-b96b-0c6d6e060743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20198d1be39740e897d94987a02f60e1, user_id=4bf49e8124f44dff9d52c86d5ba8c3fd, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:44.678719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fad809-b51e-4237-b96b-0c6d6e060743 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:44.685244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 879/1787] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:44 2022] PUT /identity/v3/projects/5509d60309ad4dd68e18c496fcbb35ff/users/7ae27ac9d97a43e59acb9881366a9948/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:44.686212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb88ed-11d1-4e5d-9885-39d6e7871e74 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:44.711753 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 909/1788] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:44 2022] PUT /identity/v3/projects/20198d1be39740e897d94987a02f60e1/users/4bf49e8124f44dff9d52c86d5ba8c3fd/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:44.712662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fad809-b51e-4237-b96b-0c6d6e060743 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:44.802816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb88ed-11d1-4e5d-9885-39d6e7871e74 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:44.840029 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fad809-b51e-4237-b96b-0c6d6e060743 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:44.874525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21565b37-98d9-4e33-b146-520791867b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:44.875160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21565b37-98d9-4e33-b146-520791867b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:44.875439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21565b37-98d9-4e33-b146-520791867b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:44.875712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21565b37-98d9-4e33-b146-520791867b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:44.876375 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21565b37-98d9-4e33-b146-520791867b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:44.878027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21565b37-98d9-4e33-b146-520791867b74 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:44.919760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 910/1789] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:44.920750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21565b37-98d9-4e33-b146-520791867b74 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:44.957760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21565b37-98d9-4e33-b146-520791867b74 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:44.963863 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d365ad6-823f-49b9-a569-bb2865223859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:44.965648 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d365ad6-823f-49b9-a569-bb2865223859 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:44.966140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d365ad6-823f-49b9-a569-bb2865223859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:44.967103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d365ad6-823f-49b9-a569-bb2865223859 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:44.968227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d365ad6-823f-49b9-a569-bb2865223859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:44.970450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d365ad6-823f-49b9-a569-bb2865223859 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:44.986952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 911/1790] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:44.987993 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d365ad6-823f-49b9-a569-bb2865223859 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:45.000928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d365ad6-823f-49b9-a569-bb2865223859 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:45.002063 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66234020-a467-4bab-b0a4-4d185869f6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:45.003890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66234020-a467-4bab-b0a4-4d185869f6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:45.004720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66234020-a467-4bab-b0a4-4d185869f6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:45.005703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66234020-a467-4bab-b0a4-4d185869f6a8 admin admin] PATH_INFO: `/v3/projects/37dd00dcd70c4a969ad198f1b2985238/users/ae1d96e584774ef4b34fe1350871ceaf/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:45.007004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b785e-5a50-457a-ba28-f490e4b5902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:45.007636 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b785e-5a50-457a-ba28-f490e4b5902f admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:45.007986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b785e-5a50-457a-ba28-f490e4b5902f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:45.008333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b785e-5a50-457a-ba28-f490e4b5902f admin admin] PATH_INFO: `/v3/projects/5509d60309ad4dd68e18c496fcbb35ff/users/7ae27ac9d97a43e59acb9881366a9948/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:45.010616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b785e-5a50-457a-ba28-f490e4b5902f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5509d60309ad4dd68e18c496fcbb35ff, user_id=7ae27ac9d97a43e59acb9881366a9948, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:45.013590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b785e-5a50-457a-ba28-f490e4b5902f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:45.034892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 912/1791] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:44 2022] PUT /identity/v3/projects/5509d60309ad4dd68e18c496fcbb35ff/users/7ae27ac9d97a43e59acb9881366a9948/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:45.035872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b785e-5a50-457a-ba28-f490e4b5902f admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:45.057762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66234020-a467-4bab-b0a4-4d185869f6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dd00dcd70c4a969ad198f1b2985238, user_id=ae1d96e584774ef4b34fe1350871ceaf, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:45.065495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66234020-a467-4bab-b0a4-4d185869f6a8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:45.094960 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 880/1792] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:44 2022] PUT /identity/v3/projects/37dd00dcd70c4a969ad198f1b2985238/users/ae1d96e584774ef4b34fe1350871ceaf/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:45.094960 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66234020-a467-4bab-b0a4-4d185869f6a8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:45.118367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:45.136726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b785e-5a50-457a-ba28-f490e4b5902f admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:45.209529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:45.226703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66234020-a467-4bab-b0a4-4d185869f6a8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:45.235374 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2206b2-3fd4-47c5-ba64-4ab6b02005ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:45.236344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2206b2-3fd4-47c5-ba64-4ab6b02005ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:45.237046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2206b2-3fd4-47c5-ba64-4ab6b02005ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:45.237397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2206b2-3fd4-47c5-ba64-4ab6b02005ee admin admin] PATH_INFO: `/v3/projects/20198d1be39740e897d94987a02f60e1/users/4bf49e8124f44dff9d52c86d5ba8c3fd/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:45.240309 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2206b2-3fd4-47c5-ba64-4ab6b02005ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=20198d1be39740e897d94987a02f60e1, user_id=4bf49e8124f44dff9d52c86d5ba8c3fd, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:45.244512 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2206b2-3fd4-47c5-ba64-4ab6b02005ee admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:45.262519 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973bd24-2bb6-4dd6-9630-8b99b875d3b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:45.264901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973bd24-2bb6-4dd6-9630-8b99b875d3b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:45.265612 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973bd24-2bb6-4dd6-9630-8b99b875d3b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:45.265612 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973bd24-2bb6-4dd6-9630-8b99b875d3b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:45.270614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 881/1793] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:45 2022] PUT /identity/v3/projects/20198d1be39740e897d94987a02f60e1/users/4bf49e8124f44dff9d52c86d5ba8c3fd/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:45.286552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021908d2-e2df-4829-b801-fb8a701f2db1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:45.286756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021908d2-e2df-4829-b801-fb8a701f2db1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:45.287394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021908d2-e2df-4829-b801-fb8a701f2db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:45.351437 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-021908d2-e2df-4829-b801-fb8a701f2db1 None None] MFA Rules not processed for user `7ae27ac9d97a43e59acb9881366a9948`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:45.353402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-021908d2-e2df-4829-b801-fb8a701f2db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:45.439258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973bd24-2bb6-4dd6-9630-8b99b875d3b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:45.442420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973bd24-2bb6-4dd6-9630-8b99b875d3b6 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:45.486059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 913/1794] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:45.492981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 882/1795] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:45.501298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973bd24-2bb6-4dd6-9630-8b99b875d3b6 service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:45.501944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab58b5d-9b2f-441b-a74b-9fe14196dba3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:45.502363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab58b5d-9b2f-441b-a74b-9fe14196dba3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:45.502691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab58b5d-9b2f-441b-a74b-9fe14196dba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:45.520349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973bd24-2bb6-4dd6-9630-8b99b875d3b6 service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:45.550201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9ab58b5d-9b2f-441b-a74b-9fe14196dba3 None None] MFA Rules not processed for user `4bf49e8124f44dff9d52c86d5ba8c3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:45.551679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ab58b5d-9b2f-441b-a74b-9fe14196dba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:45.737999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 883/1796] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:45.739057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab58b5d-9b2f-441b-a74b-9fe14196dba3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:45.742571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ab58b5d-9b2f-441b-a74b-9fe14196dba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:45.756174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85d168-a18c-4277-91f0-40930e83fa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:45.756810 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85d168-a18c-4277-91f0-40930e83fa02 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:45.764502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85d168-a18c-4277-91f0-40930e83fa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:45.767453 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85d168-a18c-4277-91f0-40930e83fa02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:45.769085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85d168-a18c-4277-91f0-40930e83fa02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:45.774266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85d168-a18c-4277-91f0-40930e83fa02 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:45.859515 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 914/1797] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:28:45.860789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85d168-a18c-4277-91f0-40930e83fa02 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:45.938408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:45.953146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85d168-a18c-4277-91f0-40930e83fa02 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:45.954428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab58b5d-9b2f-441b-a74b-9fe14196dba3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:45.959775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445200c9-cbe2-44c3-b806-0bb953511cbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:45.960486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445200c9-cbe2-44c3-b806-0bb953511cbb service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:45.960766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445200c9-cbe2-44c3-b806-0bb953511cbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:45.961040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445200c9-cbe2-44c3-b806-0bb953511cbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:45.975826 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37e136-2539-4dcb-8837-d40d6a1a08da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:45.976756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37e136-2539-4dcb-8837-d40d6a1a08da service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:45.977088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37e136-2539-4dcb-8837-d40d6a1a08da service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:45.977366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37e136-2539-4dcb-8837-d40d6a1a08da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:46.009047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37e136-2539-4dcb-8837-d40d6a1a08da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:46.015963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37e136-2539-4dcb-8837-d40d6a1a08da service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:46.035347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:46.052471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 884/1798] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:46.054293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37e136-2539-4dcb-8837-d40d6a1a08da service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:46.090808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37e136-2539-4dcb-8837-d40d6a1a08da service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:46.092738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445200c9-cbe2-44c3-b806-0bb953511cbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:46.094857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445200c9-cbe2-44c3-b806-0bb953511cbb service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:46.114288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172312bf-5dd2-4d0d-a896-1cad216881df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:46.115485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172312bf-5dd2-4d0d-a896-1cad216881df admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:46.115485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172312bf-5dd2-4d0d-a896-1cad216881df admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:46.115706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172312bf-5dd2-4d0d-a896-1cad216881df admin admin] PATH_INFO: `/v3/projects/37dd00dcd70c4a969ad198f1b2985238/users/ae1d96e584774ef4b34fe1350871ceaf/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:46.127638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172312bf-5dd2-4d0d-a896-1cad216881df admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dd00dcd70c4a969ad198f1b2985238, user_id=ae1d96e584774ef4b34fe1350871ceaf, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:46.133810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172312bf-5dd2-4d0d-a896-1cad216881df admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:46.181598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 885/1799] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:28:46 2022] PUT /identity/v3/projects/37dd00dcd70c4a969ad198f1b2985238/users/ae1d96e584774ef4b34fe1350871ceaf/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:46.184694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 915/1800] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:46.192256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0489ea1-52fb-4559-b975-43912c0e6981 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:46.193066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0489ea1-52fb-4559-b975-43912c0e6981 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:46.193526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0489ea1-52fb-4559-b975-43912c0e6981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:46.252235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d0489ea1-52fb-4559-b975-43912c0e6981 None None] MFA Rules not processed for user `ae1d96e584774ef4b34fe1350871ceaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:46.256265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d0489ea1-52fb-4559-b975-43912c0e6981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:46.506828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 886/1801] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:46.590859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445200c9-cbe2-44c3-b806-0bb953511cbb service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:46.602488 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445200c9-cbe2-44c3-b806-0bb953511cbb service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:46.704503 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65886a-5e4f-44b9-9b85-0c980b41cd7c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:46.705168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65886a-5e4f-44b9-9b85-0c980b41cd7c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:46.705168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65886a-5e4f-44b9-9b85-0c980b41cd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:46.765977 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8d65886a-5e4f-44b9-9b85-0c980b41cd7c None None] MFA Rules not processed for user `e3a473b5ad2f43db852f57f83d48240b`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:46.766869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b71e6-e064-415c-aa64-99ba3191d2be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:46.767279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8d65886a-5e4f-44b9-9b85-0c980b41cd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:46.767644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b71e6-e064-415c-aa64-99ba3191d2be service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:46.768017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b71e6-e064-415c-aa64-99ba3191d2be service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:46.768294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b71e6-e064-415c-aa64-99ba3191d2be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:46.788358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b71e6-e064-415c-aa64-99ba3191d2be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:46.791631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b71e6-e064-415c-aa64-99ba3191d2be service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:46.824474 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 916/1802] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:46.890919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 887/1803] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:28:46.913629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b71e6-e064-415c-aa64-99ba3191d2be service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:46.944755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b71e6-e064-415c-aa64-99ba3191d2be service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:46.951754 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6d354-3535-4e27-a6a6-9a390cf04d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:46.952525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d354-3535-4e27-a6a6-9a390cf04d5e service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:46.952819 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d354-3535-4e27-a6a6-9a390cf04d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:46.953186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d354-3535-4e27-a6a6-9a390cf04d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:47.118920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6d354-3535-4e27-a6a6-9a390cf04d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:47.124660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6d354-3535-4e27-a6a6-9a390cf04d5e service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:47.147160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 917/1804] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:47.504066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65886a-5e4f-44b9-9b85-0c980b41cd7c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:47.551480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65886a-5e4f-44b9-9b85-0c980b41cd7c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:47.563155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17a2d6-7ee7-441a-add4-465f035e33a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:47.564234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17a2d6-7ee7-441a-add4-465f035e33a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:47.564670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17a2d6-7ee7-441a-add4-465f035e33a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:47.565085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17a2d6-7ee7-441a-add4-465f035e33a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:47.725784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17a2d6-7ee7-441a-add4-465f035e33a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:47.728141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17a2d6-7ee7-441a-add4-465f035e33a4 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:47.742752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 888/1805] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:48.002134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c25d24-0ce3-4603-9044-2f3032214e11 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:48.002913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c25d24-0ce3-4603-9044-2f3032214e11 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:48.002913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c25d24-0ce3-4603-9044-2f3032214e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:48.075503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f8c25d24-0ce3-4603-9044-2f3032214e11 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:48.077038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f8c25d24-0ce3-4603-9044-2f3032214e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:48.089789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:48.161154 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 918/1806] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:28:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:48.263463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17a2d6-7ee7-441a-add4-465f035e33a4 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:48.265061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4e17a2d6-7ee7-441a-add4-465f035e33a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:48.304428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:48.515304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17a2d6-7ee7-441a-add4-465f035e33a4 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:48.523674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274b319-e0f9-4ae3-b04f-f2677fd28a55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:48.524569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274b319-e0f9-4ae3-b04f-f2677fd28a55 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:48.525011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274b319-e0f9-4ae3-b04f-f2677fd28a55 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:48.525429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274b319-e0f9-4ae3-b04f-f2677fd28a55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:48.540079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274b319-e0f9-4ae3-b04f-f2677fd28a55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:48.542518 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274b319-e0f9-4ae3-b04f-f2677fd28a55 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:48.570791 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 889/1807] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:28:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:28:48.708459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c25d24-0ce3-4603-9044-2f3032214e11 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:48.721241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c25d24-0ce3-4603-9044-2f3032214e11 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:48.728734 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012bc91-452e-49a9-befd-ba5e5989a87a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:48.731099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012bc91-452e-49a9-befd-ba5e5989a87a service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:48.731554 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012bc91-452e-49a9-befd-ba5e5989a87a service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:48.733901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012bc91-452e-49a9-befd-ba5e5989a87a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:48.942621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012bc91-452e-49a9-befd-ba5e5989a87a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:48.945304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012bc91-452e-49a9-befd-ba5e5989a87a service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:49.002900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 919/1808] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:50.362547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e2b10-b2ac-423b-b732-1c7cabdce3c6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:50.363061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e2b10-b2ac-423b-b732-1c7cabdce3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:50.363384 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e2b10-b2ac-423b-b732-1c7cabdce3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:50.403665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0d8e2b10-b2ac-423b-b732-1c7cabdce3c6 None None] MFA Rules not processed for user `b1d4b0f322c741c5b69b922071aab3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:50.405429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0d8e2b10-b2ac-423b-b732-1c7cabdce3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:50.579073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 890/1809] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Sep 12 23:28:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:50.941406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012bc91-452e-49a9-befd-ba5e5989a87a service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:50.945074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3012bc91-452e-49a9-befd-ba5e5989a87a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:51.015715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012bc91-452e-49a9-befd-ba5e5989a87a service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:51.032715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319a400-ac3b-4847-99ec-99e2a627c0c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:51.034742 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319a400-ac3b-4847-99ec-99e2a627c0c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:51.037139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319a400-ac3b-4847-99ec-99e2a627c0c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:51.038154 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319a400-ac3b-4847-99ec-99e2a627c0c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:51.064422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319a400-ac3b-4847-99ec-99e2a627c0c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:51.069002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319a400-ac3b-4847-99ec-99e2a627c0c7 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:51.102774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 920/1810] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:53.542014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3493c62-f051-41a3-bc95-171416852065 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:53.546220 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3493c62-f051-41a3-bc95-171416852065 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:53.546787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3493c62-f051-41a3-bc95-171416852065 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:53.549707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 891/1811] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:28:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:28:53.612844 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64609967-1b6d-4e7f-86b8-1bbdc2c91380 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:53.613864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64609967-1b6d-4e7f-86b8-1bbdc2c91380 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:53.614367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64609967-1b6d-4e7f-86b8-1bbdc2c91380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:53.689520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-64609967-1b6d-4e7f-86b8-1bbdc2c91380 None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:53.692879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-64609967-1b6d-4e7f-86b8-1bbdc2c91380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:53.971373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 921/1812] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:28:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:54.011864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3493c62-f051-41a3-bc95-171416852065 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:54.201635 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3493c62-f051-41a3-bc95-171416852065 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:54.216753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:54.218172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:54.218508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:54.219900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] PATH_INFO: `/v3/users/7e95dfb00f7c4253a73bfcebbc0523b4` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:54.222124 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e95dfb00f7c4253a73bfcebbc0523b4)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:54.225752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:54.263234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64609967-1b6d-4e7f-86b8-1bbdc2c91380 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:54.290811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64609967-1b6d-4e7f-86b8-1bbdc2c91380 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:54.303739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b20a7-7591-4ffc-8912-a5da240a0bc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:54.304381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b20a7-7591-4ffc-8912-a5da240a0bc6 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:54.304655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b20a7-7591-4ffc-8912-a5da240a0bc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:54.304962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b20a7-7591-4ffc-8912-a5da240a0bc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:54.335552 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b20a7-7591-4ffc-8912-a5da240a0bc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:54.338400 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b20a7-7591-4ffc-8912-a5da240a0bc6 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:54.369611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 922/1813] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:28:54.376909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:54.421513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e95dfb00f7c4253a73bfcebbc0523b4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:54.460669 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e95dfb00f7c4253a73bfcebbc0523b4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:54.492710 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e95dfb00f7c4253a73bfcebbc0523b4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:54.493486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e95dfb00f7c4253a73bfcebbc0523b4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:54.494107 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e95dfb00f7c4253a73bfcebbc0523b4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:54.518772 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 892/1814] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:54 2022] DELETE /identity/v3/users/7e95dfb00f7c4253a73bfcebbc0523b4 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:54.524867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd58572-f6d5-4c9d-90cf-5bd99613d6fc None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:54.525530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd58572-f6d5-4c9d-90cf-5bd99613d6fc None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:54.527815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd58572-f6d5-4c9d-90cf-5bd99613d6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:54.603585 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-4cd58572-f6d5-4c9d-90cf-5bd99613d6fc None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:54.609139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4cd58572-f6d5-4c9d-90cf-5bd99613d6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:54.644249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:54.840011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 923/1815] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:55.048684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:55.050782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:55.218268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edd1a4-9d98-4db9-a276-f0e15b29b69c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:55.226553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825a68b-a8d4-445b-9211-5925845f4bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:55.227766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825a68b-a8d4-445b-9211-5925845f4bce service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:55.228330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825a68b-a8d4-445b-9211-5925845f4bce service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:55.228898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825a68b-a8d4-445b-9211-5925845f4bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:55.263550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825a68b-a8d4-445b-9211-5925845f4bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:55.265667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825a68b-a8d4-445b-9211-5925845f4bce service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:55.288651 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 893/1816] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:28:57.675181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd58572-f6d5-4c9d-90cf-5bd99613d6fc None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:57.677596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4cd58572-f6d5-4c9d-90cf-5bd99613d6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:57.699191 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd58572-f6d5-4c9d-90cf-5bd99613d6fc None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:57.711079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:57.715096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:57.715678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:57.716102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] PATH_INFO: `/v3/projects/eca7effeb67a4519bb745537a007a907` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:57.721022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca7effeb67a4519bb745537a007a907)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:57.728454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:57.864906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca7effeb67a4519bb745537a007a907', 'request_id': 'req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:57.879315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca7effeb67a4519bb745537a007a907', 'request_id': 'req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:57.891550 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca7effeb67a4519bb745537a007a907', 'request_id': 'req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:57.914258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] The token cache is being invalidate because project eca7effeb67a4519bb745537a007a907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:28:57.916618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:57.918641 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:57.925069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825a68b-a8d4-445b-9211-5925845f4bce service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:57.926564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 924/1817] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:28:57 2022] DELETE /identity/v3/projects/eca7effeb67a4519bb745537a007a907 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:57.946619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825a68b-a8d4-445b-9211-5925845f4bce service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:58.071798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:58.074053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:58.170752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:58.171804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:58.172842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:58.173260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] PATH_INFO: `/v3/users/4bf49e8124f44dff9d52c86d5ba8c3fd` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:58.176012 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf49e8124f44dff9d52c86d5ba8c3fd)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:58.181785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:58.291466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc20c73-11d6-4f4c-90d5-811b0fac9b5e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:58.315227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52363b9c-277d-476e-abec-c2565cade8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:58.317087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52363b9c-277d-476e-abec-c2565cade8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:58.317955 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52363b9c-277d-476e-abec-c2565cade8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:58.319430 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52363b9c-277d-476e-abec-c2565cade8db admin admin] PATH_INFO: `/v3/users/68d4af040a7c45b7ae4a882d6cbfd4ab` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:58.321924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52363b9c-277d-476e-abec-c2565cade8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d4af040a7c45b7ae4a882d6cbfd4ab)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:58.329440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52363b9c-277d-476e-abec-c2565cade8db admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:58.337998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf49e8124f44dff9d52c86d5ba8c3fd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:58.365456 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf49e8124f44dff9d52c86d5ba8c3fd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:58.374509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:58.422556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf49e8124f44dff9d52c86d5ba8c3fd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:58.424535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:58.427441 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf49e8124f44dff9d52c86d5ba8c3fd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:58.428957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf49e8124f44dff9d52c86d5ba8c3fd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:58.455657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-52363b9c-277d-476e-abec-c2565cade8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d4af040a7c45b7ae4a882d6cbfd4ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:58.467347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 894/1818] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:57 2022] DELETE /identity/v3/users/4bf49e8124f44dff9d52c86d5ba8c3fd => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:58.470599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:58.474411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:58.493476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-52363b9c-277d-476e-abec-c2565cade8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d4af040a7c45b7ae4a882d6cbfd4ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:58.520709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-52363b9c-277d-476e-abec-c2565cade8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d4af040a7c45b7ae4a882d6cbfd4ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:58.524480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-52363b9c-277d-476e-abec-c2565cade8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d4af040a7c45b7ae4a882d6cbfd4ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:58.533528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-52363b9c-277d-476e-abec-c2565cade8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d4af040a7c45b7ae4a882d6cbfd4ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:58.597934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 925/1819] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:58 2022] DELETE /identity/v3/users/68d4af040a7c45b7ae4a882d6cbfd4ab => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:58.600352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c39996-a148-4b3f-803e-37d1b173f178 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:58.602959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c39996-a148-4b3f-803e-37d1b173f178 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:58.605610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c39996-a148-4b3f-803e-37d1b173f178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:58.680856 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e3c39996-a148-4b3f-803e-37d1b173f178 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:58.686584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e3c39996-a148-4b3f-803e-37d1b173f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:58.751638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e7fda-14c5-4fe4-9504-a8f85f79d1fe admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:58.837989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f8641-2ba8-4597-8ec2-c6b1b23ef4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:58.838880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8641-2ba8-4597-8ec2-c6b1b23ef4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:58.839278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8641-2ba8-4597-8ec2-c6b1b23ef4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:58.839654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8641-2ba8-4597-8ec2-c6b1b23ef4a8 admin admin] PATH_INFO: `/v3/users/e00de88599524774b529972a8eb76ac5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:58.841155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f8641-2ba8-4597-8ec2-c6b1b23ef4a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00de88599524774b529972a8eb76ac5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:58.843435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f8641-2ba8-4597-8ec2-c6b1b23ef4a8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:58.853422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 926/1820] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:58.872373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c39996-a148-4b3f-803e-37d1b173f178 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:58.874292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e3c39996-a148-4b3f-803e-37d1b173f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:58.955320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-328f8641-2ba8-4597-8ec2-c6b1b23ef4a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00de88599524774b529972a8eb76ac5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:58.980216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-328f8641-2ba8-4597-8ec2-c6b1b23ef4a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00de88599524774b529972a8eb76ac5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:59.008969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-328f8641-2ba8-4597-8ec2-c6b1b23ef4a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00de88599524774b529972a8eb76ac5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:59.013058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-328f8641-2ba8-4597-8ec2-c6b1b23ef4a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00de88599524774b529972a8eb76ac5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:59.015927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-328f8641-2ba8-4597-8ec2-c6b1b23ef4a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00de88599524774b529972a8eb76ac5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:28:59.016512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c39996-a148-4b3f-803e-37d1b173f178 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:59.036557 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ffcbe-73e2-46c2-9b2e-bc9a3b390878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:59.039406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ffcbe-73e2-46c2-9b2e-bc9a3b390878 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:59.039703 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ffcbe-73e2-46c2-9b2e-bc9a3b390878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:59.039981 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ffcbe-73e2-46c2-9b2e-bc9a3b390878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:59.047096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-336ffcbe-73e2-46c2-9b2e-bc9a3b390878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:59.055527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 895/1821] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:28:58 2022] DELETE /identity/v3/users/e00de88599524774b529972a8eb76ac5 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:28:59.061806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f2cc-3ebd-4a74-bdd9-7ed6f906d237 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:59.062097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f2cc-3ebd-4a74-bdd9-7ed6f906d237 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:59.062370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f2cc-3ebd-4a74-bdd9-7ed6f906d237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:59.075931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ffcbe-73e2-46c2-9b2e-bc9a3b390878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:59.078207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ffcbe-73e2-46c2-9b2e-bc9a3b390878 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:59.087253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:59.096474 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 927/1822] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:28:59.121873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b1c2f2cc-3ebd-4a74-bdd9-7ed6f906d237 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:28:59.124418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b1c2f2cc-3ebd-4a74-bdd9-7ed6f906d237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:59.314359 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 896/1823] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:28:59.362136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ffcbe-73e2-46c2-9b2e-bc9a3b390878 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:28:59.364360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-336ffcbe-73e2-46c2-9b2e-bc9a3b390878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:28:59.390549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ffcbe-73e2-46c2-9b2e-bc9a3b390878 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:28:59.497712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20d624-607c-4d68-a0ca-3eec0b969c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:28:59.498637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20d624-607c-4d68-a0ca-3eec0b969c07 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:28:59.500144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20d624-607c-4d68-a0ca-3eec0b969c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:28:59.500663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20d624-607c-4d68-a0ca-3eec0b969c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:28:59.530189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20d624-607c-4d68-a0ca-3eec0b969c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:28:59.531654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20d624-607c-4d68-a0ca-3eec0b969c07 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:28:59.546103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:59.571568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 928/1824] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:00.376104 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2f2cc-3ebd-4a74-bdd9-7ed6f906d237 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:00.383208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b1c2f2cc-3ebd-4a74-bdd9-7ed6f906d237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:00.412921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2f2cc-3ebd-4a74-bdd9-7ed6f906d237 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:00.436949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:00.440428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:00.440770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:00.442121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] PATH_INFO: `/v3/projects/498baf1b77d54c4e9677c6c6155bc0c1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:00.444667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498baf1b77d54c4e9677c6c6155bc0c1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:00.458750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:00.628616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498baf1b77d54c4e9677c6c6155bc0c1', 'request_id': 'req-99de2056-f125-4acb-ae29-dda9ca9eb413'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:00.655821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498baf1b77d54c4e9677c6c6155bc0c1', 'request_id': 'req-99de2056-f125-4acb-ae29-dda9ca9eb413'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:00.688200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498baf1b77d54c4e9677c6c6155bc0c1', 'request_id': 'req-99de2056-f125-4acb-ae29-dda9ca9eb413'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:00.746864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] The token cache is being invalidate because project 498baf1b77d54c4e9677c6c6155bc0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:00.747485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:00.748368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:00.757525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20d624-607c-4d68-a0ca-3eec0b969c07 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:00.758063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2b20d624-607c-4d68-a0ca-3eec0b969c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:00.758535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 897/1825] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:00 2022] DELETE /identity/v3/projects/498baf1b77d54c4e9677c6c6155bc0c1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:00.759676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:00.761978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:00.792197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20d624-607c-4d68-a0ca-3eec0b969c07 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:00.899744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de2056-f125-4acb-ae29-dda9ca9eb413 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:00.900366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284204f9-dad3-41a3-a0bd-036b93bc6c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:00.901330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284204f9-dad3-41a3-a0bd-036b93bc6c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:00.902642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284204f9-dad3-41a3-a0bd-036b93bc6c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:00.902988 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284204f9-dad3-41a3-a0bd-036b93bc6c84 admin admin] PATH_INFO: `/v3/projects/20198d1be39740e897d94987a02f60e1` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:00.907212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bade65-a462-4e12-9eb7-639b604afc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:00.907391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284204f9-dad3-41a3-a0bd-036b93bc6c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20198d1be39740e897d94987a02f60e1)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:00.910137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284204f9-dad3-41a3-a0bd-036b93bc6c84 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:00.920160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bade65-a462-4e12-9eb7-639b604afc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:00.920458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bade65-a462-4e12-9eb7-639b604afc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:00.920740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bade65-a462-4e12-9eb7-639b604afc15 admin admin] PATH_INFO: `/v3/users/7ae27ac9d97a43e59acb9881366a9948` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:00.926639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bade65-a462-4e12-9eb7-639b604afc15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ae27ac9d97a43e59acb9881366a9948)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:00.929263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bade65-a462-4e12-9eb7-639b604afc15 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:00.977645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:00.982520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-284204f9-dad3-41a3-a0bd-036b93bc6c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20198d1be39740e897d94987a02f60e1', 'request_id': 'req-284204f9-dad3-41a3-a0bd-036b93bc6c84'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:00.992828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-284204f9-dad3-41a3-a0bd-036b93bc6c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20198d1be39740e897d94987a02f60e1', 'request_id': 'req-284204f9-dad3-41a3-a0bd-036b93bc6c84'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.000492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-284204f9-dad3-41a3-a0bd-036b93bc6c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20198d1be39740e897d94987a02f60e1', 'request_id': 'req-284204f9-dad3-41a3-a0bd-036b93bc6c84'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.002610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-46bade65-a462-4e12-9eb7-639b604afc15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae27ac9d97a43e59acb9881366a9948'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.011588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-46bade65-a462-4e12-9eb7-639b604afc15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae27ac9d97a43e59acb9881366a9948'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.019921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-284204f9-dad3-41a3-a0bd-036b93bc6c84 admin admin] The token cache is being invalidate because project 20198d1be39740e897d94987a02f60e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:01.020288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-284204f9-dad3-41a3-a0bd-036b93bc6c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.021003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-284204f9-dad3-41a3-a0bd-036b93bc6c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.023140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 929/1826] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:00 2022] DELETE /identity/v3/projects/20198d1be39740e897d94987a02f60e1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:01.028515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-46bade65-a462-4e12-9eb7-639b604afc15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae27ac9d97a43e59acb9881366a9948'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.028697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1c2d4-8e17-4ba2-afb2-a2e73621f568 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:01.028807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1c2d4-8e17-4ba2-afb2-a2e73621f568 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:01.029077 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1c2d4-8e17-4ba2-afb2-a2e73621f568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:01.030073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-46bade65-a462-4e12-9eb7-639b604afc15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae27ac9d97a43e59acb9881366a9948'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.030831 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-46bade65-a462-4e12-9eb7-639b604afc15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae27ac9d97a43e59acb9881366a9948'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.046615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 898/1827] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:00 2022] DELETE /identity/v3/users/7ae27ac9d97a43e59acb9881366a9948 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:01.054140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-96f1c2d4-8e17-4ba2-afb2-a2e73621f568 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:01.055485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-96f1c2d4-8e17-4ba2-afb2-a2e73621f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:01.181704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 930/1828] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:01.190110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45038158-6da3-470f-8034-70c55b90b170 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:01.190418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45038158-6da3-470f-8034-70c55b90b170 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:01.191441 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45038158-6da3-470f-8034-70c55b90b170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:01.207523 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c215ddf-6e44-45d0-b2b4-bfef13d42a9b None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:01.207639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c215ddf-6e44-45d0-b2b4-bfef13d42a9b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:01.209168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c215ddf-6e44-45d0-b2b4-bfef13d42a9b None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:01.220293 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 931/1829] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:29:01 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:29:01.230033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-45038158-6da3-470f-8034-70c55b90b170 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:01.231252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-45038158-6da3-470f-8034-70c55b90b170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:01.244393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 899/1830] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:01.245883 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c215ddf-6e44-45d0-b2b4-bfef13d42a9b None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:01.271567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04ff78-5c82-4203-aaa2-323cf3b1a3f8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:01.271857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04ff78-5c82-4203-aaa2-323cf3b1a3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:01.272134 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04ff78-5c82-4203-aaa2-323cf3b1a3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:01.287803 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c215ddf-6e44-45d0-b2b4-bfef13d42a9b None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:01.300398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18ac52-519b-4c14-b790-e72ac4bddd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:01.301026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18ac52-519b-4c14-b790-e72ac4bddd49 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:01.301306 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18ac52-519b-4c14-b790-e72ac4bddd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:01.301763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18ac52-519b-4c14-b790-e72ac4bddd49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:01.302496 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18ac52-519b-4c14-b790-e72ac4bddd49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:01.303252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18ac52-519b-4c14-b790-e72ac4bddd49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:01.305141 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18ac52-519b-4c14-b790-e72ac4bddd49 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:01.313432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7c04ff78-5c82-4203-aaa2-323cf3b1a3f8 None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:01.315370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7c04ff78-5c82-4203-aaa2-323cf3b1a3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:01.322340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 932/1831] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:29:01.326482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18ac52-519b-4c14-b790-e72ac4bddd49 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:01.341797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18ac52-519b-4c14-b790-e72ac4bddd49 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:01.364012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8af56b-5990-422a-a987-027afa116a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:01.366662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8af56b-5990-422a-a987-027afa116a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:01.367168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8af56b-5990-422a-a987-027afa116a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:01.370983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8af56b-5990-422a-a987-027afa116a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:01.372282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8af56b-5990-422a-a987-027afa116a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:01.379996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8af56b-5990-422a-a987-027afa116a4f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:01.447085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:01.509607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 933/1832] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:01 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:01.511391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8af56b-5990-422a-a987-027afa116a4f admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:01.520246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7c8af56b-5990-422a-a987-027afa116a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:01.529697 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 900/1833] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:29:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:01.530738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04ff78-5c82-4203-aaa2-323cf3b1a3f8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:01.559126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04ff78-5c82-4203-aaa2-323cf3b1a3f8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:01.650497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1577d-4905-4ca0-9303-5b340d3eff1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:01.653062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8af56b-5990-422a-a987-027afa116a4f admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:01.658315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:01.659079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:01.659615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:01.659824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] PATH_INFO: `/v3/projects/5509d60309ad4dd68e18c496fcbb35ff` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:01.660102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1577d-4905-4ca0-9303-5b340d3eff1b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:01.660394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1577d-4905-4ca0-9303-5b340d3eff1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:01.660680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1577d-4905-4ca0-9303-5b340d3eff1b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:01.661288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5509d60309ad4dd68e18c496fcbb35ff)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:01.661401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1577d-4905-4ca0-9303-5b340d3eff1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:01.663881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:01.668137 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1577d-4905-4ca0-9303-5b340d3eff1b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:01.724270 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 901/1834] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:01 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:01.725168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1577d-4905-4ca0-9303-5b340d3eff1b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:01.727874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dbe1577d-4905-4ca0-9303-5b340d3eff1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:01.751721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5509d60309ad4dd68e18c496fcbb35ff', 'request_id': 'req-64ec1635-788d-4510-84e2-f626e7cfafc0'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.757267 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:01.766167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5509d60309ad4dd68e18c496fcbb35ff', 'request_id': 'req-64ec1635-788d-4510-84e2-f626e7cfafc0'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.790025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5509d60309ad4dd68e18c496fcbb35ff', 'request_id': 'req-64ec1635-788d-4510-84e2-f626e7cfafc0'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.813837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] The token cache is being invalidate because project 5509d60309ad4dd68e18c496fcbb35ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:01.814256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.815043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:01.820399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 934/1835] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:01 2022] DELETE /identity/v3/projects/5509d60309ad4dd68e18c496fcbb35ff => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:01.820399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:01.825148 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:01.845646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1577d-4905-4ca0-9303-5b340d3eff1b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:01.939716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ee2cf-e578-4be7-98e7-d58bc26c6af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:01.939982 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec1635-788d-4510-84e2-f626e7cfafc0 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:01.940612 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee2cf-e578-4be7-98e7-d58bc26c6af3 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:01.941194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee2cf-e578-4be7-98e7-d58bc26c6af3 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:01.941543 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee2cf-e578-4be7-98e7-d58bc26c6af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:01.943470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a76ee2cf-e578-4be7-98e7-d58bc26c6af3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:01.945160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f7ffb-0bc7-4680-b8ed-0a26860a2eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:01.945868 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f7ffb-0bc7-4680-b8ed-0a26860a2eae admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:01.946161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f7ffb-0bc7-4680-b8ed-0a26860a2eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:01.946474 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f7ffb-0bc7-4680-b8ed-0a26860a2eae admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:01.947129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f7ffb-0bc7-4680-b8ed-0a26860a2eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:01.949123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f7ffb-0bc7-4680-b8ed-0a26860a2eae admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:01.956185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ee2cf-e578-4be7-98e7-d58bc26c6af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:01.957793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ee2cf-e578-4be7-98e7-d58bc26c6af3 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:01.962575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 935/1836] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:01.965409 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6050ded-8360-40b3-8170-3791c9785d36 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:01.966139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6050ded-8360-40b3-8170-3791c9785d36 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:01.966444 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6050ded-8360-40b3-8170-3791c9785d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:01.969691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 902/1837] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:01.970636 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ee2cf-e578-4be7-98e7-d58bc26c6af3 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:01.982757 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ee2cf-e578-4be7-98e7-d58bc26c6af3 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:01.989199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9561b8-7891-4a3e-b36c-b8cee860f750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:01.989816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9561b8-7891-4a3e-b36c-b8cee860f750 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:01.990144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9561b8-7891-4a3e-b36c-b8cee860f750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:01.990457 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9561b8-7891-4a3e-b36c-b8cee860f750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:01.991113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9561b8-7891-4a3e-b36c-b8cee860f750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:01.992973 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9561b8-7891-4a3e-b36c-b8cee860f750 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.001524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-d6050ded-8360-40b3-8170-3791c9785d36 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:02.003718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d6050ded-8360-40b3-8170-3791c9785d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:02.016615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 903/1838] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:02.019784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9561b8-7891-4a3e-b36c-b8cee860f750 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.031724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 936/1839] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:02.034723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ba6a2-0472-4c03-9fd4-397cbc662bdb None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.035022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ba6a2-0472-4c03-9fd4-397cbc662bdb None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.035285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ba6a2-0472-4c03-9fd4-397cbc662bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.044841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9561b8-7891-4a3e-b36c-b8cee860f750 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.071963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a515402-bc76-4dbb-8e92-c960c0a21eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.072641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a515402-bc76-4dbb-8e92-c960c0a21eca admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.073000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a515402-bc76-4dbb-8e92-c960c0a21eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.073395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a515402-bc76-4dbb-8e92-c960c0a21eca admin admin] PATH_INFO: `/v3/projects/ead0fa393e2f45439b101ea700151e6d/users/269df6f214bd4bb99e40acd73e775fc2/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.082825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-bd2ba6a2-0472-4c03-9fd4-397cbc662bdb None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:02.084016 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bd2ba6a2-0472-4c03-9fd4-397cbc662bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:02.099175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 937/1840] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:02.099175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ba6a2-0472-4c03-9fd4-397cbc662bdb None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.102335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bd2ba6a2-0472-4c03-9fd4-397cbc662bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:02.106848 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a515402-bc76-4dbb-8e92-c960c0a21eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead0fa393e2f45439b101ea700151e6d, user_id=269df6f214bd4bb99e40acd73e775fc2, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.109990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a515402-bc76-4dbb-8e92-c960c0a21eca admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.121059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ba6a2-0472-4c03-9fd4-397cbc662bdb None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.126839 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:02.131808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 904/1841] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:02 2022] PUT /identity/v3/projects/ead0fa393e2f45439b101ea700151e6d/users/269df6f214bd4bb99e40acd73e775fc2/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:02.133136 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a515402-bc76-4dbb-8e92-c960c0a21eca admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.202873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.203631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.204628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.204628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] PATH_INFO: `/v3/projects/0892e8936aac4520b5fe8f64dd3dc24a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.206207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0892e8936aac4520b5fe8f64dd3dc24a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.208178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.241802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a515402-bc76-4dbb-8e92-c960c0a21eca admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.249037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c3bb2-2c8f-4c13-a63a-bd87642a6e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.250449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c3bb2-2c8f-4c13-a63a-bd87642a6e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.250900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c3bb2-2c8f-4c13-a63a-bd87642a6e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.251616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c3bb2-2c8f-4c13-a63a-bd87642a6e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.252975 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c3bb2-2c8f-4c13-a63a-bd87642a6e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:02.253446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c3bb2-2c8f-4c13-a63a-bd87642a6e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.255798 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c3bb2-2c8f-4c13-a63a-bd87642a6e1d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.261237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0892e8936aac4520b5fe8f64dd3dc24a', 'request_id': 'req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:02.269677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0892e8936aac4520b5fe8f64dd3dc24a', 'request_id': 'req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:02.274098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 905/1842] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:29:02.277262 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0892e8936aac4520b5fe8f64dd3dc24a', 'request_id': 'req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:02.278003 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2315a01-bc81-4a50-bd1c-b3b827e0f6b6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.278566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2315a01-bc81-4a50-bd1c-b3b827e0f6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.279451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2315a01-bc81-4a50-bd1c-b3b827e0f6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.289019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:02.296719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] The token cache is being invalidate because project 0892e8936aac4520b5fe8f64dd3dc24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:02.297447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:02.299011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:02.317299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 938/1843] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:02 2022] DELETE /identity/v3/projects/0892e8936aac4520b5fe8f64dd3dc24a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:02.317299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.317299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:02.333532 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c2315a01-bc81-4a50-bd1c-b3b827e0f6b6 None None] MFA Rules not processed for user `269df6f214bd4bb99e40acd73e775fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:02.334819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c2315a01-bc81-4a50-bd1c-b3b827e0f6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:02.388237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6a37-f52f-45e6-82a1-3a13d9b910ff admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.393359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ae3dc-86c8-4584-90e6-87547ac060dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.394019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ae3dc-86c8-4584-90e6-87547ac060dd admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.394330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ae3dc-86c8-4584-90e6-87547ac060dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.394618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ae3dc-86c8-4584-90e6-87547ac060dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.395249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ae3dc-86c8-4584-90e6-87547ac060dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.397148 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ae3dc-86c8-4584-90e6-87547ac060dd admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.421396 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 906/1844] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:02.422783 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2315a01-bc81-4a50-bd1c-b3b827e0f6b6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.425966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c2315a01-bc81-4a50-bd1c-b3b827e0f6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:02.427060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 939/1845] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:02 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:02.428544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ae3dc-86c8-4584-90e6-87547ac060dd admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.434135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-976ae3dc-86c8-4584-90e6-87547ac060dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:02.440920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2315a01-bc81-4a50-bd1c-b3b827e0f6b6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.465397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:02.515950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.516749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.517106 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.517594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] PATH_INFO: `/v3/users/ae1d96e584774ef4b34fe1350871ceaf` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.519125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1d96e584774ef4b34fe1350871ceaf)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.521416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.523292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ae3dc-86c8-4584-90e6-87547ac060dd admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.530416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa9bad-b212-4a94-827d-8e78335a5f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.531329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa9bad-b212-4a94-827d-8e78335a5f4a admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.531802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa9bad-b212-4a94-827d-8e78335a5f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.532287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa9bad-b212-4a94-827d-8e78335a5f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.533210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa9bad-b212-4a94-827d-8e78335a5f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.535564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa9bad-b212-4a94-827d-8e78335a5f4a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.569613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 940/1846] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:02 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:02.569613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa9bad-b212-4a94-827d-8e78335a5f4a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.587752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1d96e584774ef4b34fe1350871ceaf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:02.601629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1d96e584774ef4b34fe1350871ceaf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:02.632785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1d96e584774ef4b34fe1350871ceaf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:02.634860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1d96e584774ef4b34fe1350871ceaf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:02.637845 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1d96e584774ef4b34fe1350871ceaf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:02.650570 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa9bad-b212-4a94-827d-8e78335a5f4a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.656399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6413cd5-4e66-4f0b-93a8-4565b216c57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.657031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6413cd5-4e66-4f0b-93a8-4565b216c57e admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.657312 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6413cd5-4e66-4f0b-93a8-4565b216c57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.657588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6413cd5-4e66-4f0b-93a8-4565b216c57e admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.658218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6413cd5-4e66-4f0b-93a8-4565b216c57e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.660506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6413cd5-4e66-4f0b-93a8-4565b216c57e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.664293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 907/1847] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:02 2022] DELETE /identity/v3/users/ae1d96e584774ef4b34fe1350871ceaf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:02.668192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.671259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:02.688300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 941/1848] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:02 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:02.692270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6413cd5-4e66-4f0b-93a8-4565b216c57e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.693652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:02.694431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b6413cd5-4e66-4f0b-93a8-4565b216c57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:02.711107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6413cd5-4e66-4f0b-93a8-4565b216c57e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.785734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da292185-02a2-4673-b6d1-b45c5a57c8cf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.792007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acef72b-d9fd-4734-a29f-3020632eab5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.792802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acef72b-d9fd-4734-a29f-3020632eab5c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.793206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acef72b-d9fd-4734-a29f-3020632eab5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.793486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acef72b-d9fd-4734-a29f-3020632eab5c admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.794195 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acef72b-d9fd-4734-a29f-3020632eab5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.795938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf130-0da9-483e-85f7-824b4bd62f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.795938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf130-0da9-483e-85f7-824b4bd62f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.796586 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acef72b-d9fd-4734-a29f-3020632eab5c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.797687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf130-0da9-483e-85f7-824b4bd62f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.797990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf130-0da9-483e-85f7-824b4bd62f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.798676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf130-0da9-483e-85f7-824b4bd62f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.800296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf130-0da9-483e-85f7-824b4bd62f05 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.814036 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 942/1849] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:02.817806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf130-0da9-483e-85f7-824b4bd62f05 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.823594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 908/1850] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:02 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:02.828067 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acef72b-d9fd-4734-a29f-3020632eab5c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.830527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf130-0da9-483e-85f7-824b4bd62f05 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.835864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb927-491b-4105-9bc3-c92730d6d9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.836724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb927-491b-4105-9bc3-c92730d6d9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.837074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb927-491b-4105-9bc3-c92730d6d9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.837930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb927-491b-4105-9bc3-c92730d6d9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.838922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fb927-491b-4105-9bc3-c92730d6d9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.839816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acef72b-d9fd-4734-a29f-3020632eab5c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.840478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fb927-491b-4105-9bc3-c92730d6d9b8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.846046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d060f-03d5-4473-9aa1-ea512a98ce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.847597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d060f-03d5-4473-9aa1-ea512a98ce30 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.847597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d060f-03d5-4473-9aa1-ea512a98ce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.848068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d060f-03d5-4473-9aa1-ea512a98ce30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.848694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d060f-03d5-4473-9aa1-ea512a98ce30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.850804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d060f-03d5-4473-9aa1-ea512a98ce30 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.853547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 943/1851] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:02.857935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb927-491b-4105-9bc3-c92730d6d9b8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.868088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 909/1852] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:02.869995 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d060f-03d5-4473-9aa1-ea512a98ce30 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.873465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb927-491b-4105-9bc3-c92730d6d9b8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.879043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38517e9-e335-44f4-af38-883cab171621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.879850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38517e9-e335-44f4-af38-883cab171621 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.880738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38517e9-e335-44f4-af38-883cab171621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.880738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38517e9-e335-44f4-af38-883cab171621 admin admin] PATH_INFO: `/v3/projects/c66671e83f6549808bf2997eb13ee505/users/74b8895e7f834cc68b0086de5505387e/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.881087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d060f-03d5-4473-9aa1-ea512a98ce30 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:02.888062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d1c74-0df1-41ef-9408-312eaff62bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:02.888806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d1c74-0df1-41ef-9408-312eaff62bff admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.889430 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d1c74-0df1-41ef-9408-312eaff62bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.889738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d1c74-0df1-41ef-9408-312eaff62bff admin admin] PATH_INFO: `/v3/projects/af7de361455943b8abb0ada784dd81fa/users/e8d775f912d746a4bcea5600dbe5de7e/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.899753 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38517e9-e335-44f4-af38-883cab171621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66671e83f6549808bf2997eb13ee505, user_id=74b8895e7f834cc68b0086de5505387e, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.903715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38517e9-e335-44f4-af38-883cab171621 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.910914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d1c74-0df1-41ef-9408-312eaff62bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7de361455943b8abb0ada784dd81fa, user_id=e8d775f912d746a4bcea5600dbe5de7e, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:02.914019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d1c74-0df1-41ef-9408-312eaff62bff admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:02.925174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:02.942941 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 944/1853] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:02 2022] PUT /identity/v3/projects/c66671e83f6549808bf2997eb13ee505/users/74b8895e7f834cc68b0086de5505387e/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:02.948931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305628e3-f5e2-4655-86b0-81beb89fefec None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:02.949234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305628e3-f5e2-4655-86b0-81beb89fefec None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:02.950748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305628e3-f5e2-4655-86b0-81beb89fefec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:02.962665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 910/1854] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:02 2022] PUT /identity/v3/projects/af7de361455943b8abb0ada784dd81fa/users/e8d775f912d746a4bcea5600dbe5de7e/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:02.966807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d1c74-0df1-41ef-9408-312eaff62bff admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:02.987434 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-305628e3-f5e2-4655-86b0-81beb89fefec None None] MFA Rules not processed for user `74b8895e7f834cc68b0086de5505387e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:02.988892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-305628e3-f5e2-4655-86b0-81beb89fefec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:03.113565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d1c74-0df1-41ef-9408-312eaff62bff admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.119258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb860bf-2fcd-4f7b-aeb8-bc3e635e50b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.121323 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb860bf-2fcd-4f7b-aeb8-bc3e635e50b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.121323 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb860bf-2fcd-4f7b-aeb8-bc3e635e50b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.121323 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb860bf-2fcd-4f7b-aeb8-bc3e635e50b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.121630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb860bf-2fcd-4f7b-aeb8-bc3e635e50b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.123515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb860bf-2fcd-4f7b-aeb8-bc3e635e50b5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.145852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 911/1855] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:03.146960 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb860bf-2fcd-4f7b-aeb8-bc3e635e50b5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.158882 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 945/1856] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:03.159894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305628e3-f5e2-4655-86b0-81beb89fefec None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.162692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2bb860bf-2fcd-4f7b-aeb8-bc3e635e50b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:03.185015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb860bf-2fcd-4f7b-aeb8-bc3e635e50b5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.189323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305628e3-f5e2-4655-86b0-81beb89fefec None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.190801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69660d-4afb-4475-b6f9-630e9f1c8041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.191373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69660d-4afb-4475-b6f9-630e9f1c8041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.191648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69660d-4afb-4475-b6f9-630e9f1c8041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.191975 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69660d-4afb-4475-b6f9-630e9f1c8041 admin admin] PATH_INFO: `/v3/projects/37dd00dcd70c4a969ad198f1b2985238` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.193266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69660d-4afb-4475-b6f9-630e9f1c8041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dd00dcd70c4a969ad198f1b2985238)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.196766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69660d-4afb-4475-b6f9-630e9f1c8041 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.197149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd5ebb-bcd3-4792-a099-51fc4ce692a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.198049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd5ebb-bcd3-4792-a099-51fc4ce692a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.198657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd5ebb-bcd3-4792-a099-51fc4ce692a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.199092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd5ebb-bcd3-4792-a099-51fc4ce692a4 admin admin] PATH_INFO: `/v3/projects/af7de361455943b8abb0ada784dd81fa/users/e8d775f912d746a4bcea5600dbe5de7e/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.202017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd5ebb-bcd3-4792-a099-51fc4ce692a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7de361455943b8abb0ada784dd81fa, user_id=e8d775f912d746a4bcea5600dbe5de7e, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.205172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd5ebb-bcd3-4792-a099-51fc4ce692a4 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.223824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 946/1857] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:03 2022] PUT /identity/v3/projects/af7de361455943b8abb0ada784dd81fa/users/e8d775f912d746a4bcea5600dbe5de7e/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:03.224733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd5ebb-bcd3-4792-a099-51fc4ce692a4 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.282261 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0e69660d-4afb-4475-b6f9-630e9f1c8041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dd00dcd70c4a969ad198f1b2985238', 'request_id': 'req-0e69660d-4afb-4475-b6f9-630e9f1c8041'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:03.297825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0e69660d-4afb-4475-b6f9-630e9f1c8041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dd00dcd70c4a969ad198f1b2985238', 'request_id': 'req-0e69660d-4afb-4475-b6f9-630e9f1c8041'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:03.299530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:03.315459 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0e69660d-4afb-4475-b6f9-630e9f1c8041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dd00dcd70c4a969ad198f1b2985238', 'request_id': 'req-0e69660d-4afb-4475-b6f9-630e9f1c8041'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:03.316673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd5ebb-bcd3-4792-a099-51fc4ce692a4 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.330446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0e69660d-4afb-4475-b6f9-630e9f1c8041 admin admin] The token cache is being invalidate because project 37dd00dcd70c4a969ad198f1b2985238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:03.331018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0e69660d-4afb-4475-b6f9-630e9f1c8041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:03.332031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0e69660d-4afb-4475-b6f9-630e9f1c8041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:03.334571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 912/1858] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:03 2022] DELETE /identity/v3/projects/37dd00dcd70c4a969ad198f1b2985238 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:03.336189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aca59-3694-4b35-91a9-402a90cc3d3a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.336575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aca59-3694-4b35-91a9-402a90cc3d3a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.337071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aca59-3694-4b35-91a9-402a90cc3d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.378874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-588aca59-3694-4b35-91a9-402a90cc3d3a None None] MFA Rules not processed for user `e8d775f912d746a4bcea5600dbe5de7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:03.380850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-588aca59-3694-4b35-91a9-402a90cc3d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:03.434899 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ba229-8222-4605-83b2-a8158ae203d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.435776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ba229-8222-4605-83b2-a8158ae203d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.436146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ba229-8222-4605-83b2-a8158ae203d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.436513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ba229-8222-4605-83b2-a8158ae203d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.437358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ba229-8222-4605-83b2-a8158ae203d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.439478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ba229-8222-4605-83b2-a8158ae203d8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.468175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 913/1859] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:03.469559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54e845-6852-493d-9ac9-0abfbcf52faf None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.469853 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54e845-6852-493d-9ac9-0abfbcf52faf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.470135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54e845-6852-493d-9ac9-0abfbcf52faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.472323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 947/1860] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:03 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:03.476508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ba229-8222-4605-83b2-a8158ae203d8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.478609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-070ba229-8222-4605-83b2-a8158ae203d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:03.490027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:03.498111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3b54e845-6852-493d-9ac9-0abfbcf52faf None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:03.499492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3b54e845-6852-493d-9ac9-0abfbcf52faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:03.558579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ba229-8222-4605-83b2-a8158ae203d8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.563345 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee34c0-0a24-4684-a708-926d7b878daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.563957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee34c0-0a24-4684-a708-926d7b878daa admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.564238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee34c0-0a24-4684-a708-926d7b878daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.564509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee34c0-0a24-4684-a708-926d7b878daa admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.565136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee34c0-0a24-4684-a708-926d7b878daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.567106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee34c0-0a24-4684-a708-926d7b878daa admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.579945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 914/1861] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:03.581175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54e845-6852-493d-9ac9-0abfbcf52faf None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.582937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3b54e845-6852-493d-9ac9-0abfbcf52faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:03.595391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 948/1862] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:03 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:29:03.596604 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e79da-1d65-4b29-a9a7-ae1d23bf4035 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.597022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e79da-1d65-4b29-a9a7-ae1d23bf4035 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.597307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e79da-1d65-4b29-a9a7-ae1d23bf4035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.616544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-776e79da-1d65-4b29-a9a7-ae1d23bf4035 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:03.617769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-776e79da-1d65-4b29-a9a7-ae1d23bf4035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:03.626424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 949/1863] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:03.627141 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e79da-1d65-4b29-a9a7-ae1d23bf4035 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.637433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e79da-1d65-4b29-a9a7-ae1d23bf4035 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.645083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54e845-6852-493d-9ac9-0abfbcf52faf None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.648770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88332645-703f-44f7-a9e1-0b457fcaceac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.649379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88332645-703f-44f7-a9e1-0b457fcaceac service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.649664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88332645-703f-44f7-a9e1-0b457fcaceac service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.649994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88332645-703f-44f7-a9e1-0b457fcaceac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.651985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc869a4-ef85-4fd1-8a31-18cf1d26452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.652855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc869a4-ef85-4fd1-8a31-18cf1d26452a admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.653168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc869a4-ef85-4fd1-8a31-18cf1d26452a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.653561 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc869a4-ef85-4fd1-8a31-18cf1d26452a admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.654598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc869a4-ef85-4fd1-8a31-18cf1d26452a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.657735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc869a4-ef85-4fd1-8a31-18cf1d26452a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.674054 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 950/1864] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:03.674054 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc869a4-ef85-4fd1-8a31-18cf1d26452a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.677538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:03.695260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc869a4-ef85-4fd1-8a31-18cf1d26452a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.701595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685c68d-f227-44e2-985b-d4556ce757b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.704786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685c68d-f227-44e2-985b-d4556ce757b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.705120 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685c68d-f227-44e2-985b-d4556ce757b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.705403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685c68d-f227-44e2-985b-d4556ce757b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.706068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685c68d-f227-44e2-985b-d4556ce757b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:03.706395 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685c68d-f227-44e2-985b-d4556ce757b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.708308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685c68d-f227-44e2-985b-d4556ce757b9 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.721132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88332645-703f-44f7-a9e1-0b457fcaceac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.723030 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 951/1865] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:29:03.723328 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88332645-703f-44f7-a9e1-0b457fcaceac service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.723902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685c68d-f227-44e2-985b-d4556ce757b9 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.735259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 915/1866] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:03.736024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88332645-703f-44f7-a9e1-0b457fcaceac service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.736891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685c68d-f227-44e2-985b-d4556ce757b9 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.743721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea78241-6f90-47d9-bf37-ddb08ae989fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.744458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea78241-6f90-47d9-bf37-ddb08ae989fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.745253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea78241-6f90-47d9-bf37-ddb08ae989fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.745542 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea78241-6f90-47d9-bf37-ddb08ae989fa admin admin] PATH_INFO: `/v3/projects/46f23010d4e947829ced0c43edb58283/users/bd6805ae5e6f4d0b8ec9f014136852d5/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.748427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88332645-703f-44f7-a9e1-0b457fcaceac service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.754567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009e74b-85a2-4399-807e-bd52206f34cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.755198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009e74b-85a2-4399-807e-bd52206f34cd admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.755476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009e74b-85a2-4399-807e-bd52206f34cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.756183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009e74b-85a2-4399-807e-bd52206f34cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.756842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009e74b-85a2-4399-807e-bd52206f34cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.759559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009e74b-85a2-4399-807e-bd52206f34cd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.766010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea78241-6f90-47d9-bf37-ddb08ae989fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f23010d4e947829ced0c43edb58283, user_id=bd6805ae5e6f4d0b8ec9f014136852d5, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.769333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea78241-6f90-47d9-bf37-ddb08ae989fa admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.791427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 952/1867] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:03 2022] PUT /identity/v3/projects/46f23010d4e947829ced0c43edb58283/users/bd6805ae5e6f4d0b8ec9f014136852d5/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:03.802721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea78241-6f90-47d9-bf37-ddb08ae989fa admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.810695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 916/1868] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:03 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:03.816038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009e74b-85a2-4399-807e-bd52206f34cd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.896713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009e74b-85a2-4399-807e-bd52206f34cd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.904309 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3eb242-17ca-46f5-b572-5748f7e92b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.905358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3eb242-17ca-46f5-b572-5748f7e92b41 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.905903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3eb242-17ca-46f5-b572-5748f7e92b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.906696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3eb242-17ca-46f5-b572-5748f7e92b41 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.907184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea78241-6f90-47d9-bf37-ddb08ae989fa admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.907813 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3eb242-17ca-46f5-b572-5748f7e92b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.910534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3eb242-17ca-46f5-b572-5748f7e92b41 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.912640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b58223-c461-4ee8-af69-b158328eb6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.913375 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b58223-c461-4ee8-af69-b158328eb6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.913881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b58223-c461-4ee8-af69-b158328eb6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.914261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b58223-c461-4ee8-af69-b158328eb6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.915148 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b58223-c461-4ee8-af69-b158328eb6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.918099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b58223-c461-4ee8-af69-b158328eb6d8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.939478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 953/1869] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:03.940484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b58223-c461-4ee8-af69-b158328eb6d8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.944432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 917/1870] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:03 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:03.950152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3eb242-17ca-46f5-b572-5748f7e92b41 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.956991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b58223-c461-4ee8-af69-b158328eb6d8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.960398 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3eb242-17ca-46f5-b572-5748f7e92b41 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:03.963481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443030d-efc8-413a-98c3-b87bc6ef8918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.964511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443030d-efc8-413a-98c3-b87bc6ef8918 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.964736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443030d-efc8-413a-98c3-b87bc6ef8918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.965079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443030d-efc8-413a-98c3-b87bc6ef8918 admin admin] PATH_INFO: `/v3/projects/46f23010d4e947829ced0c43edb58283/users/bd6805ae5e6f4d0b8ec9f014136852d5/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.967386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443030d-efc8-413a-98c3-b87bc6ef8918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f23010d4e947829ced0c43edb58283, user_id=bd6805ae5e6f4d0b8ec9f014136852d5, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.970242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443030d-efc8-413a-98c3-b87bc6ef8918 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.972671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31a1b5-e86a-4029-9bc0-67a68aafc262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:03.973300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31a1b5-e86a-4029-9bc0-67a68aafc262 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:03.973592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31a1b5-e86a-4029-9bc0-67a68aafc262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:03.973841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31a1b5-e86a-4029-9bc0-67a68aafc262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:03.974576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31a1b5-e86a-4029-9bc0-67a68aafc262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:03.976304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31a1b5-e86a-4029-9bc0-67a68aafc262 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:03.988499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 918/1871] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:03.992339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31a1b5-e86a-4029-9bc0-67a68aafc262 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:03.997658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 954/1872] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:03 2022] PUT /identity/v3/projects/46f23010d4e947829ced0c43edb58283/users/bd6805ae5e6f4d0b8ec9f014136852d5/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:04.003471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31a1b5-e86a-4029-9bc0-67a68aafc262 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:04.009264 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de0a12-25dc-4276-8620-1311ff3c30c6 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.009556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de0a12-25dc-4276-8620-1311ff3c30c6 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.009829 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de0a12-25dc-4276-8620-1311ff3c30c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.042208 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-d3de0a12-25dc-4276-8620-1311ff3c30c6 None None] MFA Rules not processed for user `bd6805ae5e6f4d0b8ec9f014136852d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:04.043633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d3de0a12-25dc-4276-8620-1311ff3c30c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:04.057978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:04.091861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f776e-70f8-444a-9dca-b0e4787d76f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:04.093018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f776e-70f8-444a-9dca-b0e4787d76f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.093410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f776e-70f8-444a-9dca-b0e4787d76f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.093739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f776e-70f8-444a-9dca-b0e4787d76f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.095105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f776e-70f8-444a-9dca-b0e4787d76f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:04.098908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f776e-70f8-444a-9dca-b0e4787d76f5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:04.116790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 919/1873] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:04.119461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f776e-70f8-444a-9dca-b0e4787d76f5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:04.133422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f776e-70f8-444a-9dca-b0e4787d76f5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:04.139112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 955/1874] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:04.139905 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482399ed-5648-4e6a-96e9-221d392a254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:04.140582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482399ed-5648-4e6a-96e9-221d392a254b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.140868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482399ed-5648-4e6a-96e9-221d392a254b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.141139 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482399ed-5648-4e6a-96e9-221d392a254b admin admin] PATH_INFO: `/v3/projects/992c84039563408c9669d4eafc849f91/users/28ea99dcedda440d8eee7a30f0c134f2/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.152185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de0a12-25dc-4276-8620-1311ff3c30c6 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:04.153707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:04.158693 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482399ed-5648-4e6a-96e9-221d392a254b admin admin] RBAC: Authorizing `identity:create_grant(project_id=992c84039563408c9669d4eafc849f91, user_id=28ea99dcedda440d8eee7a30f0c134f2, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:04.162119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482399ed-5648-4e6a-96e9-221d392a254b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:04.180781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 920/1875] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:04 2022] PUT /identity/v3/projects/992c84039563408c9669d4eafc849f91/users/28ea99dcedda440d8eee7a30f0c134f2/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:04.195517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482399ed-5648-4e6a-96e9-221d392a254b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:04.220986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de0a12-25dc-4276-8620-1311ff3c30c6 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:04.264553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482399ed-5648-4e6a-96e9-221d392a254b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:04.269282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34821649-564e-4970-aa53-08a5b9fc8df5 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8d775f912d746a4bcea5600dbe5de7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af7de361455943b8abb0ada784dd81fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:04.269902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34821649-564e-4970-aa53-08a5b9fc8df5 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.270187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34821649-564e-4970-aa53-08a5b9fc8df5 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.270497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34821649-564e-4970-aa53-08a5b9fc8df5 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.271284 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34821649-564e-4970-aa53-08a5b9fc8df5 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:04.271597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34821649-564e-4970-aa53-08a5b9fc8df5 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:04.272297 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc3ecc-5a98-4298-bc97-d13f73b8f051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:04.272901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc3ecc-5a98-4298-bc97-d13f73b8f051 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.273175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc3ecc-5a98-4298-bc97-d13f73b8f051 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.273273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34821649-564e-4970-aa53-08a5b9fc8df5 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:04.273441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc3ecc-5a98-4298-bc97-d13f73b8f051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.285858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 921/1876] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:29:04.287070 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505c9d-9814-4a4b-a78c-331d6bf83fe7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.287360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505c9d-9814-4a4b-a78c-331d6bf83fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.287635 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8505c9d-9814-4a4b-a78c-331d6bf83fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.315930 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d8505c9d-9814-4a4b-a78c-331d6bf83fe7 None None] MFA Rules not processed for user `28ea99dcedda440d8eee7a30f0c134f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:04.317172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d8505c9d-9814-4a4b-a78c-331d6bf83fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:04.336999 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc3ecc-5a98-4298-bc97-d13f73b8f051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:04.338490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc3ecc-5a98-4298-bc97-d13f73b8f051 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:04.348425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 956/1877] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:04.349074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc3ecc-5a98-4298-bc97-d13f73b8f051 service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:04.350372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-05dc3ecc-5a98-4298-bc97-d13f73b8f051 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:04.373856 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:04.390590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 922/1878] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:04.391616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505c9d-9814-4a4b-a78c-331d6bf83fe7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:04.404489 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8505c9d-9814-4a4b-a78c-331d6bf83fe7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:04.410192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2afb-1f49-4bac-b205-bf5e2d86d18d tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8d775f912d746a4bcea5600dbe5de7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af7de361455943b8abb0ada784dd81fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:04.411314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2afb-1f49-4bac-b205-bf5e2d86d18d tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.411605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2afb-1f49-4bac-b205-bf5e2d86d18d tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.411883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2afb-1f49-4bac-b205-bf5e2d86d18d tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.412537 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c2afb-1f49-4bac-b205-bf5e2d86d18d tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:04.414763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c2afb-1f49-4bac-b205-bf5e2d86d18d tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:04.435980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc3ecc-5a98-4298-bc97-d13f73b8f051 service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:04.441003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:04.441651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.442183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.442503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] PATH_INFO: `/v3/users/d60aa97dff6e408e95483a56889c104f` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.443703 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60aa97dff6e408e95483a56889c104f)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:04.445952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:04.455247 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 923/1879] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:04 2022] POST /identity/v3/projects => generated 354 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:04.456197 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2afb-1f49-4bac-b205-bf5e2d86d18d tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:04.529837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:04.544087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2afb-1f49-4bac-b205-bf5e2d86d18d tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:04.545117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60aa97dff6e408e95483a56889c104f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:04.549947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6b656-187b-4b2c-9574-499d345d5645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:04.550713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6b656-187b-4b2c-9574-499d345d5645 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.551059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6b656-187b-4b2c-9574-499d345d5645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.551400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6b656-187b-4b2c-9574-499d345d5645 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.552108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6b656-187b-4b2c-9574-499d345d5645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:04.554146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6b656-187b-4b2c-9574-499d345d5645 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:04.562916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60aa97dff6e408e95483a56889c104f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:04.593672 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60aa97dff6e408e95483a56889c104f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:04.593814 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 924/1880] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:04 2022] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:04.593814 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6b656-187b-4b2c-9574-499d345d5645 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:04.594023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60aa97dff6e408e95483a56889c104f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:04.594023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60aa97dff6e408e95483a56889c104f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:04.597658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f1b6b656-187b-4b2c-9574-499d345d5645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:04.639086 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 957/1881] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:04 2022] DELETE /identity/v3/users/d60aa97dff6e408e95483a56889c104f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:04.644222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:04.647606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:04.682229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6b656-187b-4b2c-9574-499d345d5645 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:04.741987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b67b18-2dc1-4e78-9a3e-7e91c6e2e2eb admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:04.748659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e6208-4bd2-4053-b00c-1005116402f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:04.749381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e6208-4bd2-4053-b00c-1005116402f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.749671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e6208-4bd2-4053-b00c-1005116402f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.749939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e6208-4bd2-4053-b00c-1005116402f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.750639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e6208-4bd2-4053-b00c-1005116402f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:04.752774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e6208-4bd2-4053-b00c-1005116402f4 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:04.768085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299adf2-8e27-4d4d-bd25-be0b45013191 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8d775f912d746a4bcea5600dbe5de7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af7de361455943b8abb0ada784dd81fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:04.768999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299adf2-8e27-4d4d-bd25-be0b45013191 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.769422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299adf2-8e27-4d4d-bd25-be0b45013191 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.769834 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299adf2-8e27-4d4d-bd25-be0b45013191 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.770604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299adf2-8e27-4d4d-bd25-be0b45013191 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:04.770989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299adf2-8e27-4d4d-bd25-be0b45013191 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:04.772852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299adf2-8e27-4d4d-bd25-be0b45013191 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:04.782423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 958/1882] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:04 2022] POST /identity/v3/users => generated 301 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:04.784639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f0e1a-cc41-41da-a666-c5aa1160e662 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.785055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f0e1a-cc41-41da-a666-c5aa1160e662 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.785506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f0e1a-cc41-41da-a666-c5aa1160e662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.786120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 925/1883] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:29:04.786978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299adf2-8e27-4d4d-bd25-be0b45013191 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:04.807353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299adf2-8e27-4d4d-bd25-be0b45013191 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:04.819610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-d96f0e1a-cc41-41da-a666-c5aa1160e662 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:04.821123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d96f0e1a-cc41-41da-a666-c5aa1160e662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:04.821506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2122e99-0c14-464f-86dc-35e750c200cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:04.822257 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2122e99-0c14-464f-86dc-35e750c200cc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.822775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2122e99-0c14-464f-86dc-35e750c200cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.823717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2122e99-0c14-464f-86dc-35e750c200cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.824861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2122e99-0c14-464f-86dc-35e750c200cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:04.827369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2122e99-0c14-464f-86dc-35e750c200cc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:04.831572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 959/1884] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:04.843388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f0e1a-cc41-41da-a666-c5aa1160e662 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:04.844879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d96f0e1a-cc41-41da-a666-c5aa1160e662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:04.851029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 926/1885] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:04.851029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2122e99-0c14-464f-86dc-35e750c200cc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:04.863541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2122e99-0c14-464f-86dc-35e750c200cc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:04.868402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8d775f912d746a4bcea5600dbe5de7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af7de361455943b8abb0ada784dd81fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:04.869040 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:04.869324 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:04.869558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:04.869707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] PATH_INFO: `/v3/projects/4e3b959e6d2c4775bee8c438f9689d56` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:04.871386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4e3b959e6d2c4775bee8c438f9689d56)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:04.873462 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:04.918826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f0e1a-cc41-41da-a666-c5aa1160e662 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:04.929511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3b959e6d2c4775bee8c438f9689d56', 'request_id': 'req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:04.938419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3b959e6d2c4775bee8c438f9689d56', 'request_id': 'req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:04.946094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3b959e6d2c4775bee8c438f9689d56', 'request_id': 'req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:04.947632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:04.961872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] The token cache is being invalidate because project 4e3b959e6d2c4775bee8c438f9689d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:04.962188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:04.963024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:04.965400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 927/1886] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:04 2022] DELETE /identity/v3/projects/4e3b959e6d2c4775bee8c438f9689d56 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:04.970479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:04.971286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:05.024512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdb138-4dba-47c0-b9e9-b110ebc030a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:05.026766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdb138-4dba-47c0-b9e9-b110ebc030a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.027059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdb138-4dba-47c0-b9e9-b110ebc030a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.027337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdb138-4dba-47c0-b9e9-b110ebc030a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.032750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a8bdb138-4dba-47c0-b9e9-b110ebc030a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:05.068513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22fc0-7b12-4c06-8b3b-78d9fb7f4fd9 tempest-VolumeQuotaClassesTest-1538227360 tempest-VolumeQuotaClassesTest-1538227360-project-admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:05.086709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa59536-bea6-4a56-a9c0-b6e0f4a84488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:05.090265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa59536-bea6-4a56-a9c0-b6e0f4a84488 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.090937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa59536-bea6-4a56-a9c0-b6e0f4a84488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.092150 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa59536-bea6-4a56-a9c0-b6e0f4a84488 admin admin] PATH_INFO: `/v3/projects/f8d41c7da3cb490e9d85c8e38ccccf4c/users/84f2cfa48f44437691877a68df497497/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.137915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa59536-bea6-4a56-a9c0-b6e0f4a84488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d41c7da3cb490e9d85c8e38ccccf4c, user_id=84f2cfa48f44437691877a68df497497, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:05.142223 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa59536-bea6-4a56-a9c0-b6e0f4a84488 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:05.165141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 928/1887] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:04 2022] PUT /identity/v3/projects/f8d41c7da3cb490e9d85c8e38ccccf4c/users/84f2cfa48f44437691877a68df497497/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:05.167423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdb138-4dba-47c0-b9e9-b110ebc030a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:05.169008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdb138-4dba-47c0-b9e9-b110ebc030a4 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:05.169878 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa59536-bea6-4a56-a9c0-b6e0f4a84488 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:05.183725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 960/1888] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:05.256386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdb138-4dba-47c0-b9e9-b110ebc030a4 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:05.257858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a8bdb138-4dba-47c0-b9e9-b110ebc030a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:05.271285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa59536-bea6-4a56-a9c0-b6e0f4a84488 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:05.272643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdb138-4dba-47c0-b9e9-b110ebc030a4 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:05.278898 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:05.279503 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc91508-e48c-4ba3-9f1e-25f701741364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:05.279737 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.280133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.280474 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] PATH_INFO: `/v3/users/74b8895e7f834cc68b0086de5505387e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.280755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc91508-e48c-4ba3-9f1e-25f701741364 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.281271 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc91508-e48c-4ba3-9f1e-25f701741364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.281691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc91508-e48c-4ba3-9f1e-25f701741364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.281844 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b8895e7f834cc68b0086de5505387e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:05.282632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc91508-e48c-4ba3-9f1e-25f701741364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:05.284175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:05.284843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc91508-e48c-4ba3-9f1e-25f701741364 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:05.299080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 929/1889] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:05.303346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc91508-e48c-4ba3-9f1e-25f701741364 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:05.305524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3cc91508-e48c-4ba3-9f1e-25f701741364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:05.319691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc91508-e48c-4ba3-9f1e-25f701741364 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:05.326234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ad3d9-ef68-42c2-a5b5-8db19dec80c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:05.327261 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ad3d9-ef68-42c2-a5b5-8db19dec80c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.329167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ad3d9-ef68-42c2-a5b5-8db19dec80c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.329446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ad3d9-ef68-42c2-a5b5-8db19dec80c7 admin admin] PATH_INFO: `/v3/users/269df6f214bd4bb99e40acd73e775fc2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.330667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ad3d9-ef68-42c2-a5b5-8db19dec80c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=269df6f214bd4bb99e40acd73e775fc2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:05.332616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ad3d9-ef68-42c2-a5b5-8db19dec80c7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:05.344930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b8895e7f834cc68b0086de5505387e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.366421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b8895e7f834cc68b0086de5505387e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.379402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b8895e7f834cc68b0086de5505387e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.380286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b8895e7f834cc68b0086de5505387e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.381210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b8895e7f834cc68b0086de5505387e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.392314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8d2ad3d9-ef68-42c2-a5b5-8db19dec80c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269df6f214bd4bb99e40acd73e775fc2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.393879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:05.399711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 961/1890] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:05 2022] DELETE /identity/v3/users/74b8895e7f834cc68b0086de5505387e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:05.401506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8d2ad3d9-ef68-42c2-a5b5-8db19dec80c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269df6f214bd4bb99e40acd73e775fc2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.401663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:05.406638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:05.408189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:05.420065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8d2ad3d9-ef68-42c2-a5b5-8db19dec80c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269df6f214bd4bb99e40acd73e775fc2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.420954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8d2ad3d9-ef68-42c2-a5b5-8db19dec80c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269df6f214bd4bb99e40acd73e775fc2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.421886 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8d2ad3d9-ef68-42c2-a5b5-8db19dec80c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269df6f214bd4bb99e40acd73e775fc2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.437949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 930/1891] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:05 2022] DELETE /identity/v3/users/269df6f214bd4bb99e40acd73e775fc2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:05.442592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29186de-6c69-42c0-9043-b282e2ecb313 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.442880 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29186de-6c69-42c0-9043-b282e2ecb313 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.443156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29186de-6c69-42c0-9043-b282e2ecb313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.465660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c29186de-6c69-42c0-9043-b282e2ecb313 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:05.466857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c29186de-6c69-42c0-9043-b282e2ecb313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:05.488554 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104abfeb-7716-41d2-b754-628c779e3b2c admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:05.545532 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 931/1892] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:05.546919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911af4b4-7fb3-43e3-b3d8-d73efa23df64 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.547273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911af4b4-7fb3-43e3-b3d8-d73efa23df64 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.547850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911af4b4-7fb3-43e3-b3d8-d73efa23df64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.554189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6315f7-6a23-46c8-b605-980cc01d5466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:05.555074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6315f7-6a23-46c8-b605-980cc01d5466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.555417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6315f7-6a23-46c8-b605-980cc01d5466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.555931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6315f7-6a23-46c8-b605-980cc01d5466 admin admin] PATH_INFO: `/v3/projects/f8d41c7da3cb490e9d85c8e38ccccf4c/users/84f2cfa48f44437691877a68df497497/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.559427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6315f7-6a23-46c8-b605-980cc01d5466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d41c7da3cb490e9d85c8e38ccccf4c, user_id=84f2cfa48f44437691877a68df497497, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:05.562129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6315f7-6a23-46c8-b605-980cc01d5466 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:05.569920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-911af4b4-7fb3-43e3-b3d8-d73efa23df64 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:05.571154 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-911af4b4-7fb3-43e3-b3d8-d73efa23df64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:05.574678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 962/1893] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:05 2022] PUT /identity/v3/projects/f8d41c7da3cb490e9d85c8e38ccccf4c/users/84f2cfa48f44437691877a68df497497/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:05.575586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6315f7-6a23-46c8-b605-980cc01d5466 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:05.577162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7f6315f7-6a23-46c8-b605-980cc01d5466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:05.649157 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 932/1894] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:05.649279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6315f7-6a23-46c8-b605-980cc01d5466 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:05.652516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb408c-1b38-4f07-85ff-96454559a610 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.654679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09db6f-97b8-484a-9e77-48c5efd9c1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:05.654810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb408c-1b38-4f07-85ff-96454559a610 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.654990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb408c-1b38-4f07-85ff-96454559a610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.655281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09db6f-97b8-484a-9e77-48c5efd9c1fc service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.655559 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09db6f-97b8-484a-9e77-48c5efd9c1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.655829 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09db6f-97b8-484a-9e77-48c5efd9c1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.668280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09db6f-97b8-484a-9e77-48c5efd9c1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:05.669871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09db6f-97b8-484a-9e77-48c5efd9c1fc service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:05.680258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 963/1895] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:05.681079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09db6f-97b8-484a-9e77-48c5efd9c1fc service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:05.685513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bb09db6f-97b8-484a-9e77-48c5efd9c1fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:05.692722 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-64cb408c-1b38-4f07-85ff-96454559a610 None None] MFA Rules not processed for user `84f2cfa48f44437691877a68df497497`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:05.693976 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-64cb408c-1b38-4f07-85ff-96454559a610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:05.709350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09db6f-97b8-484a-9e77-48c5efd9c1fc service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:05.715596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:05.717028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.717369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.717702 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] PATH_INFO: `/v3/projects/c7eb3712d23a4632b157fa725c96ca9b` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.719234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7eb3712d23a4632b157fa725c96ca9b)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:05.721269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:05.765990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:05.787321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7eb3712d23a4632b157fa725c96ca9b', 'request_id': 'req-833f8e3a-640a-41c5-a596-cc9c9807db12'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.794486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 933/1896] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:05 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:05.794486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb408c-1b38-4f07-85ff-96454559a610 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:05.803203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7eb3712d23a4632b157fa725c96ca9b', 'request_id': 'req-833f8e3a-640a-41c5-a596-cc9c9807db12'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.811781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb408c-1b38-4f07-85ff-96454559a610 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:05.812430 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7eb3712d23a4632b157fa725c96ca9b', 'request_id': 'req-833f8e3a-640a-41c5-a596-cc9c9807db12'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.817686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:05.845013 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] The token cache is being invalidate because project c7eb3712d23a4632b157fa725c96ca9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:05.845588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.846697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:05.849730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 964/1897] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:05 2022] DELETE /identity/v3/projects/c7eb3712d23a4632b157fa725c96ca9b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:05.851330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:05.853977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:05.904488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c33375-16ca-4d27-a51e-aa38de3d522a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:05.905819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c33375-16ca-4d27-a51e-aa38de3d522a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.906107 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c33375-16ca-4d27-a51e-aa38de3d522a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.906822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c33375-16ca-4d27-a51e-aa38de3d522a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.909392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-91c33375-16ca-4d27-a51e-aa38de3d522a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:05.960820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f8e3a-640a-41c5-a596-cc9c9807db12 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:05.965216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a92ea-174e-4765-9d7a-ff79c8cc3d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:05.966007 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a92ea-174e-4765-9d7a-ff79c8cc3d10 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:05.966402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a92ea-174e-4765-9d7a-ff79c8cc3d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:05.966778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a92ea-174e-4765-9d7a-ff79c8cc3d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:05.968824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ca8a92ea-174e-4765-9d7a-ff79c8cc3d10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:06.015303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c33375-16ca-4d27-a51e-aa38de3d522a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:06.016846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c33375-16ca-4d27-a51e-aa38de3d522a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:06.028499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 934/1898] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:06.029340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c33375-16ca-4d27-a51e-aa38de3d522a service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:06.030652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-91c33375-16ca-4d27-a51e-aa38de3d522a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:06.044241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c33375-16ca-4d27-a51e-aa38de3d522a service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:06.048876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd35b1f-fc6b-4830-a26c-ecdb0857fb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:06.049510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd35b1f-fc6b-4830-a26c-ecdb0857fb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:06.049790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd35b1f-fc6b-4830-a26c-ecdb0857fb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:06.050061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd35b1f-fc6b-4830-a26c-ecdb0857fb62 admin admin] PATH_INFO: `/v3/users/1847cf45ce5f43d8931b0fcc92fb170b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:06.051216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd35b1f-fc6b-4830-a26c-ecdb0857fb62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1847cf45ce5f43d8931b0fcc92fb170b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:06.053295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd35b1f-fc6b-4830-a26c-ecdb0857fb62 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:06.058297 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a92ea-174e-4765-9d7a-ff79c8cc3d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:06.059999 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a92ea-174e-4765-9d7a-ff79c8cc3d10 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:06.071142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 965/1899] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:05 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:06.117373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fcd35b1f-fc6b-4830-a26c-ecdb0857fb62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1847cf45ce5f43d8931b0fcc92fb170b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.129818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fcd35b1f-fc6b-4830-a26c-ecdb0857fb62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1847cf45ce5f43d8931b0fcc92fb170b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.149025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fcd35b1f-fc6b-4830-a26c-ecdb0857fb62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1847cf45ce5f43d8931b0fcc92fb170b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.150011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fcd35b1f-fc6b-4830-a26c-ecdb0857fb62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1847cf45ce5f43d8931b0fcc92fb170b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.151680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fcd35b1f-fc6b-4830-a26c-ecdb0857fb62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1847cf45ce5f43d8931b0fcc92fb170b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.188831 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 935/1900] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:06 2022] DELETE /identity/v3/users/1847cf45ce5f43d8931b0fcc92fb170b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:06.265432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a92ea-174e-4765-9d7a-ff79c8cc3d10 service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:06.267246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ca8a92ea-174e-4765-9d7a-ff79c8cc3d10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:06.282005 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a92ea-174e-4765-9d7a-ff79c8cc3d10 service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:06.353095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:06.354051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:06.354437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:06.354788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] PATH_INFO: `/v3/users/28ea99dcedda440d8eee7a30f0c134f2` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:06.356196 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ea99dcedda440d8eee7a30f0c134f2)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:06.358368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:06.394981 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:06.430537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ea99dcedda440d8eee7a30f0c134f2'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.441140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ea99dcedda440d8eee7a30f0c134f2'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.456440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ea99dcedda440d8eee7a30f0c134f2'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.457293 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ea99dcedda440d8eee7a30f0c134f2'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.457973 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ea99dcedda440d8eee7a30f0c134f2'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.477999 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 966/1901] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:06 2022] DELETE /identity/v3/users/28ea99dcedda440d8eee7a30f0c134f2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:06.480327 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bcd15-da04-41cd-9d45-b80c99b0c0f3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:06.480819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bcd15-da04-41cd-9d45-b80c99b0c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:06.481098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bcd15-da04-41cd-9d45-b80c99b0c0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:06.505702 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-824bcd15-da04-41cd-9d45-b80c99b0c0f3 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:06.506990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-824bcd15-da04-41cd-9d45-b80c99b0c0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:06.536890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:06.587632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 936/1902] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:06.619212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:06.622777 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:06.716851 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76796d0f-b670-4320-8e62-9a7ecafb7d54 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:06.721693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102107be-959f-4c8b-87a6-a8bf0b992759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:06.722611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102107be-959f-4c8b-87a6-a8bf0b992759 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:06.722995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102107be-959f-4c8b-87a6-a8bf0b992759 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:06.723403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102107be-959f-4c8b-87a6-a8bf0b992759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:06.734598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102107be-959f-4c8b-87a6-a8bf0b992759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:06.736163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102107be-959f-4c8b-87a6-a8bf0b992759 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:06.747591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 967/1903] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:06.819812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bcd15-da04-41cd-9d45-b80c99b0c0f3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:06.823189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-824bcd15-da04-41cd-9d45-b80c99b0c0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:06.837068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bcd15-da04-41cd-9d45-b80c99b0c0f3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:06.844049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c86eb-e565-4cf5-84c2-32848bfcda47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:06.845769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c86eb-e565-4cf5-84c2-32848bfcda47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:06.846279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c86eb-e565-4cf5-84c2-32848bfcda47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:06.846850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c86eb-e565-4cf5-84c2-32848bfcda47 admin admin] PATH_INFO: `/v3/projects/eee20329f8bb4ed4b1964d8462240421` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:06.848326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c86eb-e565-4cf5-84c2-32848bfcda47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee20329f8bb4ed4b1964d8462240421)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:06.851349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c86eb-e565-4cf5-84c2-32848bfcda47 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:06.945501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ea6c86eb-e565-4cf5-84c2-32848bfcda47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee20329f8bb4ed4b1964d8462240421', 'request_id': 'req-ea6c86eb-e565-4cf5-84c2-32848bfcda47'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.956748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ea6c86eb-e565-4cf5-84c2-32848bfcda47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee20329f8bb4ed4b1964d8462240421', 'request_id': 'req-ea6c86eb-e565-4cf5-84c2-32848bfcda47'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.966893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ea6c86eb-e565-4cf5-84c2-32848bfcda47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee20329f8bb4ed4b1964d8462240421', 'request_id': 'req-ea6c86eb-e565-4cf5-84c2-32848bfcda47'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.978014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ea6c86eb-e565-4cf5-84c2-32848bfcda47 admin admin] The token cache is being invalidate because project eee20329f8bb4ed4b1964d8462240421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:06.978245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ea6c86eb-e565-4cf5-84c2-32848bfcda47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.979615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ea6c86eb-e565-4cf5-84c2-32848bfcda47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:06.981754 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 937/1904] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:06 2022] DELETE /identity/v3/projects/eee20329f8bb4ed4b1964d8462240421 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:06.988096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84b32-b002-46e0-9b2f-c54f5ad4678f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:06.988096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84b32-b002-46e0-9b2f-c54f5ad4678f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:06.988639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84b32-b002-46e0-9b2f-c54f5ad4678f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:07.013042 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-9dd84b32-b002-46e0-9b2f-c54f5ad4678f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:07.014347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9dd84b32-b002-46e0-9b2f-c54f5ad4678f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:07.102429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 968/1905] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:07.109997 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95729224-a447-4c00-92a4-b25218c68c5d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:07.110862 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95729224-a447-4c00-92a4-b25218c68c5d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:07.110862 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95729224-a447-4c00-92a4-b25218c68c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:07.142909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-95729224-a447-4c00-92a4-b25218c68c5d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:07.145030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-95729224-a447-4c00-92a4-b25218c68c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:07.156513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 938/1906] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:07.161447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd84b32-b002-46e0-9b2f-c54f5ad4678f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:07.173276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95729224-a447-4c00-92a4-b25218c68c5d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:07.176362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd84b32-b002-46e0-9b2f-c54f5ad4678f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:07.177292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-95729224-a447-4c00-92a4-b25218c68c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:07.183887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3106de-eaec-4315-894d-e76bd4bc2e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:07.185374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3106de-eaec-4315-894d-e76bd4bc2e39 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:07.185863 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3106de-eaec-4315-894d-e76bd4bc2e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:07.186333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3106de-eaec-4315-894d-e76bd4bc2e39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:07.188406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3106de-eaec-4315-894d-e76bd4bc2e39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:07.189049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3106de-eaec-4315-894d-e76bd4bc2e39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:07.191102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95729224-a447-4c00-92a4-b25218c68c5d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:07.197137 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:07.198527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:07.198819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:07.203813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3106de-eaec-4315-894d-e76bd4bc2e39 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:07.210305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] PATH_INFO: `/v3/projects/c66671e83f6549808bf2997eb13ee505` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:07.213672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66671e83f6549808bf2997eb13ee505)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:07.216675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:07.228655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 969/1907] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:29:07.233963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3106de-eaec-4315-894d-e76bd4bc2e39 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:07.248135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3106de-eaec-4315-894d-e76bd4bc2e39 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:07.262407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471d4a6-446f-4293-8b13-05660c4bec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:07.264521 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471d4a6-446f-4293-8b13-05660c4bec1a admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:07.264848 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471d4a6-446f-4293-8b13-05660c4bec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:07.265131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471d4a6-446f-4293-8b13-05660c4bec1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:07.265779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471d4a6-446f-4293-8b13-05660c4bec1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:07.270772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471d4a6-446f-4293-8b13-05660c4bec1a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:07.301025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66671e83f6549808bf2997eb13ee505', 'request_id': 'req-93e44003-2016-449f-be5c-06babc120e13'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.317692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66671e83f6549808bf2997eb13ee505', 'request_id': 'req-93e44003-2016-449f-be5c-06babc120e13'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.327392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66671e83f6549808bf2997eb13ee505', 'request_id': 'req-93e44003-2016-449f-be5c-06babc120e13'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.330487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 970/1908] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:07 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:07.330487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471d4a6-446f-4293-8b13-05660c4bec1a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:07.333686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5471d4a6-446f-4293-8b13-05660c4bec1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:07.339478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:07.348309 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] The token cache is being invalidate because project c66671e83f6549808bf2997eb13ee505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:07.350506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.351238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.352818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 939/1909] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:07 2022] DELETE /identity/v3/projects/c66671e83f6549808bf2997eb13ee505 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:07.353659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:07.357672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:07.395286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:07.413124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471d4a6-446f-4293-8b13-05660c4bec1a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:07.418845 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:07.419484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:07.419822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:07.420106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] PATH_INFO: `/v3/projects/ead0fa393e2f45439b101ea700151e6d` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:07.421213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead0fa393e2f45439b101ea700151e6d)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:07.423151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:07.433134 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e44003-2016-449f-be5c-06babc120e13 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:07.437882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:07.438550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:07.438829 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:07.439114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] PATH_INFO: `/v3/projects/992c84039563408c9669d4eafc849f91` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:07.440227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] RBAC: Authorizing `identity:delete_project(project_id=992c84039563408c9669d4eafc849f91)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:07.442133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:07.476006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead0fa393e2f45439b101ea700151e6d', 'request_id': 'req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.483480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead0fa393e2f45439b101ea700151e6d', 'request_id': 'req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.489141 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead0fa393e2f45439b101ea700151e6d', 'request_id': 'req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.491720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992c84039563408c9669d4eafc849f91', 'request_id': 'req-efd2eedd-5f12-4bbf-bb91-3011a74d606f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.499194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992c84039563408c9669d4eafc849f91', 'request_id': 'req-efd2eedd-5f12-4bbf-bb91-3011a74d606f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.502048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] The token cache is being invalidate because project ead0fa393e2f45439b101ea700151e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:07.502333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.502992 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.504500 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 971/1910] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:07 2022] DELETE /identity/v3/projects/ead0fa393e2f45439b101ea700151e6d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:07.505243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:07.506066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992c84039563408c9669d4eafc849f91', 'request_id': 'req-efd2eedd-5f12-4bbf-bb91-3011a74d606f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.506574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:07.517349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] The token cache is being invalidate because project 992c84039563408c9669d4eafc849f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:07.517634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.518290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.519823 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 940/1911] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:07 2022] DELETE /identity/v3/projects/992c84039563408c9669d4eafc849f91 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:07.520717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:07.522075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:07.574366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eee1c5-2df6-4cbb-a762-e6dcab2f3c0b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:07.587497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2eedd-5f12-4bbf-bb91-3011a74d606f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:07.593105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:07.593747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:07.594031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:07.594351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] PATH_INFO: `/v3/users/bd6805ae5e6f4d0b8ec9f014136852d5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:07.595555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd6805ae5e6f4d0b8ec9f014136852d5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:07.597518 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:07.621119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:07.644207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6b001-d046-4bc9-8a6e-b6804930ca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:07.644824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b001-d046-4bc9-8a6e-b6804930ca11 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:07.645103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b001-d046-4bc9-8a6e-b6804930ca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:07.645405 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b001-d046-4bc9-8a6e-b6804930ca11 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:07.646009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6b001-d046-4bc9-8a6e-b6804930ca11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:07.648611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6b001-d046-4bc9-8a6e-b6804930ca11 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:07.653426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd6805ae5e6f4d0b8ec9f014136852d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.661779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd6805ae5e6f4d0b8ec9f014136852d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.668043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:07.674460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 972/1912] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:07 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:07.674460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6b001-d046-4bc9-8a6e-b6804930ca11 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:07.677726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-fac6b001-d046-4bc9-8a6e-b6804930ca11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:07.683419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd6805ae5e6f4d0b8ec9f014136852d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.684138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd6805ae5e6f4d0b8ec9f014136852d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.684788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd6805ae5e6f4d0b8ec9f014136852d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.691101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6b001-d046-4bc9-8a6e-b6804930ca11 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:07.696937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:07.697577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:07.698243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:07.698594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] PATH_INFO: `/v3/users/e8d775f912d746a4bcea5600dbe5de7e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:07.699456 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 941/1913] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:07 2022] DELETE /identity/v3/users/bd6805ae5e6f4d0b8ec9f014136852d5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:07.700111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:07.701382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:07.702974 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d775f912d746a4bcea5600dbe5de7e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:07.704568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:07.769746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d775f912d746a4bcea5600dbe5de7e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.780086 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ade5-3f12-45a6-973f-b98b22c371ee admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:07.786075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:07.786816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:07.787101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:07.787372 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] PATH_INFO: `/v3/users/84f2cfa48f44437691877a68df497497` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:07.788511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f2cfa48f44437691877a68df497497)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:07.790604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:07.795673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d775f912d746a4bcea5600dbe5de7e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.813051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d775f912d746a4bcea5600dbe5de7e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.814547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d775f912d746a4bcea5600dbe5de7e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.816961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d775f912d746a4bcea5600dbe5de7e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.836171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 973/1914] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:07 2022] DELETE /identity/v3/users/e8d775f912d746a4bcea5600dbe5de7e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:07.837070 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:07.839300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:07.860681 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f2cfa48f44437691877a68df497497'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.881607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f2cfa48f44437691877a68df497497'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.901949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f2cfa48f44437691877a68df497497'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.903486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f2cfa48f44437691877a68df497497'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.904703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f2cfa48f44437691877a68df497497'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:07.926997 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 942/1915] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:07 2022] DELETE /identity/v3/users/84f2cfa48f44437691877a68df497497 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:07.962917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd08cb-9dec-4f76-b620-2ecb68d3d8be admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:08.029728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:08.068031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b73d0-af48-48e9-80e3-a20898e3994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:08.069702 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b73d0-af48-48e9-80e3-a20898e3994b admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.070265 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b73d0-af48-48e9-80e3-a20898e3994b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.070792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b73d0-af48-48e9-80e3-a20898e3994b admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.072132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b73d0-af48-48e9-80e3-a20898e3994b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:08.075163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b73d0-af48-48e9-80e3-a20898e3994b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:08.089771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 974/1916] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:08.095289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:08.097915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.117830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad180ed-8c40-4432-bf12-a06d90c0cd30 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:08.127030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fad28f-08ae-4c02-ba1b-06ae353b761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:08.128070 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fad28f-08ae-4c02-ba1b-06ae353b761d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.128649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fad28f-08ae-4c02-ba1b-06ae353b761d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.129140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fad28f-08ae-4c02-ba1b-06ae353b761d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.130315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fad28f-08ae-4c02-ba1b-06ae353b761d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:08.133718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fad28f-08ae-4c02-ba1b-06ae353b761d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:08.148141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 943/1917] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:08.153325 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b73d0-af48-48e9-80e3-a20898e3994b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:08.173137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b73d0-af48-48e9-80e3-a20898e3994b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:08.193389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c66233-d5cd-479f-9d26-4580bd84486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:08.194427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c66233-d5cd-479f-9d26-4580bd84486c admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.194889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c66233-d5cd-479f-9d26-4580bd84486c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.195266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c66233-d5cd-479f-9d26-4580bd84486c admin admin] PATH_INFO: `/v3/projects/c5d1a9862d514f81b784a83ce8165b6c/users/9c795987eaf04747a7331afd5bf9897e/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.198705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fad28f-08ae-4c02-ba1b-06ae353b761d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:08.201213 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e2fad28f-08ae-4c02-ba1b-06ae353b761d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.217008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c66233-d5cd-479f-9d26-4580bd84486c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d1a9862d514f81b784a83ce8165b6c, user_id=9c795987eaf04747a7331afd5bf9897e, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:08.217676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fad28f-08ae-4c02-ba1b-06ae353b761d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:08.219938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c66233-d5cd-479f-9d26-4580bd84486c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:08.223899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:08.224856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.225139 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.225426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] PATH_INFO: `/v3/projects/46f23010d4e947829ced0c43edb58283` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.226775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f23010d4e947829ced0c43edb58283)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:08.229202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:08.239873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 975/1918] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:08 2022] PUT /identity/v3/projects/c5d1a9862d514f81b784a83ce8165b6c/users/9c795987eaf04747a7331afd5bf9897e/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:08.252818 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad87bb-33ea-489a-adc1-ab23e0c6f36f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.265608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad87bb-33ea-489a-adc1-ab23e0c6f36f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.266686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad87bb-33ea-489a-adc1-ab23e0c6f36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.343681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-71ad87bb-33ea-489a-adc1-ab23e0c6f36f None None] MFA Rules not processed for user `9c795987eaf04747a7331afd5bf9897e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:08.345080 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-71ad87bb-33ea-489a-adc1-ab23e0c6f36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.346016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:08.357347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f23010d4e947829ced0c43edb58283', 'request_id': 'req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.378678 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f23010d4e947829ced0c43edb58283', 'request_id': 'req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.395860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f23010d4e947829ced0c43edb58283', 'request_id': 'req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.417597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] The token cache is being invalidate because project 46f23010d4e947829ced0c43edb58283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:08.417963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.419698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.422481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 944/1919] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:08 2022] DELETE /identity/v3/projects/46f23010d4e947829ced0c43edb58283 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:08.423302 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:08.425728 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.477438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 976/1920] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:08.478870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd913f-71e4-403f-9ea1-9153f3bd8864 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.479249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd913f-71e4-403f-9ea1-9153f3bd8864 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.479596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd913f-71e4-403f-9ea1-9153f3bd8864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.529055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa9797-1c2b-4ed6-98c3-3683bef0ad61 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:08.536601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:08.537879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.538163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.538464 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] PATH_INFO: `/v3/projects/af7de361455943b8abb0ada784dd81fa` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.543181 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af7de361455943b8abb0ada784dd81fa)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:08.544506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-48fd913f-71e4-403f-9ea1-9153f3bd8864 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:08.545265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:08.545981 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-48fd913f-71e4-403f-9ea1-9153f3bd8864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.562196 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 977/1921] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:08.562196 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd913f-71e4-403f-9ea1-9153f3bd8864 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:08.563737 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-48fd913f-71e4-403f-9ea1-9153f3bd8864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.579864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd913f-71e4-403f-9ea1-9153f3bd8864 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:08.584147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47175846-daec-4f6c-9acf-b03ba33f4af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:08.585412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47175846-daec-4f6c-9acf-b03ba33f4af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.585412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47175846-daec-4f6c-9acf-b03ba33f4af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.585412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47175846-daec-4f6c-9acf-b03ba33f4af7 admin admin] PATH_INFO: `/v3/projects/f8d41c7da3cb490e9d85c8e38ccccf4c` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.587084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47175846-daec-4f6c-9acf-b03ba33f4af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d41c7da3cb490e9d85c8e38ccccf4c)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:08.590138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47175846-daec-4f6c-9acf-b03ba33f4af7 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:08.605903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7de361455943b8abb0ada784dd81fa', 'request_id': 'req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.617358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7de361455943b8abb0ada784dd81fa', 'request_id': 'req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.627992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7de361455943b8abb0ada784dd81fa', 'request_id': 'req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.641101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] The token cache is being invalidate because project af7de361455943b8abb0ada784dd81fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:08.641394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.642155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.644357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 945/1922] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:08 2022] DELETE /identity/v3/projects/af7de361455943b8abb0ada784dd81fa => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:08.648005 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-47175846-daec-4f6c-9acf-b03ba33f4af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d41c7da3cb490e9d85c8e38ccccf4c', 'request_id': 'req-47175846-daec-4f6c-9acf-b03ba33f4af7'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.648211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:08.649647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.655615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-47175846-daec-4f6c-9acf-b03ba33f4af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d41c7da3cb490e9d85c8e38ccccf4c', 'request_id': 'req-47175846-daec-4f6c-9acf-b03ba33f4af7'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.661929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-47175846-daec-4f6c-9acf-b03ba33f4af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d41c7da3cb490e9d85c8e38ccccf4c', 'request_id': 'req-47175846-daec-4f6c-9acf-b03ba33f4af7'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.677095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-47175846-daec-4f6c-9acf-b03ba33f4af7 admin admin] The token cache is being invalidate because project f8d41c7da3cb490e9d85c8e38ccccf4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:08.677477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-47175846-daec-4f6c-9acf-b03ba33f4af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.678194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-47175846-daec-4f6c-9acf-b03ba33f4af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:08.679844 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 978/1923] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:08 2022] DELETE /identity/v3/projects/f8d41c7da3cb490e9d85c8e38ccccf4c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:08.685436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2f0ac-c4a4-4ff5-b398-2baf15052f3b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.685723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2f0ac-c4a4-4ff5-b398-2baf15052f3b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.686004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2f0ac-c4a4-4ff5-b398-2baf15052f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.707630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-bdc2f0ac-c4a4-4ff5-b398-2baf15052f3b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:08.708864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bdc2f0ac-c4a4-4ff5-b398-2baf15052f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.732286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:08.733627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee597-2a4b-4b64-83c3-56c4ed5fc59a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:08.737981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:08.779598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 979/1924] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:08.780928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a8b5d-36ba-4048-bb6d-e30e25b6b764 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.781279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a8b5d-36ba-4048-bb6d-e30e25b6b764 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.781616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a8b5d-36ba-4048-bb6d-e30e25b6b764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.803593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-331a8b5d-36ba-4048-bb6d-e30e25b6b764 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:08.804916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-331a8b5d-36ba-4048-bb6d-e30e25b6b764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.815892 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b931de3-6581-48ef-8fd1-4618f6b30960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:08.816820 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b931de3-6581-48ef-8fd1-4618f6b30960 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.817157 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b931de3-6581-48ef-8fd1-4618f6b30960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.817575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b931de3-6581-48ef-8fd1-4618f6b30960 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.818320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b931de3-6581-48ef-8fd1-4618f6b30960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:08.820413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b931de3-6581-48ef-8fd1-4618f6b30960 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:08.823371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 980/1925] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:08.825044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc65c2f-1916-4fd7-b5c6-eecb63cb3295 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.825324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc65c2f-1916-4fd7-b5c6-eecb63cb3295 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.825593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc65c2f-1916-4fd7-b5c6-eecb63cb3295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.849695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-9cc65c2f-1916-4fd7-b5c6-eecb63cb3295 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:08.851219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9cc65c2f-1916-4fd7-b5c6-eecb63cb3295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.858488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 946/1926] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:08 2022] POST /identity/v3/projects => generated 369 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:08.859423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b931de3-6581-48ef-8fd1-4618f6b30960 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:08.860117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 981/1927] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:08.861337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20edab-783e-41fb-a1b2-a13596a13481 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.861621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20edab-783e-41fb-a1b2-a13596a13481 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.861886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20edab-783e-41fb-a1b2-a13596a13481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.889103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-5e20edab-783e-41fb-a1b2-a13596a13481 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:08.891430 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5e20edab-783e-41fb-a1b2-a13596a13481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.949364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b931de3-6581-48ef-8fd1-4618f6b30960 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:08.954530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181faeb-a75f-48fc-8558-a271c967954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:08.955245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181faeb-a75f-48fc-8558-a271c967954e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.955658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181faeb-a75f-48fc-8558-a271c967954e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.956328 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181faeb-a75f-48fc-8558-a271c967954e admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.956777 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181faeb-a75f-48fc-8558-a271c967954e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:08.957139 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181faeb-a75f-48fc-8558-a271c967954e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:08.959155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181faeb-a75f-48fc-8558-a271c967954e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:08.972174 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 947/1928] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:29:08.973560 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bd6df-f9e6-4beb-a6bf-27cc32528f41 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:08.973843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bd6df-f9e6-4beb-a6bf-27cc32528f41 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:08.974112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bd6df-f9e6-4beb-a6bf-27cc32528f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:08.986564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 982/1929] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:08.986564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20edab-783e-41fb-a1b2-a13596a13481 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:08.986564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5e20edab-783e-41fb-a1b2-a13596a13481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.993956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20edab-783e-41fb-a1b2-a13596a13481 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:08.994259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e59bd6df-f9e6-4beb-a6bf-27cc32528f41 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:08.996096 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e59bd6df-f9e6-4beb-a6bf-27cc32528f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:08.999522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb909b9-bad8-484b-b64b-c7f9a05fc7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.000124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb909b9-bad8-484b-b64b-c7f9a05fc7fd admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.000403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb909b9-bad8-484b-b64b-c7f9a05fc7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.000669 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb909b9-bad8-484b-b64b-c7f9a05fc7fd admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.001316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb909b9-bad8-484b-b64b-c7f9a05fc7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.003269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb909b9-bad8-484b-b64b-c7f9a05fc7fd admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.004351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 948/1930] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:09.005126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bd6df-f9e6-4beb-a6bf-27cc32528f41 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.016410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bd6df-f9e6-4beb-a6bf-27cc32528f41 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.021783 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b742b9-02da-4773-b94d-c3ada2824d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.022472 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b742b9-02da-4773-b94d-c3ada2824d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.022759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b742b9-02da-4773-b94d-c3ada2824d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.023034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b742b9-02da-4773-b94d-c3ada2824d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.023671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b742b9-02da-4773-b94d-c3ada2824d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.025589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b742b9-02da-4773-b94d-c3ada2824d7d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.029676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 983/1931] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:08 2022] POST /identity/v3/users => generated 291 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:09.029676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb909b9-bad8-484b-b64b-c7f9a05fc7fd admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.036881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb909b9-bad8-484b-b64b-c7f9a05fc7fd admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.041797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc6c7-3d14-49fd-93da-2c8f4865eaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.042630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc6c7-3d14-49fd-93da-2c8f4865eaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.042915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc6c7-3d14-49fd-93da-2c8f4865eaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.043191 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc6c7-3d14-49fd-93da-2c8f4865eaa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.043827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafc6c7-3d14-49fd-93da-2c8f4865eaa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:09.044131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafc6c7-3d14-49fd-93da-2c8f4865eaa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.045894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafc6c7-3d14-49fd-93da-2c8f4865eaa8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.058780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 949/1932] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:09 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:09.058780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b742b9-02da-4773-b94d-c3ada2824d7d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.059040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 984/1933] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:29:09.059826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc6c7-3d14-49fd-93da-2c8f4865eaa8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.070077 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc6c7-3d14-49fd-93da-2c8f4865eaa8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.117755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:09.122667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b742b9-02da-4773-b94d-c3ada2824d7d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.128245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96888ef0-4b83-40f3-96dd-2fdf4b6af716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.128851 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96888ef0-4b83-40f3-96dd-2fdf4b6af716 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.129127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96888ef0-4b83-40f3-96dd-2fdf4b6af716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.129396 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96888ef0-4b83-40f3-96dd-2fdf4b6af716 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.130033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96888ef0-4b83-40f3-96dd-2fdf4b6af716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:09.130334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96888ef0-4b83-40f3-96dd-2fdf4b6af716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.131252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7f42-1f86-411a-b8ee-b62fb308608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.131891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7f42-1f86-411a-b8ee-b62fb308608e admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.132007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96888ef0-4b83-40f3-96dd-2fdf4b6af716 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.132168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7f42-1f86-411a-b8ee-b62fb308608e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.132440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7f42-1f86-411a-b8ee-b62fb308608e admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.133107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a7f42-1f86-411a-b8ee-b62fb308608e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.134915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a7f42-1f86-411a-b8ee-b62fb308608e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.143971 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 950/1934] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:29:09.144570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96888ef0-4b83-40f3-96dd-2fdf4b6af716 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.147997 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 985/1935] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:09.147997 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7f42-1f86-411a-b8ee-b62fb308608e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.156537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7f42-1f86-411a-b8ee-b62fb308608e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.157433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96888ef0-4b83-40f3-96dd-2fdf4b6af716 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.161089 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520ac0-0615-4a1c-870c-f28db52088c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.161678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520ac0-0615-4a1c-870c-f28db52088c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.161904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c3c5b-776c-4a47-968e-fba5e1f68c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.162035 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520ac0-0615-4a1c-870c-f28db52088c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.162218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520ac0-0615-4a1c-870c-f28db52088c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.162522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c3c5b-776c-4a47-968e-fba5e1f68c4b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.162797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c3c5b-776c-4a47-968e-fba5e1f68c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.162888 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0520ac0-0615-4a1c-870c-f28db52088c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.163062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c3c5b-776c-4a47-968e-fba5e1f68c4b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.163684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c3c5b-776c-4a47-968e-fba5e1f68c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.165572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c3c5b-776c-4a47-968e-fba5e1f68c4b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.165979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0520ac0-0615-4a1c-870c-f28db52088c6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.188957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 951/1936] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:09 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:09.189750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c3c5b-776c-4a47-968e-fba5e1f68c4b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.189983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:09.202335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c3c5b-776c-4a47-968e-fba5e1f68c4b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.203580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 986/1937] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:09 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:09.204381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520ac0-0615-4a1c-870c-f28db52088c6 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.268687 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cd399-3ccf-48c6-9bdf-ee56ef752edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.269331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cd399-3ccf-48c6-9bdf-ee56ef752edd admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.269596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cd399-3ccf-48c6-9bdf-ee56ef752edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.269940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cd399-3ccf-48c6-9bdf-ee56ef752edd admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.270657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cd399-3ccf-48c6-9bdf-ee56ef752edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.272719 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cd399-3ccf-48c6-9bdf-ee56ef752edd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.274708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520ac0-0615-4a1c-870c-f28db52088c6 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.282314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04332195-b15f-4779-a44f-83c71bc1fa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.283020 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04332195-b15f-4779-a44f-83c71bc1fa1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.283395 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04332195-b15f-4779-a44f-83c71bc1fa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.283682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04332195-b15f-4779-a44f-83c71bc1fa1b admin admin] PATH_INFO: `/v3/projects/39e11b46b89b4c97846ee39f1301f8a9/users/16a0dbb46dd84a449a2993262c97875e/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.300623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04332195-b15f-4779-a44f-83c71bc1fa1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e11b46b89b4c97846ee39f1301f8a9, user_id=16a0dbb46dd84a449a2993262c97875e, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.303367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04332195-b15f-4779-a44f-83c71bc1fa1b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.305576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 952/1938] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:09 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:09.306586 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cd399-3ccf-48c6-9bdf-ee56ef752edd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.328920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 987/1939] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:09 2022] PUT /identity/v3/projects/39e11b46b89b4c97846ee39f1301f8a9/users/16a0dbb46dd84a449a2993262c97875e/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:09.328920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04332195-b15f-4779-a44f-83c71bc1fa1b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.397102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cd399-3ccf-48c6-9bdf-ee56ef752edd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.403126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb517b5-ebf3-4981-8806-cc42b7b579dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.403749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb517b5-ebf3-4981-8806-cc42b7b579dd admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.404533 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb517b5-ebf3-4981-8806-cc42b7b579dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.404533 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb517b5-ebf3-4981-8806-cc42b7b579dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.406049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb517b5-ebf3-4981-8806-cc42b7b579dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.409117 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb517b5-ebf3-4981-8806-cc42b7b579dd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.410861 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04332195-b15f-4779-a44f-83c71bc1fa1b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.415713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cec97c-f2e3-4285-baa3-a44b7c4db98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.416621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cec97c-f2e3-4285-baa3-a44b7c4db98b admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.416962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cec97c-f2e3-4285-baa3-a44b7c4db98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.417323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cec97c-f2e3-4285-baa3-a44b7c4db98b admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.417984 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cec97c-f2e3-4285-baa3-a44b7c4db98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.419957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cec97c-f2e3-4285-baa3-a44b7c4db98b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.426161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 953/1940] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:09.427665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb517b5-ebf3-4981-8806-cc42b7b579dd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.443954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb517b5-ebf3-4981-8806-cc42b7b579dd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.449244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 988/1941] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:09 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:09.450164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cec97c-f2e3-4285-baa3-a44b7c4db98b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.455191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23aed7-3db1-4c35-b310-a3cb4da6ff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.455831 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23aed7-3db1-4c35-b310-a3cb4da6ff95 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.456107 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23aed7-3db1-4c35-b310-a3cb4da6ff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.456375 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23aed7-3db1-4c35-b310-a3cb4da6ff95 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.457017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23aed7-3db1-4c35-b310-a3cb4da6ff95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.458992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23aed7-3db1-4c35-b310-a3cb4da6ff95 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.467189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cec97c-f2e3-4285-baa3-a44b7c4db98b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.472575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b276ba5-dc04-4f25-9f35-377bca5153c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.473130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b276ba5-dc04-4f25-9f35-377bca5153c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.473472 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b276ba5-dc04-4f25-9f35-377bca5153c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.473988 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b276ba5-dc04-4f25-9f35-377bca5153c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.474588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b276ba5-dc04-4f25-9f35-377bca5153c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.487697 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 954/1942] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:09 2022] POST /identity/v3/users => generated 286 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:09.488666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23aed7-3db1-4c35-b310-a3cb4da6ff95 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.493328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b276ba5-dc04-4f25-9f35-377bca5153c3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.506280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23aed7-3db1-4c35-b310-a3cb4da6ff95 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.509041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 989/1943] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:09.509923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b276ba5-dc04-4f25-9f35-377bca5153c3 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.515481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82107f-af9b-4445-b970-f22dd2b00aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.516427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82107f-af9b-4445-b970-f22dd2b00aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.516906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82107f-af9b-4445-b970-f22dd2b00aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.517525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82107f-af9b-4445-b970-f22dd2b00aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.518398 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82107f-af9b-4445-b970-f22dd2b00aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.520392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82107f-af9b-4445-b970-f22dd2b00aaf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.526848 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b276ba5-dc04-4f25-9f35-377bca5153c3 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.533721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d89ece-97df-4da2-b2d3-c2595e335a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.534271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d89ece-97df-4da2-b2d3-c2595e335a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.534590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d89ece-97df-4da2-b2d3-c2595e335a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.534922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d89ece-97df-4da2-b2d3-c2595e335a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.535583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d89ece-97df-4da2-b2d3-c2595e335a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.537173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 955/1944] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:09.538299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82107f-af9b-4445-b970-f22dd2b00aaf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.542074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d89ece-97df-4da2-b2d3-c2595e335a36 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.550952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82107f-af9b-4445-b970-f22dd2b00aaf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.555309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 990/1945] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:09.556153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d89ece-97df-4da2-b2d3-c2595e335a36 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.560333 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385a00-0dc5-47df-b554-289cda9ce7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.561358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385a00-0dc5-47df-b554-289cda9ce7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.561825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385a00-0dc5-47df-b554-289cda9ce7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.562277 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385a00-0dc5-47df-b554-289cda9ce7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.564446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c385a00-0dc5-47df-b554-289cda9ce7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.566573 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c385a00-0dc5-47df-b554-289cda9ce7c7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.566702 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d89ece-97df-4da2-b2d3-c2595e335a36 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.572312 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0591ffa-c6e2-4406-bb30-362aafc41fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.573628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0591ffa-c6e2-4406-bb30-362aafc41fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.573913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0591ffa-c6e2-4406-bb30-362aafc41fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.574184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0591ffa-c6e2-4406-bb30-362aafc41fd7 admin admin] PATH_INFO: `/v3/projects/39e11b46b89b4c97846ee39f1301f8a9/users/16a0dbb46dd84a449a2993262c97875e/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.576815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0591ffa-c6e2-4406-bb30-362aafc41fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e11b46b89b4c97846ee39f1301f8a9, user_id=16a0dbb46dd84a449a2993262c97875e, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.579822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0591ffa-c6e2-4406-bb30-362aafc41fd7 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.582805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 956/1946] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:09.584205 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385a00-0dc5-47df-b554-289cda9ce7c7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.596348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385a00-0dc5-47df-b554-289cda9ce7c7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.602869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2735481-a567-4f05-8a8e-e5b1b27c53d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.604414 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735481-a567-4f05-8a8e-e5b1b27c53d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.604974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735481-a567-4f05-8a8e-e5b1b27c53d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.605733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735481-a567-4f05-8a8e-e5b1b27c53d6 admin admin] PATH_INFO: `/v3/projects/ad9811ef18984f44b37a91e7e986f7d1/users/b891891c7e2b4d14a8c38c59330629a8/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.619663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 991/1947] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:09 2022] PUT /identity/v3/projects/39e11b46b89b4c97846ee39f1301f8a9/users/16a0dbb46dd84a449a2993262c97875e/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:09.621166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0591ffa-c6e2-4406-bb30-362aafc41fd7 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.625431 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:09.629666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2735481-a567-4f05-8a8e-e5b1b27c53d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9811ef18984f44b37a91e7e986f7d1, user_id=b891891c7e2b4d14a8c38c59330629a8, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.632991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2735481-a567-4f05-8a8e-e5b1b27c53d6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.650212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 957/1948] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:09 2022] PUT /identity/v3/projects/ad9811ef18984f44b37a91e7e986f7d1/users/b891891c7e2b4d14a8c38c59330629a8/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:09.651471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2735481-a567-4f05-8a8e-e5b1b27c53d6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.701727 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:09.728634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2735481-a567-4f05-8a8e-e5b1b27c53d6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.730988 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0591ffa-c6e2-4406-bb30-362aafc41fd7 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.733779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b6392-11c8-4bcf-ad4d-40637341a370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.734427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b6392-11c8-4bcf-ad4d-40637341a370 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.734691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b6392-11c8-4bcf-ad4d-40637341a370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.734962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b6392-11c8-4bcf-ad4d-40637341a370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.735603 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b6392-11c8-4bcf-ad4d-40637341a370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.736348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338bbfc-2665-49e0-bb5b-6cf3f5c1eb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.737082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338bbfc-2665-49e0-bb5b-6cf3f5c1eb79 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.737187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b6392-11c8-4bcf-ad4d-40637341a370 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.737428 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338bbfc-2665-49e0-bb5b-6cf3f5c1eb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.737806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338bbfc-2665-49e0-bb5b-6cf3f5c1eb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.738574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338bbfc-2665-49e0-bb5b-6cf3f5c1eb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.740282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338bbfc-2665-49e0-bb5b-6cf3f5c1eb79 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.749310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 958/1949] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:09.750898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd57ef-f516-4047-a7eb-fbc02d292bc7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.751215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd57ef-f516-4047-a7eb-fbc02d292bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.751487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd57ef-f516-4047-a7eb-fbc02d292bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.755937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 992/1950] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:09.757577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec22c5-f52f-45af-a23e-0c6e580b24d2 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.758052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec22c5-f52f-45af-a23e-0c6e580b24d2 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.758597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec22c5-f52f-45af-a23e-0c6e580b24d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.791498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c1ec22c5-f52f-45af-a23e-0c6e580b24d2 None None] MFA Rules not processed for user `b891891c7e2b4d14a8c38c59330629a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:09.793618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c1ec22c5-f52f-45af-a23e-0c6e580b24d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:09.794690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-42bd57ef-f516-4047-a7eb-fbc02d292bc7 None None] MFA Rules not processed for user `16a0dbb46dd84a449a2993262c97875e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:09.796098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-42bd57ef-f516-4047-a7eb-fbc02d292bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:09.864067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 993/1951] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:09.865002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec22c5-f52f-45af-a23e-0c6e580b24d2 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.872166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 959/1952] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:09.873010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd57ef-f516-4047-a7eb-fbc02d292bc7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.876996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec22c5-f52f-45af-a23e-0c6e580b24d2 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.882173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612733c-14a0-4276-bb3d-33077ea72dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.882876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612733c-14a0-4276-bb3d-33077ea72dac admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.883106 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd57ef-f516-4047-a7eb-fbc02d292bc7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.883228 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612733c-14a0-4276-bb3d-33077ea72dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.883465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612733c-14a0-4276-bb3d-33077ea72dac admin admin] PATH_INFO: `/v3/projects/9a8781603b0d48c595305fd025874a82/users/0a8f4d37060d4158bd0cf774b02429ee/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.888201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feecef-bf5a-42af-a693-98b0c892956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:09.888869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feecef-bf5a-42af-a693-98b0c892956b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:09.889152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feecef-bf5a-42af-a693-98b0c892956b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:09.889429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feecef-bf5a-42af-a693-98b0c892956b admin admin] PATH_INFO: `/v3/projects/4eec9115f83b4126a2df1fcd04e2e0d5/users/7e15be3b90284c8dba6f34354be1962e/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:09.899948 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612733c-14a0-4276-bb3d-33077ea72dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8781603b0d48c595305fd025874a82, user_id=0a8f4d37060d4158bd0cf774b02429ee, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.903270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612733c-14a0-4276-bb3d-33077ea72dac admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.905723 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feecef-bf5a-42af-a693-98b0c892956b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eec9115f83b4126a2df1fcd04e2e0d5, user_id=7e15be3b90284c8dba6f34354be1962e, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:09.908625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feecef-bf5a-42af-a693-98b0c892956b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:09.917646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 994/1953] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:09 2022] PUT /identity/v3/projects/9a8781603b0d48c595305fd025874a82/users/0a8f4d37060d4158bd0cf774b02429ee/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:09.918529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612733c-14a0-4276-bb3d-33077ea72dac admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.931335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 960/1954] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:09 2022] PUT /identity/v3/projects/4eec9115f83b4126a2df1fcd04e2e0d5/users/7e15be3b90284c8dba6f34354be1962e/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:09.932801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feecef-bf5a-42af-a693-98b0c892956b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:09.934820 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f2feecef-bf5a-42af-a693-98b0c892956b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:09.984327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612733c-14a0-4276-bb3d-33077ea72dac admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:09.988385 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:09.995295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feecef-bf5a-42af-a693-98b0c892956b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:10.000161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd3f9b-c063-4f07-82a2-d29ee840d9fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:10.000868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd3f9b-c063-4f07-82a2-d29ee840d9fe service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.001150 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd3f9b-c063-4f07-82a2-d29ee840d9fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.001464 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd3f9b-c063-4f07-82a2-d29ee840d9fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.033261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:10.050990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91956c-ea1a-4205-8960-e5e83a813168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:10.051513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91956c-ea1a-4205-8960-e5e83a813168 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.051790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91956c-ea1a-4205-8960-e5e83a813168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.052056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91956c-ea1a-4205-8960-e5e83a813168 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.052679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91956c-ea1a-4205-8960-e5e83a813168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:10.054726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91956c-ea1a-4205-8960-e5e83a813168 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:10.071078 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd3f9b-c063-4f07-82a2-d29ee840d9fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:10.072542 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd3f9b-c063-4f07-82a2-d29ee840d9fe service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:10.083508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 961/1955] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:10.085155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89134243-ed40-45ea-b007-e574666adb34 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.085155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89134243-ed40-45ea-b007-e574666adb34 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.085358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89134243-ed40-45ea-b007-e574666adb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.102036 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 995/1956] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:09 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:10.106971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fb6c3-3a03-450f-b6da-1531dc58bfe7 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.107850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fb6c3-3a03-450f-b6da-1531dc58bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.110467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fb6c3-3a03-450f-b6da-1531dc58bfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.125120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-89134243-ed40-45ea-b007-e574666adb34 None None] MFA Rules not processed for user `0a8f4d37060d4158bd0cf774b02429ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:10.126630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-89134243-ed40-45ea-b007-e574666adb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:10.139896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-7c2fb6c3-3a03-450f-b6da-1531dc58bfe7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:10.139896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7c2fb6c3-3a03-450f-b6da-1531dc58bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:10.210447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 996/1957] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:10.211386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fb6c3-3a03-450f-b6da-1531dc58bfe7 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:10.225521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 962/1958] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:10.225714 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fb6c3-3a03-450f-b6da-1531dc58bfe7 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:10.225796 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89134243-ed40-45ea-b007-e574666adb34 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:10.226967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-89134243-ed40-45ea-b007-e574666adb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:10.230357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8d0d9-c6fe-46d5-90ef-d42935b57571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:10.231075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8d0d9-c6fe-46d5-90ef-d42935b57571 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.231427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8d0d9-c6fe-46d5-90ef-d42935b57571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.231771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8d0d9-c6fe-46d5-90ef-d42935b57571 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.232470 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8d0d9-c6fe-46d5-90ef-d42935b57571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:10.234596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8d0d9-c6fe-46d5-90ef-d42935b57571 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:10.260112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 997/1959] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:10 2022] POST /identity/v3/users => generated 298 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:10.260112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8d0d9-c6fe-46d5-90ef-d42935b57571 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:10.261971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b3b8d0d9-c6fe-46d5-90ef-d42935b57571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:10.285279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89134243-ed40-45ea-b007-e574666adb34 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:10.289038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c30057-ebeb-4e83-801b-f175a47dbc09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:10.289647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c30057-ebeb-4e83-801b-f175a47dbc09 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.289932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c30057-ebeb-4e83-801b-f175a47dbc09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.290201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c30057-ebeb-4e83-801b-f175a47dbc09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.292975 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-55c30057-ebeb-4e83-801b-f175a47dbc09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:10.320568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8d0d9-c6fe-46d5-90ef-d42935b57571 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:10.325709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc8126-43cb-40f1-b11a-3fa084236a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:10.326288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc8126-43cb-40f1-b11a-3fa084236a9a service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.326593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc8126-43cb-40f1-b11a-3fa084236a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.326936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc8126-43cb-40f1-b11a-3fa084236a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.336321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:10.336489 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc8126-43cb-40f1-b11a-3fa084236a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:10.338661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc8126-43cb-40f1-b11a-3fa084236a9a service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:10.348399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 998/1960] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:10.349189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc8126-43cb-40f1-b11a-3fa084236a9a service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:10.353135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c30057-ebeb-4e83-801b-f175a47dbc09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:10.355151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c30057-ebeb-4e83-801b-f175a47dbc09 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:10.358423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc8126-43cb-40f1-b11a-3fa084236a9a service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:10.363337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f555813-f6d5-4655-9ec6-cff6c1365107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:10.363930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555813-f6d5-4655-9ec6-cff6c1365107 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.364204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555813-f6d5-4655-9ec6-cff6c1365107 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.364471 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555813-f6d5-4655-9ec6-cff6c1365107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.364955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 963/1961] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:10.365896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c30057-ebeb-4e83-801b-f175a47dbc09 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:10.378039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c30057-ebeb-4e83-801b-f175a47dbc09 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:10.383240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbed395-e4f5-442c-ba79-b82412462c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:10.383860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbed395-e4f5-442c-ba79-b82412462c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.384138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbed395-e4f5-442c-ba79-b82412462c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.384413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbed395-e4f5-442c-ba79-b82412462c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.385056 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbed395-e4f5-442c-ba79-b82412462c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:10.386979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbed395-e4f5-442c-ba79-b82412462c90 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:10.390320 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f555813-f6d5-4655-9ec6-cff6c1365107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:10.394266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f555813-f6d5-4655-9ec6-cff6c1365107 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:10.399492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 964/1962] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:10.403667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbed395-e4f5-442c-ba79-b82412462c90 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:10.408688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 999/1963] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:10.415427 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbed395-e4f5-442c-ba79-b82412462c90 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:10.429107 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087ec35-4e33-4718-a127-908be4653953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:10.430683 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087ec35-4e33-4718-a127-908be4653953 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.431265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087ec35-4e33-4718-a127-908be4653953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.431400 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f555813-f6d5-4655-9ec6-cff6c1365107 service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:10.431940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087ec35-4e33-4718-a127-908be4653953 admin admin] PATH_INFO: `/v3/projects/556f82009fb6401f997ee29493439d4d/users/252e56ea023e4a7c89256943712e2cef/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.446271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f555813-f6d5-4655-9ec6-cff6c1365107 service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:10.456202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286bf8d-15ea-4779-93ca-226a46bb3a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:10.456751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087ec35-4e33-4718-a127-908be4653953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=556f82009fb6401f997ee29493439d4d, user_id=252e56ea023e4a7c89256943712e2cef, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:10.459574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087ec35-4e33-4718-a127-908be4653953 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:10.459732 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286bf8d-15ea-4779-93ca-226a46bb3a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.459891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286bf8d-15ea-4779-93ca-226a46bb3a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.460121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286bf8d-15ea-4779-93ca-226a46bb3a67 admin admin] PATH_INFO: `/v3/users/0a8f4d37060d4158bd0cf774b02429ee` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.461518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286bf8d-15ea-4779-93ca-226a46bb3a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8f4d37060d4158bd0cf774b02429ee)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:10.464241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286bf8d-15ea-4779-93ca-226a46bb3a67 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:10.477563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 965/1964] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:10 2022] PUT /identity/v3/projects/556f82009fb6401f997ee29493439d4d/users/252e56ea023e4a7c89256943712e2cef/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:10.482058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087ec35-4e33-4718-a127-908be4653953 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:10.516799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:10.531482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1286bf8d-15ea-4779-93ca-226a46bb3a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8f4d37060d4158bd0cf774b02429ee'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:10.547060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1286bf8d-15ea-4779-93ca-226a46bb3a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8f4d37060d4158bd0cf774b02429ee'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:10.570948 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1286bf8d-15ea-4779-93ca-226a46bb3a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8f4d37060d4158bd0cf774b02429ee'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:10.571740 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1286bf8d-15ea-4779-93ca-226a46bb3a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8f4d37060d4158bd0cf774b02429ee'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:10.573008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1286bf8d-15ea-4779-93ca-226a46bb3a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8f4d37060d4158bd0cf774b02429ee'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:10.590129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087ec35-4e33-4718-a127-908be4653953 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:10.594930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1000/1965] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:10 2022] DELETE /identity/v3/users/0a8f4d37060d4158bd0cf774b02429ee => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:10.598076 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb2385-97f6-4912-8aac-875b0854f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:10.598816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb2385-97f6-4912-8aac-875b0854f026 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.599814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201737e-e44a-4ba1-b3a1-9bb627b0a3c7 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.599926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb2385-97f6-4912-8aac-875b0854f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.600232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201737e-e44a-4ba1-b3a1-9bb627b0a3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.600367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb2385-97f6-4912-8aac-875b0854f026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.600588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201737e-e44a-4ba1-b3a1-9bb627b0a3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.601193 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb2385-97f6-4912-8aac-875b0854f026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:10.605608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb2385-97f6-4912-8aac-875b0854f026 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:10.625146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-1201737e-e44a-4ba1-b3a1-9bb627b0a3c7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:10.626473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-1201737e-e44a-4ba1-b3a1-9bb627b0a3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:10.637364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 966/1966] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:10.642017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb2385-97f6-4912-8aac-875b0854f026 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:10.644293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ddfb2385-97f6-4912-8aac-875b0854f026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:10.676006 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb2385-97f6-4912-8aac-875b0854f026 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:10.757056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1001/1967] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:10.785405 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33682a9d-a86f-4435-a652-b4f4e1a4fdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:10.786417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33682a9d-a86f-4435-a652-b4f4e1a4fdb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.786708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33682a9d-a86f-4435-a652-b4f4e1a4fdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.787038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33682a9d-a86f-4435-a652-b4f4e1a4fdb0 admin admin] PATH_INFO: `/v3/projects/556f82009fb6401f997ee29493439d4d/users/252e56ea023e4a7c89256943712e2cef/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.789415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33682a9d-a86f-4435-a652-b4f4e1a4fdb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=556f82009fb6401f997ee29493439d4d, user_id=252e56ea023e4a7c89256943712e2cef, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:10.793925 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33682a9d-a86f-4435-a652-b4f4e1a4fdb0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:10.810604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 967/1968] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:10 2022] PUT /identity/v3/projects/556f82009fb6401f997ee29493439d4d/users/252e56ea023e4a7c89256943712e2cef/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:10.831298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43018f29-a84d-46c4-97d8-506c368682ef None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:10.831298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43018f29-a84d-46c4-97d8-506c368682ef None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:10.831298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43018f29-a84d-46c4-97d8-506c368682ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:10.852039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33682a9d-a86f-4435-a652-b4f4e1a4fdb0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:10.857252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-33682a9d-a86f-4435-a652-b4f4e1a4fdb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:10.923270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-43018f29-a84d-46c4-97d8-506c368682ef None None] MFA Rules not processed for user `252e56ea023e4a7c89256943712e2cef`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:10.926174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-43018f29-a84d-46c4-97d8-506c368682ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:10.994310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:11.039442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33682a9d-a86f-4435-a652-b4f4e1a4fdb0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:11.053666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d8e53-9c5a-47c6-9be5-9c5dc62602e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:11.055707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d8e53-9c5a-47c6-9be5-9c5dc62602e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:11.056404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d8e53-9c5a-47c6-9be5-9c5dc62602e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:11.057922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d8e53-9c5a-47c6-9be5-9c5dc62602e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:11.105097 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1002/1969] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:11.115322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43018f29-a84d-46c4-97d8-506c368682ef None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:11.121240 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-43018f29-a84d-46c4-97d8-506c368682ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:11.205433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:11.211906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43018f29-a84d-46c4-97d8-506c368682ef None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:11.219793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f92b0-48b2-4b64-b73f-a203b2a5bb56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:11.220857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f92b0-48b2-4b64-b73f-a203b2a5bb56 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:11.221412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f92b0-48b2-4b64-b73f-a203b2a5bb56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:11.221922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f92b0-48b2-4b64-b73f-a203b2a5bb56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:11.224769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a06f92b0-48b2-4b64-b73f-a203b2a5bb56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:11.235914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d8e53-9c5a-47c6-9be5-9c5dc62602e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:11.237398 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d8e53-9c5a-47c6-9be5-9c5dc62602e9 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:11.259171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 968/1970] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:11.307525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f92b0-48b2-4b64-b73f-a203b2a5bb56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:11.309667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f92b0-48b2-4b64-b73f-a203b2a5bb56 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:11.346563 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1003/1971] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:11.445315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223ca7-0950-466f-a3b3-d5e37a6bdaea None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:11.445873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223ca7-0950-466f-a3b3-d5e37a6bdaea None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:11.446486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223ca7-0950-466f-a3b3-d5e37a6bdaea None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:11.448249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 969/1972] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:29:11.466906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af90548-b942-4e8c-803d-3e5255c7d5ac None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:11.467193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af90548-b942-4e8c-803d-3e5255c7d5ac None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:11.467476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af90548-b942-4e8c-803d-3e5255c7d5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:11.505831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-5af90548-b942-4e8c-803d-3e5255c7d5ac None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:11.508787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5af90548-b942-4e8c-803d-3e5255c7d5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:11.645227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1004/1973] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:29:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:12.257942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b223ca7-0950-466f-a3b3-d5e37a6bdaea None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:12.262256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5b223ca7-0950-466f-a3b3-d5e37a6bdaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:12.281403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b223ca7-0950-466f-a3b3-d5e37a6bdaea None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:12.290555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c3df2-9461-457c-b206-ea7d67ac6d80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:12.291478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c3df2-9461-457c-b206-ea7d67ac6d80 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:12.291815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c3df2-9461-457c-b206-ea7d67ac6d80 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:12.292938 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c3df2-9461-457c-b206-ea7d67ac6d80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:12.302396 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c3df2-9461-457c-b206-ea7d67ac6d80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:12.304258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c3df2-9461-457c-b206-ea7d67ac6d80 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:12.316630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 970/1974] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:12.366859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d27264-dd07-4b5b-912d-4fb87eeb5b65 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:12.367385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d27264-dd07-4b5b-912d-4fb87eeb5b65 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:12.367481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d27264-dd07-4b5b-912d-4fb87eeb5b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:12.376477 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c3df2-9461-457c-b206-ea7d67ac6d80 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:12.380535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-408c3df2-9461-457c-b206-ea7d67ac6d80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:12.400476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c3df2-9461-457c-b206-ea7d67ac6d80 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:12.415541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:12.417983 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:12.419359 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:12.419817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871 admin admin] PATH_INFO: `/v3/projects/9a8781603b0d48c595305fd025874a82` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:12.421243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8781603b0d48c595305fd025874a82)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:12.423690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:12.429322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-88d27264-dd07-4b5b-912d-4fb87eeb5b65 None None] MFA Rules not processed for user `7e15be3b90284c8dba6f34354be1962e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:12.430906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-88d27264-dd07-4b5b-912d-4fb87eeb5b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:12.491614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8781603b0d48c595305fd025874a82', 'request_id': 'req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:12.503883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8781603b0d48c595305fd025874a82', 'request_id': 'req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:12.513376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8781603b0d48c595305fd025874a82', 'request_id': 'req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:12.528375 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871 admin admin] The token cache is being invalidate because project 9a8781603b0d48c595305fd025874a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:12.529123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:12.529933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a29e8be2-8fb3-44b1-a9ee-8ef9c2808871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:12.530930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1005/1975] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:12.536255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d27264-dd07-4b5b-912d-4fb87eeb5b65 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:12.536889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 971/1976] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:12 2022] DELETE /identity/v3/projects/9a8781603b0d48c595305fd025874a82 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:12.538172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-88d27264-dd07-4b5b-912d-4fb87eeb5b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:12.543118 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b00699-4aa5-466e-88db-0dca97c22fff None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:12.543433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b00699-4aa5-466e-88db-0dca97c22fff None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:12.543891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b00699-4aa5-466e-88db-0dca97c22fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:12.565858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-51b00699-4aa5-466e-88db-0dca97c22fff None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:12.567381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-51b00699-4aa5-466e-88db-0dca97c22fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:12.570810 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d27264-dd07-4b5b-912d-4fb87eeb5b65 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:12.589948 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:12.645613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:12.658164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbb8af-05cc-4980-ad75-09991c393bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:12.659018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbb8af-05cc-4980-ad75-09991c393bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:12.659409 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbb8af-05cc-4980-ad75-09991c393bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:12.659789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbb8af-05cc-4980-ad75-09991c393bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:12.660500 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbb8af-05cc-4980-ad75-09991c393bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:12.661357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 972/1977] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:12.662932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbb8af-05cc-4980-ad75-09991c393bc3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:12.670800 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d03a-5b42-4a8e-b6ac-52a71fbaf77c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:12.671085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d03a-5b42-4a8e-b6ac-52a71fbaf77c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:12.671353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d03a-5b42-4a8e-b6ac-52a71fbaf77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:12.703709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-08a2d03a-5b42-4a8e-b6ac-52a71fbaf77c None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:12.704884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-08a2d03a-5b42-4a8e-b6ac-52a71fbaf77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:12.705762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1006/1978] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:12 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:12.709761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbb8af-05cc-4980-ad75-09991c393bc3 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:12.712304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-16dbb8af-05cc-4980-ad75-09991c393bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:12.774962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 973/1979] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:12.779714 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d03a-5b42-4a8e-b6ac-52a71fbaf77c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:12.785464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbb8af-05cc-4980-ad75-09991c393bc3 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:12.788577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d03a-5b42-4a8e-b6ac-52a71fbaf77c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:12.790098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa58f5-1ae2-4397-809e-411947966f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:12.790769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa58f5-1ae2-4397-809e-411947966f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:12.791050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa58f5-1ae2-4397-809e-411947966f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:12.792154 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa58f5-1ae2-4397-809e-411947966f69 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:12.792928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa58f5-1ae2-4397-809e-411947966f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:12.794266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230602f-3373-46d1-84fc-64c7aa149e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:12.794991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230602f-3373-46d1-84fc-64c7aa149e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:12.795276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230602f-3373-46d1-84fc-64c7aa149e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:12.795375 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa58f5-1ae2-4397-809e-411947966f69 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:12.795546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230602f-3373-46d1-84fc-64c7aa149e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:12.796194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230602f-3373-46d1-84fc-64c7aa149e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:12.796497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230602f-3373-46d1-84fc-64c7aa149e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:12.798233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230602f-3373-46d1-84fc-64c7aa149e3b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:12.811165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 974/1980] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:29:12.815459 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230602f-3373-46d1-84fc-64c7aa149e3b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:12.817179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1007/1981] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:12 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:12.820635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa58f5-1ae2-4397-809e-411947966f69 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:12.825619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230602f-3373-46d1-84fc-64c7aa149e3b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:12.830287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa58f5-1ae2-4397-809e-411947966f69 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:12.831781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5878d65-3e0d-4da7-b54b-f592c45cfd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:12.832399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5878d65-3e0d-4da7-b54b-f592c45cfd61 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:12.832684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5878d65-3e0d-4da7-b54b-f592c45cfd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:12.832959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5878d65-3e0d-4da7-b54b-f592c45cfd61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:12.833597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5878d65-3e0d-4da7-b54b-f592c45cfd61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:12.835110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173cfb2-15bc-4380-9c37-928433c3cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:12.835559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5878d65-3e0d-4da7-b54b-f592c45cfd61 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:12.835778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173cfb2-15bc-4380-9c37-928433c3cb93 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:12.836055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173cfb2-15bc-4380-9c37-928433c3cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:12.836324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173cfb2-15bc-4380-9c37-928433c3cb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:12.836966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173cfb2-15bc-4380-9c37-928433c3cb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:12.839230 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173cfb2-15bc-4380-9c37-928433c3cb93 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:12.861026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1008/1982] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:12.862224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173cfb2-15bc-4380-9c37-928433c3cb93 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:12.872626 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 975/1983] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:12 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:29:12.872823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173cfb2-15bc-4380-9c37-928433c3cb93 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:12.873703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5878d65-3e0d-4da7-b54b-f592c45cfd61 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:12.958432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1a964-c64b-4bad-8d5c-56ff6ce54b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:12.958432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1a964-c64b-4bad-8d5c-56ff6ce54b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:12.958432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1a964-c64b-4bad-8d5c-56ff6ce54b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:12.958432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1a964-c64b-4bad-8d5c-56ff6ce54b3f admin admin] PATH_INFO: `/v3/projects/9ee79b3793544baa83fa5f4a9124b2e7/users/f5aed4c00f444a138ae8fb29df090efd/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:12.974487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1a964-c64b-4bad-8d5c-56ff6ce54b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee79b3793544baa83fa5f4a9124b2e7, user_id=f5aed4c00f444a138ae8fb29df090efd, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:12.977366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1a964-c64b-4bad-8d5c-56ff6ce54b3f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:12.978684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5878d65-3e0d-4da7-b54b-f592c45cfd61 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:12.985435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d0c3f-2dea-4adb-b9fc-60cce841fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:12.986163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d0c3f-2dea-4adb-b9fc-60cce841fd68 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:12.986533 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d0c3f-2dea-4adb-b9fc-60cce841fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:12.986849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d0c3f-2dea-4adb-b9fc-60cce841fd68 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:12.987493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d0c3f-2dea-4adb-b9fc-60cce841fd68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:12.990680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d0c3f-2dea-4adb-b9fc-60cce841fd68 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:12.997385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1009/1984] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:12 2022] PUT /identity/v3/projects/9ee79b3793544baa83fa5f4a9124b2e7/users/f5aed4c00f444a138ae8fb29df090efd/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:12.998638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1a964-c64b-4bad-8d5c-56ff6ce54b3f admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:13.014160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:13.017027 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 976/1985] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:12 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:13.021216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d0c3f-2dea-4adb-b9fc-60cce841fd68 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:13.040544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d0c3f-2dea-4adb-b9fc-60cce841fd68 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:13.114304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:13.131140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63d65-be2c-41a2-9ebe-cb15b1ba4f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:13.132870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63d65-be2c-41a2-9ebe-cb15b1ba4f0a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:13.133224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63d65-be2c-41a2-9ebe-cb15b1ba4f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:13.133510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63d65-be2c-41a2-9ebe-cb15b1ba4f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:13.134177 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a63d65-be2c-41a2-9ebe-cb15b1ba4f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:13.137808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a63d65-be2c-41a2-9ebe-cb15b1ba4f0a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:13.145412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1a964-c64b-4bad-8d5c-56ff6ce54b3f admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:13.152305 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740e699-b90b-42fe-904b-4388f0a63fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:13.153037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740e699-b90b-42fe-904b-4388f0a63fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:13.153385 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740e699-b90b-42fe-904b-4388f0a63fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:13.153842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740e699-b90b-42fe-904b-4388f0a63fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:13.157089 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 977/1986] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:13.157224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740e699-b90b-42fe-904b-4388f0a63fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:13.157224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740e699-b90b-42fe-904b-4388f0a63fb5 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:13.158910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63d65-be2c-41a2-9ebe-cb15b1ba4f0a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:13.170837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1010/1987] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:13.174408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63d65-be2c-41a2-9ebe-cb15b1ba4f0a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:13.179916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740e699-b90b-42fe-904b-4388f0a63fb5 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:13.181352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241c8b-80cf-4d9a-bc72-64444ce847ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:13.182756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241c8b-80cf-4d9a-bc72-64444ce847ab admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:13.183153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241c8b-80cf-4d9a-bc72-64444ce847ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:13.183626 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241c8b-80cf-4d9a-bc72-64444ce847ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:13.184425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2241c8b-80cf-4d9a-bc72-64444ce847ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:13.186188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2241c8b-80cf-4d9a-bc72-64444ce847ab admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:13.198946 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 978/1988] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:13.203424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241c8b-80cf-4d9a-bc72-64444ce847ab admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:13.209034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740e699-b90b-42fe-904b-4388f0a63fb5 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:13.214713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241c8b-80cf-4d9a-bc72-64444ce847ab admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:13.218935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f9f62-d7c7-4f35-aa1e-3c61387eb743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:13.219825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9f62-d7c7-4f35-aa1e-3c61387eb743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:13.220674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0e7e1-4fe2-4122-b857-101db0bfa505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:13.221129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9f62-d7c7-4f35-aa1e-3c61387eb743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:13.221541 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9f62-d7c7-4f35-aa1e-3c61387eb743 admin admin] PATH_INFO: `/v3/projects/9ee79b3793544baa83fa5f4a9124b2e7/users/f5aed4c00f444a138ae8fb29df090efd/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:13.222325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0e7e1-4fe2-4122-b857-101db0bfa505 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:13.222733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0e7e1-4fe2-4122-b857-101db0bfa505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:13.223103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0e7e1-4fe2-4122-b857-101db0bfa505 admin admin] PATH_INFO: `/v3/projects/8a67d8f82803453fb0cc7ce449155792/users/362ba33b2cd746e0846dada383886e60/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:13.226471 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f9f62-d7c7-4f35-aa1e-3c61387eb743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee79b3793544baa83fa5f4a9124b2e7, user_id=f5aed4c00f444a138ae8fb29df090efd, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:13.235837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f9f62-d7c7-4f35-aa1e-3c61387eb743 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:13.247474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0e7e1-4fe2-4122-b857-101db0bfa505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a67d8f82803453fb0cc7ce449155792, user_id=362ba33b2cd746e0846dada383886e60, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:13.255493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1011/1989] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:13 2022] PUT /identity/v3/projects/9ee79b3793544baa83fa5f4a9124b2e7/users/f5aed4c00f444a138ae8fb29df090efd/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:13.260536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0e7e1-4fe2-4122-b857-101db0bfa505 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:13.303256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 979/1990] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:13 2022] PUT /identity/v3/projects/8a67d8f82803453fb0cc7ce449155792/users/362ba33b2cd746e0846dada383886e60/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:13.316520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc61b-a64b-4c17-ac86-3264e64d97b4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:13.316814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc61b-a64b-4c17-ac86-3264e64d97b4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:13.317127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc61b-a64b-4c17-ac86-3264e64d97b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:13.378828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-1cdbc61b-a64b-4c17-ac86-3264e64d97b4 None None] MFA Rules not processed for user `362ba33b2cd746e0846dada383886e60`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:13.380996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-1cdbc61b-a64b-4c17-ac86-3264e64d97b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:13.484843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1012/1991] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:13.498500 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0e7e1-4fe2-4122-b857-101db0bfa505 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:13.501900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b0f0e7e1-4fe2-4122-b857-101db0bfa505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:13.669952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0e7e1-4fe2-4122-b857-101db0bfa505 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:13.673870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350ae38-4898-4077-b051-74510a919e17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f96bbb14c04691ac403271de293224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:13.674538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350ae38-4898-4077-b051-74510a919e17 service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:13.674938 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350ae38-4898-4077-b051-74510a919e17 service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:13.675267 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350ae38-4898-4077-b051-74510a919e17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:13.685471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350ae38-4898-4077-b051-74510a919e17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:13.687140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350ae38-4898-4077-b051-74510a919e17 service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:13.710008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 980/1992] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:14.594184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc61b-a64b-4c17-ac86-3264e64d97b4 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:14.597494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-1cdbc61b-a64b-4c17-ac86-3264e64d97b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:14.786031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc61b-a64b-4c17-ac86-3264e64d97b4 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:14.805208 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd77a6-af7f-421e-ad95-bf1d028de7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:14.805961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd77a6-af7f-421e-ad95-bf1d028de7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:14.806486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd77a6-af7f-421e-ad95-bf1d028de7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:14.806766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd77a6-af7f-421e-ad95-bf1d028de7f4 admin admin] PATH_INFO: `/v3/users/9c795987eaf04747a7331afd5bf9897e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:14.808340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd77a6-af7f-421e-ad95-bf1d028de7f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c795987eaf04747a7331afd5bf9897e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:14.810423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd77a6-af7f-421e-ad95-bf1d028de7f4 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:14.839255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:14.868663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee894b-5f63-4ea7-89ef-3c172245c982 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:14.869645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee894b-5f63-4ea7-89ef-3c172245c982 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:14.870326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee894b-5f63-4ea7-89ef-3c172245c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:14.936418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0fee894b-5f63-4ea7-89ef-3c172245c982 None None] MFA Rules not processed for user `f5aed4c00f444a138ae8fb29df090efd`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:14.943627 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c5cd77a6-af7f-421e-ad95-bf1d028de7f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c795987eaf04747a7331afd5bf9897e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:14.943839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0fee894b-5f63-4ea7-89ef-3c172245c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:14.964980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c5cd77a6-af7f-421e-ad95-bf1d028de7f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c795987eaf04747a7331afd5bf9897e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:14.987422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c5cd77a6-af7f-421e-ad95-bf1d028de7f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c795987eaf04747a7331afd5bf9897e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:14.988870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c5cd77a6-af7f-421e-ad95-bf1d028de7f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c795987eaf04747a7331afd5bf9897e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:14.990245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c5cd77a6-af7f-421e-ad95-bf1d028de7f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c795987eaf04747a7331afd5bf9897e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:15.053556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1013/1993] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:14 2022] DELETE /identity/v3/users/9c795987eaf04747a7331afd5bf9897e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:15.061380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528dcca-5d34-4634-b2d1-78da5243047f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:15.062302 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528dcca-5d34-4634-b2d1-78da5243047f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:15.062790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528dcca-5d34-4634-b2d1-78da5243047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:15.104633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-6528dcca-5d34-4634-b2d1-78da5243047f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:15.107470 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6528dcca-5d34-4634-b2d1-78da5243047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:15.154447 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 981/1994] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:15.161440 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e6061-06fe-4df4-ab0d-1b817e5318b1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:15.161749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e6061-06fe-4df4-ab0d-1b817e5318b1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:15.162024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e6061-06fe-4df4-ab0d-1b817e5318b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:15.217479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-932e6061-06fe-4df4-ab0d-1b817e5318b1 None None] MFA Rules not processed for user `7e15be3b90284c8dba6f34354be1962e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:15.219661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-932e6061-06fe-4df4-ab0d-1b817e5318b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:15.258717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:15.309728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1014/1995] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:15.320085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528dcca-5d34-4634-b2d1-78da5243047f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:15.321771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6528dcca-5d34-4634-b2d1-78da5243047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:15.330244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 982/1996] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:15.337542 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e6061-06fe-4df4-ab0d-1b817e5318b1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:15.339656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-932e6061-06fe-4df4-ab0d-1b817e5318b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:15.403723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528dcca-5d34-4634-b2d1-78da5243047f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:15.413051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde3d1d-cf94-44aa-8dbd-6ce2f85fd59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:15.413684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde3d1d-cf94-44aa-8dbd-6ce2f85fd59b service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:15.413959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde3d1d-cf94-44aa-8dbd-6ce2f85fd59b service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:15.414228 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde3d1d-cf94-44aa-8dbd-6ce2f85fd59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:15.439977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde3d1d-cf94-44aa-8dbd-6ce2f85fd59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:15.441666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde3d1d-cf94-44aa-8dbd-6ce2f85fd59b service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:15.450914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e6061-06fe-4df4-ab0d-1b817e5318b1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:15.458061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1015/1997] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:15.467832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2700a6-7a61-4bef-95c5-918553b1ddbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:15.468766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2700a6-7a61-4bef-95c5-918553b1ddbe service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:15.469102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2700a6-7a61-4bef-95c5-918553b1ddbe service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:15.469376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2700a6-7a61-4bef-95c5-918553b1ddbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:15.471446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cb2700a6-7a61-4bef-95c5-918553b1ddbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:15.485122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2700a6-7a61-4bef-95c5-918553b1ddbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:15.488371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2700a6-7a61-4bef-95c5-918553b1ddbe service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:15.499548 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 983/1998] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:15.821953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde3d1d-cf94-44aa-8dbd-6ce2f85fd59b service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:15.823646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9cde3d1d-cf94-44aa-8dbd-6ce2f85fd59b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:15.851653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde3d1d-cf94-44aa-8dbd-6ce2f85fd59b service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:15.857455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:15.858137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:15.858473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:15.858753 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] PATH_INFO: `/v3/projects/c5d1a9862d514f81b784a83ce8165b6c` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:15.859900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d1a9862d514f81b784a83ce8165b6c)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:15.861878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:15.904872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:15.921279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d1a9862d514f81b784a83ce8165b6c', 'request_id': 'req-6843e955-6fbe-47c1-81fb-66ab4a3a5688'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:15.929171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d1a9862d514f81b784a83ce8165b6c', 'request_id': 'req-6843e955-6fbe-47c1-81fb-66ab4a3a5688'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:15.939545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d1a9862d514f81b784a83ce8165b6c', 'request_id': 'req-6843e955-6fbe-47c1-81fb-66ab4a3a5688'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:15.967397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] The token cache is being invalidate because project c5d1a9862d514f81b784a83ce8165b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:15.968197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:15.969266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:15.971987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1016/1999] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:15 2022] DELETE /identity/v3/projects/c5d1a9862d514f81b784a83ce8165b6c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:15.976668 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2700a6-7a61-4bef-95c5-918553b1ddbe service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:15.997429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2700a6-7a61-4bef-95c5-918553b1ddbe service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:16.104388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:16.106457 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:16.106857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:16.107237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] PATH_INFO: `/v3/users/16a0dbb46dd84a449a2993262c97875e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:16.108923 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a0dbb46dd84a449a2993262c97875e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:16.111202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:16.210288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a0dbb46dd84a449a2993262c97875e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:16.220299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:16.223639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a0dbb46dd84a449a2993262c97875e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:16.294347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a0dbb46dd84a449a2993262c97875e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:16.295138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a0dbb46dd84a449a2993262c97875e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:16.295933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a0dbb46dd84a449a2993262c97875e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:16.321395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 984/2000] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:15 2022] DELETE /identity/v3/users/16a0dbb46dd84a449a2993262c97875e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:16.457329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:16.458906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:16.565094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843e955-6fbe-47c1-81fb-66ab4a3a5688 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:16.688789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c73f7-2866-4dec-b28f-63c280db021e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:16.690837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c73f7-2866-4dec-b28f-63c280db021e service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:16.691117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c73f7-2866-4dec-b28f-63c280db021e service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:16.694506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c73f7-2866-4dec-b28f-63c280db021e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:16.701915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-fd6c73f7-2866-4dec-b28f-63c280db021e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:16.794713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c73f7-2866-4dec-b28f-63c280db021e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:16.796408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c73f7-2866-4dec-b28f-63c280db021e service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:16.808910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1017/2001] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:17.029481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:17.033127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:17.161056 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483b850-4307-4f87-a352-4c52a9381408 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:17.167001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35770c5d-ef25-471c-9600-4e16299fbe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:17.167749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35770c5d-ef25-471c-9600-4e16299fbe0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:17.168032 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35770c5d-ef25-471c-9600-4e16299fbe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:17.168292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35770c5d-ef25-471c-9600-4e16299fbe0e admin admin] PATH_INFO: `/v3/projects/39e11b46b89b4c97846ee39f1301f8a9` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:17.169454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35770c5d-ef25-471c-9600-4e16299fbe0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e11b46b89b4c97846ee39f1301f8a9)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:17.171431 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35770c5d-ef25-471c-9600-4e16299fbe0e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:17.255903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-35770c5d-ef25-471c-9600-4e16299fbe0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e11b46b89b4c97846ee39f1301f8a9', 'request_id': 'req-35770c5d-ef25-471c-9600-4e16299fbe0e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:17.267104 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-35770c5d-ef25-471c-9600-4e16299fbe0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e11b46b89b4c97846ee39f1301f8a9', 'request_id': 'req-35770c5d-ef25-471c-9600-4e16299fbe0e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:17.274231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-35770c5d-ef25-471c-9600-4e16299fbe0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e11b46b89b4c97846ee39f1301f8a9', 'request_id': 'req-35770c5d-ef25-471c-9600-4e16299fbe0e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:17.286511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-35770c5d-ef25-471c-9600-4e16299fbe0e admin admin] The token cache is being invalidate because project 39e11b46b89b4c97846ee39f1301f8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:17.286799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-35770c5d-ef25-471c-9600-4e16299fbe0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:17.287607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-35770c5d-ef25-471c-9600-4e16299fbe0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:17.289479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 985/2002] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:17 2022] DELETE /identity/v3/projects/39e11b46b89b4c97846ee39f1301f8a9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:17.295066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1887b-37df-49ab-ab7d-03ca4d51b960 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:17.295549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1887b-37df-49ab-ab7d-03ca4d51b960 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:17.295625 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1887b-37df-49ab-ab7d-03ca4d51b960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:17.317793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-9fa1887b-37df-49ab-ab7d-03ca4d51b960 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:17.319091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9fa1887b-37df-49ab-ab7d-03ca4d51b960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:17.348381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:17.401924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1018/2003] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:17.410753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92840563-286c-4499-8c48-e9eba9d2ba0a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:17.411099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92840563-286c-4499-8c48-e9eba9d2ba0a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:17.411382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92840563-286c-4499-8c48-e9eba9d2ba0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:17.443135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-92840563-286c-4499-8c48-e9eba9d2ba0a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:17.444383 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-92840563-286c-4499-8c48-e9eba9d2ba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:17.453459 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 986/2004] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:17.458450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1887b-37df-49ab-ab7d-03ca4d51b960 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:17.468227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1887b-37df-49ab-ab7d-03ca4d51b960 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:17.473448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c04c1-1fcf-4bd8-ba86-e4758ab1d65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:17.474083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c04c1-1fcf-4bd8-ba86-e4758ab1d65e admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:17.474365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c04c1-1fcf-4bd8-ba86-e4758ab1d65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:17.474669 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c04c1-1fcf-4bd8-ba86-e4758ab1d65e admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:17.475334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c04c1-1fcf-4bd8-ba86-e4758ab1d65e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:17.475637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c04c1-1fcf-4bd8-ba86-e4758ab1d65e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:17.477314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c04c1-1fcf-4bd8-ba86-e4758ab1d65e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:17.490635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1019/2005] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:29:17.496170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92840563-286c-4499-8c48-e9eba9d2ba0a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:17.507086 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92840563-286c-4499-8c48-e9eba9d2ba0a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:17.514081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb7be-375f-47fd-b180-63f05b437a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:17.514561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb7be-375f-47fd-b180-63f05b437a21 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:17.514846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb7be-375f-47fd-b180-63f05b437a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:17.515120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb7be-375f-47fd-b180-63f05b437a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:17.515926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eb7be-375f-47fd-b180-63f05b437a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:17.518588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eb7be-375f-47fd-b180-63f05b437a21 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:17.552112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 987/2006] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:17 2022] POST /identity/v3/projects => generated 409 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:17.561145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c04c1-1fcf-4bd8-ba86-e4758ab1d65e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:17.573776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c04c1-1fcf-4bd8-ba86-e4758ab1d65e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:17.632583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554420e-5fe0-4398-aa64-80b102c0c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:17.633194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554420e-5fe0-4398-aa64-80b102c0c8fb admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:17.633469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554420e-5fe0-4398-aa64-80b102c0c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:17.633738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554420e-5fe0-4398-aa64-80b102c0c8fb admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:17.634352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554420e-5fe0-4398-aa64-80b102c0c8fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:17.636869 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554420e-5fe0-4398-aa64-80b102c0c8fb admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:17.660308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1020/2007] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:17 2022] POST /identity/v3/users => generated 305 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:17.667480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb7be-375f-47fd-b180-63f05b437a21 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:17.682309 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb7be-375f-47fd-b180-63f05b437a21 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:17.687437 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54988b80-edb5-44a0-8744-6900bf1c0167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:17.688061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54988b80-edb5-44a0-8744-6900bf1c0167 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:17.688342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54988b80-edb5-44a0-8744-6900bf1c0167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:17.688614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54988b80-edb5-44a0-8744-6900bf1c0167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:17.689253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54988b80-edb5-44a0-8744-6900bf1c0167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:17.690909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54988b80-edb5-44a0-8744-6900bf1c0167 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:17.707237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 988/2008] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:17.708378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554420e-5fe0-4398-aa64-80b102c0c8fb admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:17.719531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554420e-5fe0-4398-aa64-80b102c0c8fb admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:17.724357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9bcc2-2370-4fb7-a9a1-fdfbda245bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:17.724959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9bcc2-2370-4fb7-a9a1-fdfbda245bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:17.725236 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9bcc2-2370-4fb7-a9a1-fdfbda245bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:17.725507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9bcc2-2370-4fb7-a9a1-fdfbda245bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:17.726147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9bcc2-2370-4fb7-a9a1-fdfbda245bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:17.728008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9bcc2-2370-4fb7-a9a1-fdfbda245bdc admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:17.744006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1021/2009] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:17.744788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54988b80-edb5-44a0-8744-6900bf1c0167 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:17.755362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54988b80-edb5-44a0-8744-6900bf1c0167 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:17.782203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d517f-41b2-438c-8658-41e386565dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:17.782925 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d517f-41b2-438c-8658-41e386565dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:17.783207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d517f-41b2-438c-8658-41e386565dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:17.783479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d517f-41b2-438c-8658-41e386565dc9 admin admin] PATH_INFO: `/v3/projects/fbbfe3b37e7f469b90dd9cece510d17d/users/d27a2f7938b64301b3308fffe6987aab/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:17.801562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d517f-41b2-438c-8658-41e386565dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbfe3b37e7f469b90dd9cece510d17d, user_id=d27a2f7938b64301b3308fffe6987aab, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:17.805745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d517f-41b2-438c-8658-41e386565dc9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:17.821486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:17.834474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 989/2010] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:17 2022] PUT /identity/v3/projects/fbbfe3b37e7f469b90dd9cece510d17d/users/d27a2f7938b64301b3308fffe6987aab/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:17.841913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3755d-51ce-4b1c-9cfe-409182d68da9 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:17.842448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3755d-51ce-4b1c-9cfe-409182d68da9 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:17.842724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3755d-51ce-4b1c-9cfe-409182d68da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:17.872138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ada3755d-51ce-4b1c-9cfe-409182d68da9 None None] MFA Rules not processed for user `d27a2f7938b64301b3308fffe6987aab`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:17.873367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ada3755d-51ce-4b1c-9cfe-409182d68da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:17.952730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1022/2011] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:17 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:17.957334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d517f-41b2-438c-8658-41e386565dc9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:18.044041 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d517f-41b2-438c-8658-41e386565dc9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:18.048781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c583b-db51-4690-adff-ae053d5a4a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:18.049391 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c583b-db51-4690-adff-ae053d5a4a33 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:18.049668 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c583b-db51-4690-adff-ae053d5a4a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:18.049944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c583b-db51-4690-adff-ae053d5a4a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:18.050605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c583b-db51-4690-adff-ae053d5a4a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:18.052522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c583b-db51-4690-adff-ae053d5a4a33 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:18.085963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 990/2012] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:17 2022] POST /identity/v3/projects => generated 409 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:18.091571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3755d-51ce-4b1c-9cfe-409182d68da9 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:18.108404 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3755d-51ce-4b1c-9cfe-409182d68da9 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:18.138035 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:18.179657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb083e1-b549-4b6d-9027-9344b419f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:18.180636 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb083e1-b549-4b6d-9027-9344b419f34f admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:18.181073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb083e1-b549-4b6d-9027-9344b419f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:18.181732 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb083e1-b549-4b6d-9027-9344b419f34f admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:18.182240 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb083e1-b549-4b6d-9027-9344b419f34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:18.184353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb083e1-b549-4b6d-9027-9344b419f34f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:18.227622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1023/2013] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:18 2022] POST /identity/v3/users => generated 311 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:18.227758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c583b-db51-4690-adff-ae053d5a4a33 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:18.239914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c583b-db51-4690-adff-ae053d5a4a33 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:18.244666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e4af7-c0e2-4ea4-8e55-8b835ab84b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:18.245330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e4af7-c0e2-4ea4-8e55-8b835ab84b1f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:18.245561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e4af7-c0e2-4ea4-8e55-8b835ab84b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:18.245838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e4af7-c0e2-4ea4-8e55-8b835ab84b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:18.246520 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e4af7-c0e2-4ea4-8e55-8b835ab84b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:18.249018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e4af7-c0e2-4ea4-8e55-8b835ab84b1f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:18.265503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb083e1-b549-4b6d-9027-9344b419f34f admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:18.270644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 991/2014] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:18.277408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb083e1-b549-4b6d-9027-9344b419f34f admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:18.282698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce15d6-6ee4-4fff-8eb3-32f68f5e503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:18.283399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce15d6-6ee4-4fff-8eb3-32f68f5e503f admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:18.283676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce15d6-6ee4-4fff-8eb3-32f68f5e503f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:18.283955 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce15d6-6ee4-4fff-8eb3-32f68f5e503f admin admin] PATH_INFO: `/v3/projects/aa54aef324b54e4a923bcb29b804fde3/users/66fa30a40765423b897f338c7f200612/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:18.302278 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce15d6-6ee4-4fff-8eb3-32f68f5e503f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa54aef324b54e4a923bcb29b804fde3, user_id=66fa30a40765423b897f338c7f200612, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:18.305087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce15d6-6ee4-4fff-8eb3-32f68f5e503f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:18.323149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1024/2015] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:18 2022] PUT /identity/v3/projects/aa54aef324b54e4a923bcb29b804fde3/users/66fa30a40765423b897f338c7f200612/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:18.327889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e4af7-c0e2-4ea4-8e55-8b835ab84b1f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:18.339100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e4af7-c0e2-4ea4-8e55-8b835ab84b1f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:18.415656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223645ff-6e3b-4604-b3b5-dadd133b412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:18.416611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223645ff-6e3b-4604-b3b5-dadd133b412b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:18.416885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223645ff-6e3b-4604-b3b5-dadd133b412b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:18.417163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223645ff-6e3b-4604-b3b5-dadd133b412b admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:18.418006 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223645ff-6e3b-4604-b3b5-dadd133b412b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:18.419671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223645ff-6e3b-4604-b3b5-dadd133b412b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:18.430757 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 992/2016] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:18.438553 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce15d6-6ee4-4fff-8eb3-32f68f5e503f admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:18.445327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce15d6-6ee4-4fff-8eb3-32f68f5e503f admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:18.450651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a4fc9-2cd8-4b94-8a10-4d6cff64a265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:18.451301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a4fc9-2cd8-4b94-8a10-4d6cff64a265 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:18.451589 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a4fc9-2cd8-4b94-8a10-4d6cff64a265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:18.452092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a4fc9-2cd8-4b94-8a10-4d6cff64a265 admin admin] PATH_INFO: `/v3/projects/aa54aef324b54e4a923bcb29b804fde3/users/66fa30a40765423b897f338c7f200612/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:18.453953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a4fc9-2cd8-4b94-8a10-4d6cff64a265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa54aef324b54e4a923bcb29b804fde3, user_id=66fa30a40765423b897f338c7f200612, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:18.456597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a4fc9-2cd8-4b94-8a10-4d6cff64a265 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:18.468238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1025/2017] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:18 2022] PUT /identity/v3/projects/aa54aef324b54e4a923bcb29b804fde3/users/66fa30a40765423b897f338c7f200612/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:18.479849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9be5c-ebcd-4eb6-b645-b04b258f9ff0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:18.480188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9be5c-ebcd-4eb6-b645-b04b258f9ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:18.480474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9be5c-ebcd-4eb6-b645-b04b258f9ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:18.510518 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-12e9be5c-ebcd-4eb6-b645-b04b258f9ff0 None None] MFA Rules not processed for user `66fa30a40765423b897f338c7f200612`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:18.511785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-12e9be5c-ebcd-4eb6-b645-b04b258f9ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:18.577563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:18.593665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 993/2018] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:18 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:18.605488 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a4fc9-2cd8-4b94-8a10-4d6cff64a265 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:18.607855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-820a4fc9-2cd8-4b94-8a10-4d6cff64a265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:18.688719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a4fc9-2cd8-4b94-8a10-4d6cff64a265 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:18.692737 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988b7aa-d683-4207-bda6-bf5f322c4732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:18.693343 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988b7aa-d683-4207-bda6-bf5f322c4732 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:18.693622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988b7aa-d683-4207-bda6-bf5f322c4732 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:18.693896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988b7aa-d683-4207-bda6-bf5f322c4732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:18.705565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988b7aa-d683-4207-bda6-bf5f322c4732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:18.707044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988b7aa-d683-4207-bda6-bf5f322c4732 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:18.718487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1026/2019] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:18 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:18.904515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9be5c-ebcd-4eb6-b645-b04b258f9ff0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:18.906164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-12e9be5c-ebcd-4eb6-b645-b04b258f9ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:18.919053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9be5c-ebcd-4eb6-b645-b04b258f9ff0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:18.923008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d437c3c-8365-4663-bfe2-e82d4cc099a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:18.923618 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d437c3c-8365-4663-bfe2-e82d4cc099a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:18.923904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d437c3c-8365-4663-bfe2-e82d4cc099a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:18.924179 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d437c3c-8365-4663-bfe2-e82d4cc099a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:18.992326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d437c3c-8365-4663-bfe2-e82d4cc099a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:18.994739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d437c3c-8365-4663-bfe2-e82d4cc099a8 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:19.005399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 994/2020] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:18 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:22.149669 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988b7aa-d683-4207-bda6-bf5f322c4732 service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:22.151695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c988b7aa-d683-4207-bda6-bf5f322c4732 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:22.410351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988b7aa-d683-4207-bda6-bf5f322c4732 service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:22.424171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:22.425269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:22.425803 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:22.426241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] PATH_INFO: `/v3/users/b891891c7e2b4d14a8c38c59330629a8` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:22.439358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b891891c7e2b4d14a8c38c59330629a8)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:22.446093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:22.488423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:22.542791 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b891891c7e2b4d14a8c38c59330629a8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:22.551387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b891891c7e2b4d14a8c38c59330629a8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:22.592596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b891891c7e2b4d14a8c38c59330629a8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:22.594488 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b891891c7e2b4d14a8c38c59330629a8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:22.596890 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b891891c7e2b4d14a8c38c59330629a8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:22.623923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1027/2021] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:22 2022] DELETE /identity/v3/users/b891891c7e2b4d14a8c38c59330629a8 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:22.628872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fafda6-02dd-4347-ac20-8423b3a6a8cc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:22.628872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fafda6-02dd-4347-ac20-8423b3a6a8cc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:22.629329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fafda6-02dd-4347-ac20-8423b3a6a8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:22.663488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-07fafda6-02dd-4347-ac20-8423b3a6a8cc None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:22.664729 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-07fafda6-02dd-4347-ac20-8423b3a6a8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:22.799576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 995/2022] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:22.807556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:22.809530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:22.883697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba87a45-ef15-4490-8110-f5d9028dc446 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:22.890013 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213c18b-faa7-49a4-ada5-99202ce6f665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:22.890678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213c18b-faa7-49a4-ada5-99202ce6f665 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:22.891594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213c18b-faa7-49a4-ada5-99202ce6f665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:22.891594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213c18b-faa7-49a4-ada5-99202ce6f665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:22.901860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213c18b-faa7-49a4-ada5-99202ce6f665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:22.903331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213c18b-faa7-49a4-ada5-99202ce6f665 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:22.914501 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1028/2023] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:23.389023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fafda6-02dd-4347-ac20-8423b3a6a8cc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:23.390671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-07fafda6-02dd-4347-ac20-8423b3a6a8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:23.408388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fafda6-02dd-4347-ac20-8423b3a6a8cc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:23.424065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:23.425030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:23.425574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:23.426061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] PATH_INFO: `/v3/projects/ad9811ef18984f44b37a91e7e986f7d1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:23.427816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9811ef18984f44b37a91e7e986f7d1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:23.429953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:23.529214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9811ef18984f44b37a91e7e986f7d1', 'request_id': 'req-41fd70be-f6ce-4441-b564-9feb587aee3e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:23.539597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9811ef18984f44b37a91e7e986f7d1', 'request_id': 'req-41fd70be-f6ce-4441-b564-9feb587aee3e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:23.548542 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9811ef18984f44b37a91e7e986f7d1', 'request_id': 'req-41fd70be-f6ce-4441-b564-9feb587aee3e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:23.568216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] The token cache is being invalidate because project ad9811ef18984f44b37a91e7e986f7d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:23.568504 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:23.569218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:23.571199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 996/2024] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:23 2022] DELETE /identity/v3/projects/ad9811ef18984f44b37a91e7e986f7d1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:23.575864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213c18b-faa7-49a4-ada5-99202ce6f665 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:23.598573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213c18b-faa7-49a4-ada5-99202ce6f665 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:23.747562 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb937d-41a2-4c8b-954f-75ae8af6aa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:23.748400 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb937d-41a2-4c8b-954f-75ae8af6aa7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:23.748881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb937d-41a2-4c8b-954f-75ae8af6aa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:23.749445 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb937d-41a2-4c8b-954f-75ae8af6aa7e admin admin] PATH_INFO: `/v3/users/252e56ea023e4a7c89256943712e2cef` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:23.752243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb937d-41a2-4c8b-954f-75ae8af6aa7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=252e56ea023e4a7c89256943712e2cef)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:23.754263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb937d-41a2-4c8b-954f-75ae8af6aa7e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:23.815265 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:23.821315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-eceb937d-41a2-4c8b-954f-75ae8af6aa7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252e56ea023e4a7c89256943712e2cef'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:23.834600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-eceb937d-41a2-4c8b-954f-75ae8af6aa7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252e56ea023e4a7c89256943712e2cef'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:23.853071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-eceb937d-41a2-4c8b-954f-75ae8af6aa7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252e56ea023e4a7c89256943712e2cef'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:23.855065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-eceb937d-41a2-4c8b-954f-75ae8af6aa7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252e56ea023e4a7c89256943712e2cef'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:23.855738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-eceb937d-41a2-4c8b-954f-75ae8af6aa7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252e56ea023e4a7c89256943712e2cef'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:23.886632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1029/2025] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:23 2022] DELETE /identity/v3/users/252e56ea023e4a7c89256943712e2cef => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:24.413120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:24.414817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:24.436797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd70be-f6ce-4441-b564-9feb587aee3e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:24.488779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:24.553224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:24.553877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:24.554225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:24.554487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac admin admin] PATH_INFO: `/v3/projects/556f82009fb6401f997ee29493439d4d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:24.555634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=556f82009fb6401f997ee29493439d4d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:24.557608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:24.614038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556f82009fb6401f997ee29493439d4d', 'request_id': 'req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:24.624303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556f82009fb6401f997ee29493439d4d', 'request_id': 'req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:24.631655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556f82009fb6401f997ee29493439d4d', 'request_id': 'req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:24.645729 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac admin admin] The token cache is being invalidate because project 556f82009fb6401f997ee29493439d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:24.646226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:24.646950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-92eff0d5-1e80-4a9e-a44d-ac6bca1a3dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:24.654486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 997/2026] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:24 2022] DELETE /identity/v3/projects/556f82009fb6401f997ee29493439d4d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:24.656270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d0c0-5c54-4d7b-9ee4-86f921ff6a31 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:24.656783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d0c0-5c54-4d7b-9ee4-86f921ff6a31 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:24.656875 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d0c0-5c54-4d7b-9ee4-86f921ff6a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:24.683483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-3770d0c0-5c54-4d7b-9ee4-86f921ff6a31 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:24.684809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3770d0c0-5c54-4d7b-9ee4-86f921ff6a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:24.755978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40158460-549f-462e-ad5b-f143af95a340 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:24.756269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40158460-549f-462e-ad5b-f143af95a340 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:24.756567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40158460-549f-462e-ad5b-f143af95a340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:24.759316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1030/2027] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:24.793108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-40158460-549f-462e-ad5b-f143af95a340 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:24.794494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-40158460-549f-462e-ad5b-f143af95a340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:24.812666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770d0c0-5c54-4d7b-9ee4-86f921ff6a31 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:24.819199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 998/2028] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:24.825029 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770d0c0-5c54-4d7b-9ee4-86f921ff6a31 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:24.831148 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb77a7-2705-44f5-87a0-8e41a5769936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:24.832117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb77a7-2705-44f5-87a0-8e41a5769936 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:24.832475 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb77a7-2705-44f5-87a0-8e41a5769936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:24.832816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb77a7-2705-44f5-87a0-8e41a5769936 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:24.833688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb77a7-2705-44f5-87a0-8e41a5769936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:24.834068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb77a7-2705-44f5-87a0-8e41a5769936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:24.836029 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb77a7-2705-44f5-87a0-8e41a5769936 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:24.859069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1031/2029] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:29:24.863498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40158460-549f-462e-ad5b-f143af95a340 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:24.876032 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40158460-549f-462e-ad5b-f143af95a340 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:24.884413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7627063-5248-4ac7-9440-f58eedd5ce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:24.886203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7627063-5248-4ac7-9440-f58eedd5ce94 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:24.886751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7627063-5248-4ac7-9440-f58eedd5ce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:24.887262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7627063-5248-4ac7-9440-f58eedd5ce94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:24.889610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7627063-5248-4ac7-9440-f58eedd5ce94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:24.893497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7627063-5248-4ac7-9440-f58eedd5ce94 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:24.939840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 999/2030] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:24 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:24.944742 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb77a7-2705-44f5-87a0-8e41a5769936 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:24.972301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb77a7-2705-44f5-87a0-8e41a5769936 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:25.006810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7627063-5248-4ac7-9440-f58eedd5ce94 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:25.008775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f7627063-5248-4ac7-9440-f58eedd5ce94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:25.076419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50809fde-3609-4368-97cd-993e456fa275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:25.077350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50809fde-3609-4368-97cd-993e456fa275 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:25.077866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50809fde-3609-4368-97cd-993e456fa275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:25.078153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50809fde-3609-4368-97cd-993e456fa275 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:25.078887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50809fde-3609-4368-97cd-993e456fa275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:25.081505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50809fde-3609-4368-97cd-993e456fa275 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:25.089851 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7627063-5248-4ac7-9440-f58eedd5ce94 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:25.095656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3f28-a5f0-470e-b2a6-35704d16dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:25.096430 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3f28-a5f0-470e-b2a6-35704d16dbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:25.096896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3f28-a5f0-470e-b2a6-35704d16dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:25.097298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3f28-a5f0-470e-b2a6-35704d16dbba admin admin] PATH_INFO: `/v3/users/d27a2f7938b64301b3308fffe6987aab` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:25.099725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d3f28-a5f0-470e-b2a6-35704d16dbba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27a2f7938b64301b3308fffe6987aab)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:25.103818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d3f28-a5f0-470e-b2a6-35704d16dbba admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:25.110019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1032/2031] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:24 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:25.114465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50809fde-3609-4368-97cd-993e456fa275 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:25.126666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50809fde-3609-4368-97cd-993e456fa275 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:25.131731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff23bbd-125d-45fb-b693-aefb6778df95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:25.132411 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff23bbd-125d-45fb-b693-aefb6778df95 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:25.132764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff23bbd-125d-45fb-b693-aefb6778df95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:25.132867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:25.133164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff23bbd-125d-45fb-b693-aefb6778df95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:25.133886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff23bbd-125d-45fb-b693-aefb6778df95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:25.136766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff23bbd-125d-45fb-b693-aefb6778df95 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:25.150633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1033/2032] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:25.156394 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff23bbd-125d-45fb-b693-aefb6778df95 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:25.168185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff23bbd-125d-45fb-b693-aefb6778df95 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:25.172254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b95d3f28-a5f0-470e-b2a6-35704d16dbba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27a2f7938b64301b3308fffe6987aab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:25.173350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc44424-1511-4728-a7f2-ae2ac5650bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:25.173964 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc44424-1511-4728-a7f2-ae2ac5650bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:25.174248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc44424-1511-4728-a7f2-ae2ac5650bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:25.174828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc44424-1511-4728-a7f2-ae2ac5650bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:25.175192 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc44424-1511-4728-a7f2-ae2ac5650bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:25.176799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc44424-1511-4728-a7f2-ae2ac5650bb9 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:25.181527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b95d3f28-a5f0-470e-b2a6-35704d16dbba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27a2f7938b64301b3308fffe6987aab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:25.188552 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1034/2033] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:25.192725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc44424-1511-4728-a7f2-ae2ac5650bb9 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:25.197373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b95d3f28-a5f0-470e-b2a6-35704d16dbba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27a2f7938b64301b3308fffe6987aab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:25.198437 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b95d3f28-a5f0-470e-b2a6-35704d16dbba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27a2f7938b64301b3308fffe6987aab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:25.199075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b95d3f28-a5f0-470e-b2a6-35704d16dbba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27a2f7938b64301b3308fffe6987aab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:25.203497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc44424-1511-4728-a7f2-ae2ac5650bb9 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:25.209665 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283e63d-d4d3-4689-b460-bc923c54466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:25.210573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283e63d-d4d3-4689-b460-bc923c54466a admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:25.210987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283e63d-d4d3-4689-b460-bc923c54466a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:25.211334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283e63d-d4d3-4689-b460-bc923c54466a admin admin] PATH_INFO: `/v3/projects/2e369a49592746d0a07862d126c1f233/users/da5555c0af1043b8896c3f80a25ca9a1/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:25.245340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1000/2034] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:25 2022] DELETE /identity/v3/users/d27a2f7938b64301b3308fffe6987aab => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:25.250349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abaebe-acfd-4b8f-8718-83678dc245b7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:25.250756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abaebe-acfd-4b8f-8718-83678dc245b7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:25.251035 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abaebe-acfd-4b8f-8718-83678dc245b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:25.253430 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:25.261586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283e63d-d4d3-4689-b460-bc923c54466a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e369a49592746d0a07862d126c1f233, user_id=da5555c0af1043b8896c3f80a25ca9a1, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:25.266993 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283e63d-d4d3-4689-b460-bc923c54466a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:25.297401 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1035/2035] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:25 2022] PUT /identity/v3/projects/2e369a49592746d0a07862d126c1f233/users/da5555c0af1043b8896c3f80a25ca9a1/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:25.304390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-99abaebe-acfd-4b8f-8718-83678dc245b7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:25.305606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-99abaebe-acfd-4b8f-8718-83678dc245b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:25.312387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed0dee-3e88-4f46-b24c-37767e18e087 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:25.312915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed0dee-3e88-4f46-b24c-37767e18e087 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:25.313568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed0dee-3e88-4f46-b24c-37767e18e087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:25.370496 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-35ed0dee-3e88-4f46-b24c-37767e18e087 None None] MFA Rules not processed for user `da5555c0af1043b8896c3f80a25ca9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:25.371953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-35ed0dee-3e88-4f46-b24c-37767e18e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:25.414425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1001/2036] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:25.422446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abaebe-acfd-4b8f-8718-83678dc245b7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:25.424160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-99abaebe-acfd-4b8f-8718-83678dc245b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:25.490542 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1036/2037] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:25.505204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed0dee-3e88-4f46-b24c-37767e18e087 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:25.507534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-35ed0dee-3e88-4f46-b24c-37767e18e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:25.521418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abaebe-acfd-4b8f-8718-83678dc245b7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:25.527895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf192df-c060-430e-83c5-c2444677fd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:25.528814 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf192df-c060-430e-83c5-c2444677fd9a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:25.529169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf192df-c060-430e-83c5-c2444677fd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:25.529520 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf192df-c060-430e-83c5-c2444677fd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:25.542492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf192df-c060-430e-83c5-c2444677fd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:25.544124 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf192df-c060-430e-83c5-c2444677fd9a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:25.558214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1002/2038] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:25.582141 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed0dee-3e88-4f46-b24c-37767e18e087 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:25.586225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c0366-34da-48f9-b59e-80fdf22eff65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:25.586951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c0366-34da-48f9-b59e-80fdf22eff65 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:25.587358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c0366-34da-48f9-b59e-80fdf22eff65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:25.588780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c0366-34da-48f9-b59e-80fdf22eff65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:25.599019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c0366-34da-48f9-b59e-80fdf22eff65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:25.600871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c0366-34da-48f9-b59e-80fdf22eff65 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:25.619249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1037/2039] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:25.639109 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf192df-c060-430e-83c5-c2444677fd9a service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:25.640552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6cf192df-c060-430e-83c5-c2444677fd9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:25.654062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf192df-c060-430e-83c5-c2444677fd9a service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:25.659253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:25.659774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:25.660125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:25.660410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] PATH_INFO: `/v3/users/da5555c0af1043b8896c3f80a25ca9a1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:25.661571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da5555c0af1043b8896c3f80a25ca9a1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:25.663648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:25.718410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:25.758303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da5555c0af1043b8896c3f80a25ca9a1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:25.775070 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da5555c0af1043b8896c3f80a25ca9a1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:25.808549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da5555c0af1043b8896c3f80a25ca9a1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:25.811229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da5555c0af1043b8896c3f80a25ca9a1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:25.813528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da5555c0af1043b8896c3f80a25ca9a1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:25.849309 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1003/2040] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:25 2022] DELETE /identity/v3/users/da5555c0af1043b8896c3f80a25ca9a1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:25.859376 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0bfa0-1e7f-44eb-a8e1-a7110eb6d151 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:25.859917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0bfa0-1e7f-44eb-a8e1-a7110eb6d151 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:25.859917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0bfa0-1e7f-44eb-a8e1-a7110eb6d151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:25.899498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-42c0bfa0-1e7f-44eb-a8e1-a7110eb6d151 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:25.901460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-42c0bfa0-1e7f-44eb-a8e1-a7110eb6d151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:25.936175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:25.938429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:26.048280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1038/2041] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:26.060677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0bfa0-1e7f-44eb-a8e1-a7110eb6d151 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:26.062874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-42c0bfa0-1e7f-44eb-a8e1-a7110eb6d151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:26.082096 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ee51a-50a6-40f2-8d53-531b582debf0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:26.087746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:26.088495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:26.089397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:26.089741 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] PATH_INFO: `/v3/projects/fbbfe3b37e7f469b90dd9cece510d17d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:26.091297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbbfe3b37e7f469b90dd9cece510d17d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:26.093310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:26.118756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:26.165210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0bfa0-1e7f-44eb-a8e1-a7110eb6d151 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:26.177890 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbbfe3b37e7f469b90dd9cece510d17d', 'request_id': 'req-94a00521-037a-4479-96fe-04108f04eb6a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:26.186523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbbfe3b37e7f469b90dd9cece510d17d', 'request_id': 'req-94a00521-037a-4479-96fe-04108f04eb6a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:26.193380 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbbfe3b37e7f469b90dd9cece510d17d', 'request_id': 'req-94a00521-037a-4479-96fe-04108f04eb6a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:26.213399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] The token cache is being invalidate because project fbbfe3b37e7f469b90dd9cece510d17d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:26.214059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:26.214939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:26.217597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1004/2042] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:25 2022] DELETE /identity/v3/projects/fbbfe3b37e7f469b90dd9cece510d17d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:26.221115 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:26.224886 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:26.262479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43352186-869b-49a7-b652-85d7d4e17480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:26.263096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352186-869b-49a7-b652-85d7d4e17480 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:26.263380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352186-869b-49a7-b652-85d7d4e17480 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:26.263649 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352186-869b-49a7-b652-85d7d4e17480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:26.265472 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-43352186-869b-49a7-b652-85d7d4e17480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:26.286123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:26.314601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a00521-037a-4479-96fe-04108f04eb6a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:26.321716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:26.322615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:26.323015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:26.323466 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] PATH_INFO: `/v3/users/66fa30a40765423b897f338c7f200612` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:26.324949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66fa30a40765423b897f338c7f200612)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:26.327104 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:26.365797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43352186-869b-49a7-b652-85d7d4e17480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:26.367690 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43352186-869b-49a7-b652-85d7d4e17480 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:26.402293 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1039/2043] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:26.421465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66fa30a40765423b897f338c7f200612'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:26.449238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66fa30a40765423b897f338c7f200612'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:26.474998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66fa30a40765423b897f338c7f200612'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:26.476330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66fa30a40765423b897f338c7f200612'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:26.477182 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66fa30a40765423b897f338c7f200612'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:26.519111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1005/2044] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:26 2022] DELETE /identity/v3/users/66fa30a40765423b897f338c7f200612 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:26.977820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43352186-869b-49a7-b652-85d7d4e17480 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:26.997095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43352186-869b-49a7-b652-85d7d4e17480 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:27.069474 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be75200-fb1c-4590-925f-e0b9917db058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:27.070229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be75200-fb1c-4590-925f-e0b9917db058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.070556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be75200-fb1c-4590-925f-e0b9917db058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.070827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be75200-fb1c-4590-925f-e0b9917db058 admin admin] PATH_INFO: `/v3/projects/aa54aef324b54e4a923bcb29b804fde3` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.072028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be75200-fb1c-4590-925f-e0b9917db058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa54aef324b54e4a923bcb29b804fde3)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:27.074879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be75200-fb1c-4590-925f-e0b9917db058 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:27.122186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:27.138416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:27.139875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:27.140917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9be75200-fb1c-4590-925f-e0b9917db058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa54aef324b54e4a923bcb29b804fde3', 'request_id': 'req-9be75200-fb1c-4590-925f-e0b9917db058'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:27.152241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9be75200-fb1c-4590-925f-e0b9917db058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa54aef324b54e4a923bcb29b804fde3', 'request_id': 'req-9be75200-fb1c-4590-925f-e0b9917db058'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:27.157620 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef246219-bca2-445c-baa3-ca1fbcaee699 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:27.158498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9be75200-fb1c-4590-925f-e0b9917db058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa54aef324b54e4a923bcb29b804fde3', 'request_id': 'req-9be75200-fb1c-4590-925f-e0b9917db058'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:27.175057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9be75200-fb1c-4590-925f-e0b9917db058 admin admin] The token cache is being invalidate because project aa54aef324b54e4a923bcb29b804fde3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:27.175351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9be75200-fb1c-4590-925f-e0b9917db058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:27.176090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9be75200-fb1c-4590-925f-e0b9917db058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:27.177593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1040/2045] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:26 2022] DELETE /identity/v3/projects/aa54aef324b54e4a923bcb29b804fde3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:27.183319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04275b-1f79-4c00-920f-24f29c693fd4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.183664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04275b-1f79-4c00-920f-24f29c693fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.184008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04275b-1f79-4c00-920f-24f29c693fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.206783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-eb04275b-1f79-4c00-920f-24f29c693fd4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:27.208646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-eb04275b-1f79-4c00-920f-24f29c693fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:27.250417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:27.250417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.250417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.250780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f admin admin] PATH_INFO: `/v3/projects/2e369a49592746d0a07862d126c1f233` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.252273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e369a49592746d0a07862d126c1f233)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:27.269843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:27.342073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1041/2046] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:27.347982 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a79d-9c89-41e6-8599-9fe58cea2115 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.350738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a79d-9c89-41e6-8599-9fe58cea2115 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.351268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a79d-9c89-41e6-8599-9fe58cea2115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.379178 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e369a49592746d0a07862d126c1f233', 'request_id': 'req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:27.382596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ed32a79d-9c89-41e6-8599-9fe58cea2115 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:27.386280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ed32a79d-9c89-41e6-8599-9fe58cea2115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:27.393558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e369a49592746d0a07862d126c1f233', 'request_id': 'req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:27.402432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e369a49592746d0a07862d126c1f233', 'request_id': 'req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:27.404973 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:27.429813 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f admin admin] The token cache is being invalidate because project 2e369a49592746d0a07862d126c1f233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:27.430369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:27.430934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-eb12a0c2-b7a0-45a4-9a7d-88382d0dc90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:27.432801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1006/2047] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:27 2022] DELETE /identity/v3/projects/2e369a49592746d0a07862d126c1f233 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:27.438909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba981f9-2103-4ba4-ba04-0e3ae6481a57 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.439268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba981f9-2103-4ba4-ba04-0e3ae6481a57 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.439626 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba981f9-2103-4ba4-ba04-0e3ae6481a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.460442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0ba981f9-2103-4ba4-ba04-0e3ae6481a57 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:27.461867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0ba981f9-2103-4ba4-ba04-0e3ae6481a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:27.486644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1042/2048] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:27.490745 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a79d-9c89-41e6-8599-9fe58cea2115 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:27.511364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a79d-9c89-41e6-8599-9fe58cea2115 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:27.527093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131f305-c56a-4fee-bcc7-35d36633b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:27.529921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131f305-c56a-4fee-bcc7-35d36633b82b admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.531243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131f305-c56a-4fee-bcc7-35d36633b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.532154 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131f305-c56a-4fee-bcc7-35d36633b82b admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.533269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131f305-c56a-4fee-bcc7-35d36633b82b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:27.534446 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131f305-c56a-4fee-bcc7-35d36633b82b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:27.542502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131f305-c56a-4fee-bcc7-35d36633b82b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:27.561682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1043/2049] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:29:27.566755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131f305-c56a-4fee-bcc7-35d36633b82b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:27.585968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131f305-c56a-4fee-bcc7-35d36633b82b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:27.593375 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7efbf-3db5-4572-ad38-f9afb690486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:27.594198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7efbf-3db5-4572-ad38-f9afb690486f admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.594801 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7efbf-3db5-4572-ad38-f9afb690486f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.595321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7efbf-3db5-4572-ad38-f9afb690486f admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.596177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7efbf-3db5-4572-ad38-f9afb690486f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:27.602095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7efbf-3db5-4572-ad38-f9afb690486f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:27.638458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1007/2050] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:27.646536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ff53d-2c9a-431d-b694-5d7c302643bc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.646959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ff53d-2c9a-431d-b694-5d7c302643bc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.647332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ff53d-2c9a-431d-b694-5d7c302643bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.664409 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1044/2051] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:27 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:27.668504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7efbf-3db5-4572-ad38-f9afb690486f admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:27.675340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b10ff53d-2c9a-431d-b694-5d7c302643bc None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:27.676832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b10ff53d-2c9a-431d-b694-5d7c302643bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:27.706373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:27.746942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1008/2052] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:27.751254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ff53d-2c9a-431d-b694-5d7c302643bc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:27.761094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7efbf-3db5-4572-ad38-f9afb690486f admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:27.762029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ff53d-2c9a-431d-b694-5d7c302643bc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:27.767792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1222563-f615-4b6a-a4a4-5ee00e2a4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:27.768313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ee1ff-4230-4369-8b77-38a8598e6bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:27.768480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1222563-f615-4b6a-a4a4-5ee00e2a4969 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.768875 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1222563-f615-4b6a-a4a4-5ee00e2a4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.768985 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ee1ff-4230-4369-8b77-38a8598e6bec admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.769200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ee1ff-4230-4369-8b77-38a8598e6bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.769295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1222563-f615-4b6a-a4a4-5ee00e2a4969 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.769465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ee1ff-4230-4369-8b77-38a8598e6bec admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.769972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1222563-f615-4b6a-a4a4-5ee00e2a4969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:27.770790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ee1ff-4230-4369-8b77-38a8598e6bec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:27.771097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ee1ff-4230-4369-8b77-38a8598e6bec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:27.772301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1222563-f615-4b6a-a4a4-5ee00e2a4969 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:27.772694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ee1ff-4230-4369-8b77-38a8598e6bec admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:27.786485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1009/2053] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:29:27.794531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ee1ff-4230-4369-8b77-38a8598e6bec admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:27.803659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1045/2054] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:27 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:29:27.808021 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1222563-f615-4b6a-a4a4-5ee00e2a4969 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:27.810121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ee1ff-4230-4369-8b77-38a8598e6bec admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:27.815132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893918-2fd1-45ef-953b-192e14a0c3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:27.816061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893918-2fd1-45ef-953b-192e14a0c3ed admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.816061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893918-2fd1-45ef-953b-192e14a0c3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.816317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893918-2fd1-45ef-953b-192e14a0c3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.816925 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21893918-2fd1-45ef-953b-192e14a0c3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:27.819627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21893918-2fd1-45ef-953b-192e14a0c3ed admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:27.822650 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1222563-f615-4b6a-a4a4-5ee00e2a4969 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:27.827810 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc523ea1-5469-44fb-a29f-ebdb2018e71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:27.828490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc523ea1-5469-44fb-a29f-ebdb2018e71a admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.828833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc523ea1-5469-44fb-a29f-ebdb2018e71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.829195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc523ea1-5469-44fb-a29f-ebdb2018e71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.829893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc523ea1-5469-44fb-a29f-ebdb2018e71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:27.831747 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc523ea1-5469-44fb-a29f-ebdb2018e71a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:27.849611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1046/2055] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:27.853157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc523ea1-5469-44fb-a29f-ebdb2018e71a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:27.862213 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1010/2056] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:27 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:29:27.863672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893918-2fd1-45ef-953b-192e14a0c3ed admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:27.867388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc523ea1-5469-44fb-a29f-ebdb2018e71a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:27.956793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:27.959277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adecf0-59cd-44b7-992a-83ac5b86bab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:27.959960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adecf0-59cd-44b7-992a-83ac5b86bab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.960326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adecf0-59cd-44b7-992a-83ac5b86bab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.960675 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adecf0-59cd-44b7-992a-83ac5b86bab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.961517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adecf0-59cd-44b7-992a-83ac5b86bab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:27.961614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893918-2fd1-45ef-953b-192e14a0c3ed admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:27.963666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adecf0-59cd-44b7-992a-83ac5b86bab6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:27.968411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec793c17-39e7-47f9-b4b5-3db1bddfb4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:27.969173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec793c17-39e7-47f9-b4b5-3db1bddfb4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:27.969613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec793c17-39e7-47f9-b4b5-3db1bddfb4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:27.970312 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec793c17-39e7-47f9-b4b5-3db1bddfb4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:27.971396 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec793c17-39e7-47f9-b4b5-3db1bddfb4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:27.974428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec793c17-39e7-47f9-b4b5-3db1bddfb4e4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:27.990703 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1047/2057] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:27.995799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adecf0-59cd-44b7-992a-83ac5b86bab6 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.002973 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1011/2058] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:27 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:28.006907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec793c17-39e7-47f9-b4b5-3db1bddfb4e4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.013220 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adecf0-59cd-44b7-992a-83ac5b86bab6 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.018635 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec793c17-39e7-47f9-b4b5-3db1bddfb4e4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.019052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20a259-1658-4a8e-963a-bb4235164c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.019926 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20a259-1658-4a8e-963a-bb4235164c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.022414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20a259-1658-4a8e-963a-bb4235164c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.022414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20a259-1658-4a8e-963a-bb4235164c59 admin admin] PATH_INFO: `/v3/projects/79e9cb956c1641daa5b05117600d1628/users/cd3fa75f45f14c2fb13948762aabf82a/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.030809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df359e98-cf39-41ea-8e7f-4e07478c856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.031443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df359e98-cf39-41ea-8e7f-4e07478c856e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.031742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df359e98-cf39-41ea-8e7f-4e07478c856e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.032019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df359e98-cf39-41ea-8e7f-4e07478c856e admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.032672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df359e98-cf39-41ea-8e7f-4e07478c856e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.034318 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df359e98-cf39-41ea-8e7f-4e07478c856e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.037138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20a259-1658-4a8e-963a-bb4235164c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e9cb956c1641daa5b05117600d1628, user_id=cd3fa75f45f14c2fb13948762aabf82a, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.039845 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20a259-1658-4a8e-963a-bb4235164c59 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.045133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1012/2059] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:28.049393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df359e98-cf39-41ea-8e7f-4e07478c856e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.054111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1048/2060] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:27 2022] PUT /identity/v3/projects/79e9cb956c1641daa5b05117600d1628/users/cd3fa75f45f14c2fb13948762aabf82a/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:28.065426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67199bf1-a615-4e4c-bb23-70775653b16a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.065708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67199bf1-a615-4e4c-bb23-70775653b16a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.065984 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67199bf1-a615-4e4c-bb23-70775653b16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.066870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df359e98-cf39-41ea-8e7f-4e07478c856e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.097322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-67199bf1-a615-4e4c-bb23-70775653b16a None None] MFA Rules not processed for user `cd3fa75f45f14c2fb13948762aabf82a`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:28.098842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-67199bf1-a615-4e4c-bb23-70775653b16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:28.130364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86b46d-3bb5-4687-bcdd-d45d44fe1795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.130999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86b46d-3bb5-4687-bcdd-d45d44fe1795 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.131279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86b46d-3bb5-4687-bcdd-d45d44fe1795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.131546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86b46d-3bb5-4687-bcdd-d45d44fe1795 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.132211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86b46d-3bb5-4687-bcdd-d45d44fe1795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.133847 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86b46d-3bb5-4687-bcdd-d45d44fe1795 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.144503 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1013/2061] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:28.148672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86b46d-3bb5-4687-bcdd-d45d44fe1795 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.158507 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86b46d-3bb5-4687-bcdd-d45d44fe1795 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.163326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d5317-733d-4012-b7a2-7f3de8f93ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.163974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d5317-733d-4012-b7a2-7f3de8f93ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.164252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d5317-733d-4012-b7a2-7f3de8f93ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.164529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d5317-733d-4012-b7a2-7f3de8f93ad9 admin admin] PATH_INFO: `/v3/projects/9322fa22d73d4d3aa3ab7f75e97791c2/users/282ed5ad0a394c35833f6125740a8b94/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.168075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1049/2062] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:28.172912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67199bf1-a615-4e4c-bb23-70775653b16a None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.179199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:28.181006 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d5317-733d-4012-b7a2-7f3de8f93ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9322fa22d73d4d3aa3ab7f75e97791c2, user_id=282ed5ad0a394c35833f6125740a8b94, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.183662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67199bf1-a615-4e4c-bb23-70775653b16a None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.183984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d5317-733d-4012-b7a2-7f3de8f93ad9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.189466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9d38c-3533-4b58-bd0c-5a4860b09020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.190078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9d38c-3533-4b58-bd0c-5a4860b09020 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.190413 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9d38c-3533-4b58-bd0c-5a4860b09020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.190642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9d38c-3533-4b58-bd0c-5a4860b09020 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.191272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9d38c-3533-4b58-bd0c-5a4860b09020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.193122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9d38c-3533-4b58-bd0c-5a4860b09020 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.197736 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1014/2063] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:28 2022] PUT /identity/v3/projects/9322fa22d73d4d3aa3ab7f75e97791c2/users/282ed5ad0a394c35833f6125740a8b94/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:28.208075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525e705-77ce-4ddd-a907-2ad70a93a65c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.208409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525e705-77ce-4ddd-a907-2ad70a93a65c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.208669 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525e705-77ce-4ddd-a907-2ad70a93a65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.227768 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1050/2064] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:28 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:29:28.229213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9d38c-3533-4b58-bd0c-5a4860b09020 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.239213 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a525e705-77ce-4ddd-a907-2ad70a93a65c None None] MFA Rules not processed for user `282ed5ad0a394c35833f6125740a8b94`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:28.240501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a525e705-77ce-4ddd-a907-2ad70a93a65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:28.294504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9d38c-3533-4b58-bd0c-5a4860b09020 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.299052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbf7a4-f158-40d6-bbd8-7daa1834c4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.299659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbf7a4-f158-40d6-bbd8-7daa1834c4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.299941 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbf7a4-f158-40d6-bbd8-7daa1834c4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.300213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbf7a4-f158-40d6-bbd8-7daa1834c4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.300844 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbf7a4-f158-40d6-bbd8-7daa1834c4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.302776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbf7a4-f158-40d6-bbd8-7daa1834c4e0 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.308059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1015/2065] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:28.312699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525e705-77ce-4ddd-a907-2ad70a93a65c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.325016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525e705-77ce-4ddd-a907-2ad70a93a65c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.330136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1051/2066] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:28 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:29:28.330408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf05a7-8494-45d5-8554-64ba7f484c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.331047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf05a7-8494-45d5-8554-64ba7f484c3e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.331331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf05a7-8494-45d5-8554-64ba7f484c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.331606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf05a7-8494-45d5-8554-64ba7f484c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.332059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbf7a4-f158-40d6-bbd8-7daa1834c4e0 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.332248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf05a7-8494-45d5-8554-64ba7f484c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.334318 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf05a7-8494-45d5-8554-64ba7f484c3e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.343719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbf7a4-f158-40d6-bbd8-7daa1834c4e0 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.348953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558e2e-5d62-47ae-9a68-5e850f41a83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.349770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558e2e-5d62-47ae-9a68-5e850f41a83a admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.350240 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558e2e-5d62-47ae-9a68-5e850f41a83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.350550 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558e2e-5d62-47ae-9a68-5e850f41a83a admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.351196 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97558e2e-5d62-47ae-9a68-5e850f41a83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.352827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97558e2e-5d62-47ae-9a68-5e850f41a83a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.364240 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1052/2067] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:28.370062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1016/2068] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:28 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:29:28.370221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558e2e-5d62-47ae-9a68-5e850f41a83a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.371338 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf05a7-8494-45d5-8554-64ba7f484c3e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.378304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558e2e-5d62-47ae-9a68-5e850f41a83a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.398450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:28.453420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f631a8-dc9f-4b3c-9ddb-7b76efa41eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.454509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f631a8-dc9f-4b3c-9ddb-7b76efa41eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.455276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f631a8-dc9f-4b3c-9ddb-7b76efa41eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.455276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f631a8-dc9f-4b3c-9ddb-7b76efa41eb3 admin admin] PATH_INFO: `/v3/projects/bfd748f806994cf29cfe3835367a9a2d/users/6f22531355694fc5abc87ee1e7c7bc83/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.473311 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f631a8-dc9f-4b3c-9ddb-7b76efa41eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd748f806994cf29cfe3835367a9a2d, user_id=6f22531355694fc5abc87ee1e7c7bc83, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.477142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f631a8-dc9f-4b3c-9ddb-7b76efa41eb3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.495675 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1053/2069] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:28 2022] PUT /identity/v3/projects/bfd748f806994cf29cfe3835367a9a2d/users/6f22531355694fc5abc87ee1e7c7bc83/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:28.496062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf05a7-8494-45d5-8554-64ba7f484c3e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.499804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f631a8-dc9f-4b3c-9ddb-7b76efa41eb3 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.567566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:28.571407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e800d-b552-42d0-9e3b-12a5ff8fbd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.572688 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e800d-b552-42d0-9e3b-12a5ff8fbd8a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.573077 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e800d-b552-42d0-9e3b-12a5ff8fbd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.573416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e800d-b552-42d0-9e3b-12a5ff8fbd8a admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.574364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e800d-b552-42d0-9e3b-12a5ff8fbd8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.576752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e800d-b552-42d0-9e3b-12a5ff8fbd8a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.589103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f631a8-dc9f-4b3c-9ddb-7b76efa41eb3 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.595007 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87151c30-17c7-49f8-a68f-bf3bf6f9acd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.597250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151c30-17c7-49f8-a68f-bf3bf6f9acd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.597528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151c30-17c7-49f8-a68f-bf3bf6f9acd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.597799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151c30-17c7-49f8-a68f-bf3bf6f9acd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.598497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87151c30-17c7-49f8-a68f-bf3bf6f9acd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.600121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87151c30-17c7-49f8-a68f-bf3bf6f9acd6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.608496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1017/2070] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:28 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:28.612330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e800d-b552-42d0-9e3b-12a5ff8fbd8a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.617699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1054/2071] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:28.618580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87151c30-17c7-49f8-a68f-bf3bf6f9acd6 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.626664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e800d-b552-42d0-9e3b-12a5ff8fbd8a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.629317 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87151c30-17c7-49f8-a68f-bf3bf6f9acd6 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.632212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb602474-eca1-43ff-9248-3fb14d6e8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.633028 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb602474-eca1-43ff-9248-3fb14d6e8beb admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.633581 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb602474-eca1-43ff-9248-3fb14d6e8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.634039 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c269f-10a6-4ed9-83ef-4e89b9511334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.634494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb602474-eca1-43ff-9248-3fb14d6e8beb admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.635432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c269f-10a6-4ed9-83ef-4e89b9511334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.635719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c269f-10a6-4ed9-83ef-4e89b9511334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.636016 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c269f-10a6-4ed9-83ef-4e89b9511334 admin admin] PATH_INFO: `/v3/projects/bfd748f806994cf29cfe3835367a9a2d/users/6f22531355694fc5abc87ee1e7c7bc83/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.636647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb602474-eca1-43ff-9248-3fb14d6e8beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.638055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c269f-10a6-4ed9-83ef-4e89b9511334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd748f806994cf29cfe3835367a9a2d, user_id=6f22531355694fc5abc87ee1e7c7bc83, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.639011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb602474-eca1-43ff-9248-3fb14d6e8beb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.640758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c269f-10a6-4ed9-83ef-4e89b9511334 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.651632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1018/2072] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:28.652309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1055/2073] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:28 2022] PUT /identity/v3/projects/bfd748f806994cf29cfe3835367a9a2d/users/6f22531355694fc5abc87ee1e7c7bc83/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:28.655840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb602474-eca1-43ff-9248-3fb14d6e8beb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.663525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a268ec-42b0-4bdf-8a4c-c63ebb6726c4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.663826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a268ec-42b0-4bdf-8a4c-c63ebb6726c4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.664088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a268ec-42b0-4bdf-8a4c-c63ebb6726c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.669385 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb602474-eca1-43ff-9248-3fb14d6e8beb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.697964 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-d4a268ec-42b0-4bdf-8a4c-c63ebb6726c4 None None] MFA Rules not processed for user `6f22531355694fc5abc87ee1e7c7bc83`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:28.699797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d4a268ec-42b0-4bdf-8a4c-c63ebb6726c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:28.741183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b62b2-0eea-4ad1-9347-560e1337b832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.741811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b62b2-0eea-4ad1-9347-560e1337b832 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.742096 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b62b2-0eea-4ad1-9347-560e1337b832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.742370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b62b2-0eea-4ad1-9347-560e1337b832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.743044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b62b2-0eea-4ad1-9347-560e1337b832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.745623 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b62b2-0eea-4ad1-9347-560e1337b832 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.756073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1019/2074] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:28.761132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b62b2-0eea-4ad1-9347-560e1337b832 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.772507 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b62b2-0eea-4ad1-9347-560e1337b832 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.778928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d49d0-1c9c-4da0-9139-df5f53ff6cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.780380 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d49d0-1c9c-4da0-9139-df5f53ff6cce admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.780852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d49d0-1c9c-4da0-9139-df5f53ff6cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.781200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d49d0-1c9c-4da0-9139-df5f53ff6cce admin admin] PATH_INFO: `/v3/projects/afffcf8759594739be017180cdc6f0a1/users/8088b06f5e594e1285425863daa7662f/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.793253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1056/2075] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:28.798989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d49d0-1c9c-4da0-9139-df5f53ff6cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=afffcf8759594739be017180cdc6f0a1, user_id=8088b06f5e594e1285425863daa7662f, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:28.801654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d49d0-1c9c-4da0-9139-df5f53ff6cce admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:28.804266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a268ec-42b0-4bdf-8a4c-c63ebb6726c4 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.805683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d4a268ec-42b0-4bdf-8a4c-c63ebb6726c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:28.818335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1020/2076] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:28 2022] PUT /identity/v3/projects/afffcf8759594739be017180cdc6f0a1/users/8088b06f5e594e1285425863daa7662f/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:28.830952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f047d48-bd87-4e6a-84a6-e7f2ee552da7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.831589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f047d48-bd87-4e6a-84a6-e7f2ee552da7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.832034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f047d48-bd87-4e6a-84a6-e7f2ee552da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.868567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:28.872774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3f047d48-bd87-4e6a-84a6-e7f2ee552da7 None None] MFA Rules not processed for user `8088b06f5e594e1285425863daa7662f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:28.873026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a268ec-42b0-4bdf-8a4c-c63ebb6726c4 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:28.875030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3f047d48-bd87-4e6a-84a6-e7f2ee552da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:28.958734 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d58b9-ec3d-490f-a25d-96c2be81f04b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:28.959511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d58b9-ec3d-490f-a25d-96c2be81f04b service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:28.959803 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d58b9-ec3d-490f-a25d-96c2be81f04b service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:28.960097 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d58b9-ec3d-490f-a25d-96c2be81f04b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:28.977806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1021/2077] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:28.979661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f047d48-bd87-4e6a-84a6-e7f2ee552da7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:28.987708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:29.066220 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d58b9-ec3d-490f-a25d-96c2be81f04b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:29.068136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d58b9-ec3d-490f-a25d-96c2be81f04b service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:29.083333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1057/2078] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:29.089701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f047d48-bd87-4e6a-84a6-e7f2ee552da7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:29.100095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2cc3e-9d2c-4206-9579-c712b777f403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:29.101981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2cc3e-9d2c-4206-9579-c712b777f403 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:29.102371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2cc3e-9d2c-4206-9579-c712b777f403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:29.102790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2cc3e-9d2c-4206-9579-c712b777f403 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:29.104410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2cc3e-9d2c-4206-9579-c712b777f403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:29.106550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2cc3e-9d2c-4206-9579-c712b777f403 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:29.152468 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1022/2079] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:28 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:29.155950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d58b9-ec3d-490f-a25d-96c2be81f04b service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:29.171197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d58b9-ec3d-490f-a25d-96c2be81f04b service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:29.274621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fe37b-1cdd-4b48-9a7b-fd6543835c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:29.276280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fe37b-1cdd-4b48-9a7b-fd6543835c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:29.276671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fe37b-1cdd-4b48-9a7b-fd6543835c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:29.277069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fe37b-1cdd-4b48-9a7b-fd6543835c95 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:29.277866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fe37b-1cdd-4b48-9a7b-fd6543835c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:29.280911 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fe37b-1cdd-4b48-9a7b-fd6543835c95 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:29.322422 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1058/2080] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:29 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:29:29.326107 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2cc3e-9d2c-4206-9579-c712b777f403 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:29.357601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2cc3e-9d2c-4206-9579-c712b777f403 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:29.372756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bb8b2-a5e8-4db9-aaed-a35b3c22903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:29.373801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bb8b2-a5e8-4db9-aaed-a35b3c22903b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:29.375127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bb8b2-a5e8-4db9-aaed-a35b3c22903b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:29.375503 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bb8b2-a5e8-4db9-aaed-a35b3c22903b admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:29.376417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bb8b2-a5e8-4db9-aaed-a35b3c22903b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:29.378417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bb8b2-a5e8-4db9-aaed-a35b3c22903b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:29.398752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1023/2081] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:29.399499 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fe37b-1cdd-4b48-9a7b-fd6543835c95 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:29.411206 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fe37b-1cdd-4b48-9a7b-fd6543835c95 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:29.419208 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca086b-a011-49d7-93a7-920b3da2f8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:29.420226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca086b-a011-49d7-93a7-920b3da2f8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:29.420370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca086b-a011-49d7-93a7-920b3da2f8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:29.420645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca086b-a011-49d7-93a7-920b3da2f8f7 admin admin] PATH_INFO: `/v3/projects/8f4a68ff64644eaf8e9044790e09100a/users/6e5b7bd8ed09405ca0ec0961ae6aa504/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:29.443162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca086b-a011-49d7-93a7-920b3da2f8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4a68ff64644eaf8e9044790e09100a, user_id=6e5b7bd8ed09405ca0ec0961ae6aa504, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:29.446483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca086b-a011-49d7-93a7-920b3da2f8f7 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:29.474140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1059/2082] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:29 2022] PUT /identity/v3/projects/8f4a68ff64644eaf8e9044790e09100a/users/6e5b7bd8ed09405ca0ec0961ae6aa504/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:29.475554 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bb8b2-a5e8-4db9-aaed-a35b3c22903b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:29.490620 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bb8b2-a5e8-4db9-aaed-a35b3c22903b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:29.617574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d98e02-3cb2-4e5b-9239-a82292cf53fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:29.618532 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d98e02-3cb2-4e5b-9239-a82292cf53fe admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:29.618920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d98e02-3cb2-4e5b-9239-a82292cf53fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:29.619205 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d98e02-3cb2-4e5b-9239-a82292cf53fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:29.619891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d98e02-3cb2-4e5b-9239-a82292cf53fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:29.622007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d98e02-3cb2-4e5b-9239-a82292cf53fe admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:29.637745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1024/2083] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:29.641784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca086b-a011-49d7-93a7-920b3da2f8f7 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:29.648734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d98e02-3cb2-4e5b-9239-a82292cf53fe admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:29.654288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca086b-a011-49d7-93a7-920b3da2f8f7 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:29.659711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91630bc-4fdd-47c2-a738-68877688fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:29.660373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91630bc-4fdd-47c2-a738-68877688fe8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:29.660481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d98e02-3cb2-4e5b-9239-a82292cf53fe admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:29.661190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91630bc-4fdd-47c2-a738-68877688fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:29.661190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91630bc-4fdd-47c2-a738-68877688fe8c admin admin] PATH_INFO: `/v3/projects/8f4a68ff64644eaf8e9044790e09100a/users/6e5b7bd8ed09405ca0ec0961ae6aa504/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:29.662867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91630bc-4fdd-47c2-a738-68877688fe8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4a68ff64644eaf8e9044790e09100a, user_id=6e5b7bd8ed09405ca0ec0961ae6aa504, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:29.665546 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91630bc-4fdd-47c2-a738-68877688fe8c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:29.666506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99e369-e3d9-44ca-a7de-837b21673260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:29.667163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99e369-e3d9-44ca-a7de-837b21673260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:29.667446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99e369-e3d9-44ca-a7de-837b21673260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:29.667718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99e369-e3d9-44ca-a7de-837b21673260 admin admin] PATH_INFO: `/v3/users/cd3fa75f45f14c2fb13948762aabf82a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:29.668870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99e369-e3d9-44ca-a7de-837b21673260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3fa75f45f14c2fb13948762aabf82a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:29.671213 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99e369-e3d9-44ca-a7de-837b21673260 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:29.676800 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:29.681299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1060/2084] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:29 2022] PUT /identity/v3/projects/8f4a68ff64644eaf8e9044790e09100a/users/6e5b7bd8ed09405ca0ec0961ae6aa504/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:29.692716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacffef-aa65-44ca-812c-1fd33e3913c3 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:29.693102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacffef-aa65-44ca-812c-1fd33e3913c3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:29.693488 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacffef-aa65-44ca-812c-1fd33e3913c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:29.724135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-abacffef-aa65-44ca-812c-1fd33e3913c3 None None] MFA Rules not processed for user `6e5b7bd8ed09405ca0ec0961ae6aa504`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:29.725455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-abacffef-aa65-44ca-812c-1fd33e3913c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:29.734473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b99e369-e3d9-44ca-a7de-837b21673260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3fa75f45f14c2fb13948762aabf82a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:29.742669 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b99e369-e3d9-44ca-a7de-837b21673260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3fa75f45f14c2fb13948762aabf82a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:29.756097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b99e369-e3d9-44ca-a7de-837b21673260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3fa75f45f14c2fb13948762aabf82a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:29.756938 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b99e369-e3d9-44ca-a7de-837b21673260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3fa75f45f14c2fb13948762aabf82a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:29.757567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b99e369-e3d9-44ca-a7de-837b21673260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3fa75f45f14c2fb13948762aabf82a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:29.772766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1025/2085] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:29 2022] DELETE /identity/v3/users/cd3fa75f45f14c2fb13948762aabf82a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:29.778297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d14470-6895-4fdd-ab25-df2835ff0503 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:29.778980 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d14470-6895-4fdd-ab25-df2835ff0503 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:29.779362 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d14470-6895-4fdd-ab25-df2835ff0503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:29.803541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-62d14470-6895-4fdd-ab25-df2835ff0503 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:29.804193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:29.806480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-62d14470-6895-4fdd-ab25-df2835ff0503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:29.819127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1061/2086] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:29.829538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacffef-aa65-44ca-812c-1fd33e3913c3 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:29.831150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-abacffef-aa65-44ca-812c-1fd33e3913c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:29.876016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1026/2087] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:29.885881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d14470-6895-4fdd-ab25-df2835ff0503 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:29.887394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-62d14470-6895-4fdd-ab25-df2835ff0503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:29.891705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacffef-aa65-44ca-812c-1fd33e3913c3 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:29.940840 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0e097-6857-40a2-91de-70538e2254d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:29.941477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0e097-6857-40a2-91de-70538e2254d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:29.941866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0e097-6857-40a2-91de-70538e2254d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:29.942147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0e097-6857-40a2-91de-70538e2254d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:29.944129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-1eb0e097-6857-40a2-91de-70538e2254d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:29.944352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d14470-6895-4fdd-ab25-df2835ff0503 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:29.948979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dda5e-1565-41b4-b010-e3f498f1a915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:29.949694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dda5e-1565-41b4-b010-e3f498f1a915 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:29.949870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dda5e-1565-41b4-b010-e3f498f1a915 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:29.950142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dda5e-1565-41b4-b010-e3f498f1a915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:29.959754 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dda5e-1565-41b4-b010-e3f498f1a915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:29.961201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dda5e-1565-41b4-b010-e3f498f1a915 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:29.971390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1027/2088] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:30.003977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0e097-6857-40a2-91de-70538e2254d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:30.005421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0e097-6857-40a2-91de-70538e2254d8 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:30.015611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1062/2089] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:30.760143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dda5e-1565-41b4-b010-e3f498f1a915 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:30.761679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-936dda5e-1565-41b4-b010-e3f498f1a915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:30.774712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dda5e-1565-41b4-b010-e3f498f1a915 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:30.779421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:30.780047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:30.780321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:30.780591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] PATH_INFO: `/v3/projects/79e9cb956c1641daa5b05117600d1628` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:30.781698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e9cb956c1641daa5b05117600d1628)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:30.783652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:30.814941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:30.844463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e9cb956c1641daa5b05117600d1628', 'request_id': 'req-b399f2b1-32d8-4b2a-9b95-9b316752ade1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:30.861530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e9cb956c1641daa5b05117600d1628', 'request_id': 'req-b399f2b1-32d8-4b2a-9b95-9b316752ade1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:30.871790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e9cb956c1641daa5b05117600d1628', 'request_id': 'req-b399f2b1-32d8-4b2a-9b95-9b316752ade1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:30.885618 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] The token cache is being invalidate because project 79e9cb956c1641daa5b05117600d1628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:30.885907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:30.886753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:30.891161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1028/2090] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:30 2022] DELETE /identity/v3/projects/79e9cb956c1641daa5b05117600d1628 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:30.892281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0e097-6857-40a2-91de-70538e2254d8 service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:30.929917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0e097-6857-40a2-91de-70538e2254d8 service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:31.012298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91206907-3512-4398-b628-df4bd00c265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:31.013139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91206907-3512-4398-b628-df4bd00c265e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:31.013631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91206907-3512-4398-b628-df4bd00c265e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:31.014060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91206907-3512-4398-b628-df4bd00c265e admin admin] PATH_INFO: `/v3/users/6f22531355694fc5abc87ee1e7c7bc83` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:31.015460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91206907-3512-4398-b628-df4bd00c265e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f22531355694fc5abc87ee1e7c7bc83)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:31.018519 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91206907-3512-4398-b628-df4bd00c265e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:31.028783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:31.092164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-91206907-3512-4398-b628-df4bd00c265e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f22531355694fc5abc87ee1e7c7bc83'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:31.101213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-91206907-3512-4398-b628-df4bd00c265e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f22531355694fc5abc87ee1e7c7bc83'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:31.117195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-91206907-3512-4398-b628-df4bd00c265e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f22531355694fc5abc87ee1e7c7bc83'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:31.117568 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-91206907-3512-4398-b628-df4bd00c265e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f22531355694fc5abc87ee1e7c7bc83'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:31.118439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-91206907-3512-4398-b628-df4bd00c265e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f22531355694fc5abc87ee1e7c7bc83'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:31.134023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1063/2091] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:30 2022] DELETE /identity/v3/users/6f22531355694fc5abc87ee1e7c7bc83 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:31.465319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:31.466843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:31.495911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399f2b1-32d8-4b2a-9b95-9b316752ade1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:31.574940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:31.575686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:31.575978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:31.576258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] PATH_INFO: `/v3/projects/bfd748f806994cf29cfe3835367a9a2d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:31.577767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd748f806994cf29cfe3835367a9a2d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:31.579830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:31.630838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd748f806994cf29cfe3835367a9a2d', 'request_id': 'req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:31.639390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd748f806994cf29cfe3835367a9a2d', 'request_id': 'req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:31.646988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd748f806994cf29cfe3835367a9a2d', 'request_id': 'req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:31.669917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] The token cache is being invalidate because project bfd748f806994cf29cfe3835367a9a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:31.670272 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:31.671296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:31.673300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1029/2092] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:31 2022] DELETE /identity/v3/projects/bfd748f806994cf29cfe3835367a9a2d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:31.679169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd502d6-9cdb-4133-b0e0-e559f0543ede None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:31.679866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd502d6-9cdb-4133-b0e0-e559f0543ede None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:31.680364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd502d6-9cdb-4133-b0e0-e559f0543ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:31.714153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:31.714153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:31.715330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-edd502d6-9cdb-4133-b0e0-e559f0543ede None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:31.716730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-edd502d6-9cdb-4133-b0e0-e559f0543ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:31.756626 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:31.772400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1f1ec-7ec2-44dc-b37e-2390ba7ade72 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:31.776633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98159131-dafa-464f-a3e3-6af0acd99821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:31.777245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98159131-dafa-464f-a3e3-6af0acd99821 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:31.777528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98159131-dafa-464f-a3e3-6af0acd99821 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:31.777796 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98159131-dafa-464f-a3e3-6af0acd99821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:31.781380 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-98159131-dafa-464f-a3e3-6af0acd99821 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:31.798293 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1064/2093] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:31.806632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f626825-23da-4bb2-8db4-4ae038b9e9d7 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:31.806971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f626825-23da-4bb2-8db4-4ae038b9e9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:31.807244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f626825-23da-4bb2-8db4-4ae038b9e9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:31.828810 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-4f626825-23da-4bb2-8db4-4ae038b9e9d7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:31.830021 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4f626825-23da-4bb2-8db4-4ae038b9e9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:31.839354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1065/2094] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:31.843498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f626825-23da-4bb2-8db4-4ae038b9e9d7 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:31.850171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98159131-dafa-464f-a3e3-6af0acd99821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:31.851670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98159131-dafa-464f-a3e3-6af0acd99821 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:31.852788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f626825-23da-4bb2-8db4-4ae038b9e9d7 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:31.859623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edab22-c5cb-4b3f-981e-1d9408bf63ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:31.860247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edab22-c5cb-4b3f-981e-1d9408bf63ef admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:31.860527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edab22-c5cb-4b3f-981e-1d9408bf63ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:31.860799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edab22-c5cb-4b3f-981e-1d9408bf63ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:31.861454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edab22-c5cb-4b3f-981e-1d9408bf63ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:31.861756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edab22-c5cb-4b3f-981e-1d9408bf63ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:31.863196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1030/2095] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:31.865204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edab22-c5cb-4b3f-981e-1d9408bf63ef admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:31.880038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1066/2096] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:29:31.884149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98159131-dafa-464f-a3e3-6af0acd99821 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:31.894795 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98159131-dafa-464f-a3e3-6af0acd99821 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:31.899461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f54846-d023-4a37-af7f-ed23982e79c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:31.900103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f54846-d023-4a37-af7f-ed23982e79c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:31.900388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f54846-d023-4a37-af7f-ed23982e79c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:31.900661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f54846-d023-4a37-af7f-ed23982e79c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:31.901305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f54846-d023-4a37-af7f-ed23982e79c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:31.903273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f54846-d023-4a37-af7f-ed23982e79c4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:31.938698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1031/2097] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:31 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:31.944022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edab22-c5cb-4b3f-981e-1d9408bf63ef admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:31.957769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edab22-c5cb-4b3f-981e-1d9408bf63ef admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:32.034181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7889-b083-40e1-8cd6-239ef3838255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:32.035109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7889-b083-40e1-8cd6-239ef3838255 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:32.035387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7889-b083-40e1-8cd6-239ef3838255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:32.035658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7889-b083-40e1-8cd6-239ef3838255 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:32.036395 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add7889-b083-40e1-8cd6-239ef3838255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:32.038897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add7889-b083-40e1-8cd6-239ef3838255 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:32.053069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:32.069497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1067/2098] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:31 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:32.074325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f54846-d023-4a37-af7f-ed23982e79c4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:32.085400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f54846-d023-4a37-af7f-ed23982e79c4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:32.090982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f69a7-70fe-48e6-a274-d9cb75712487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:32.091607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f69a7-70fe-48e6-a274-d9cb75712487 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:32.091884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f69a7-70fe-48e6-a274-d9cb75712487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:32.092153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f69a7-70fe-48e6-a274-d9cb75712487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:32.093243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f69a7-70fe-48e6-a274-d9cb75712487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:32.094448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f69a7-70fe-48e6-a274-d9cb75712487 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:32.110821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1032/2099] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:32.112225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7889-b083-40e1-8cd6-239ef3838255 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:32.123129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7889-b083-40e1-8cd6-239ef3838255 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:32.128967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030db8ff-37cc-451b-a186-5610a88484c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:32.129587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030db8ff-37cc-451b-a186-5610a88484c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:32.129896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030db8ff-37cc-451b-a186-5610a88484c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:32.130168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030db8ff-37cc-451b-a186-5610a88484c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:32.130890 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030db8ff-37cc-451b-a186-5610a88484c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:32.132606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030db8ff-37cc-451b-a186-5610a88484c3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:32.147237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1068/2100] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:32.152726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f69a7-70fe-48e6-a274-d9cb75712487 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:32.165580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f69a7-70fe-48e6-a274-d9cb75712487 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:32.172819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae584f-8fb2-49da-98d4-d2291aafc75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:32.173511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae584f-8fb2-49da-98d4-d2291aafc75c admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:32.173796 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae584f-8fb2-49da-98d4-d2291aafc75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:32.174541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae584f-8fb2-49da-98d4-d2291aafc75c admin admin] PATH_INFO: `/v3/projects/44fe14c0f228435bab1a110e2f6502c8/users/c18f6dbaa5a74c8d8329df6d93861706/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:32.198754 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae584f-8fb2-49da-98d4-d2291aafc75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=44fe14c0f228435bab1a110e2f6502c8, user_id=c18f6dbaa5a74c8d8329df6d93861706, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:32.201518 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae584f-8fb2-49da-98d4-d2291aafc75c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:32.216684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1033/2101] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:32 2022] PUT /identity/v3/projects/44fe14c0f228435bab1a110e2f6502c8/users/c18f6dbaa5a74c8d8329df6d93861706/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:32.228107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c4d14-0808-4efd-b331-72695c4c53cf None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:32.228461 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c4d14-0808-4efd-b331-72695c4c53cf None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:32.228954 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c4d14-0808-4efd-b331-72695c4c53cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:32.263847 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-4f2c4d14-0808-4efd-b331-72695c4c53cf None None] MFA Rules not processed for user `c18f6dbaa5a74c8d8329df6d93861706`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:32.265432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4f2c4d14-0808-4efd-b331-72695c4c53cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:32.363844 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1069/2102] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:32.401665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae584f-8fb2-49da-98d4-d2291aafc75c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:32.403717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b4ae584f-8fb2-49da-98d4-d2291aafc75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:32.471413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae584f-8fb2-49da-98d4-d2291aafc75c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:32.475763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac728b01-c6d9-4275-9f83-dd7f168e7917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:32.476852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac728b01-c6d9-4275-9f83-dd7f168e7917 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:32.476852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac728b01-c6d9-4275-9f83-dd7f168e7917 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:32.477464 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac728b01-c6d9-4275-9f83-dd7f168e7917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:32.488820 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac728b01-c6d9-4275-9f83-dd7f168e7917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:32.491079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac728b01-c6d9-4275-9f83-dd7f168e7917 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:32.503703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1034/2103] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:32.596514 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c4d14-0808-4efd-b331-72695c4c53cf None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:32.607270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c4d14-0808-4efd-b331-72695c4c53cf None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:32.610859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e89b5a-a808-4b4a-869e-bf9e8fa831bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:32.611464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e89b5a-a808-4b4a-869e-bf9e8fa831bf service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:32.611747 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e89b5a-a808-4b4a-869e-bf9e8fa831bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:32.612020 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e89b5a-a808-4b4a-869e-bf9e8fa831bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:32.613757 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-00e89b5a-a808-4b4a-869e-bf9e8fa831bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:32.679247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e89b5a-a808-4b4a-869e-bf9e8fa831bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:32.680684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e89b5a-a808-4b4a-869e-bf9e8fa831bf service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:32.690962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1070/2104] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:33.960508 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588058a-cbd5-45e8-b767-25f19975dfb6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:33.961072 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588058a-cbd5-45e8-b767-25f19975dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:33.961072 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588058a-cbd5-45e8-b767-25f19975dfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:33.983666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0588058a-cbd5-45e8-b767-25f19975dfb6 None None] MFA Rules not processed for user `c18f6dbaa5a74c8d8329df6d93861706`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:33.984989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0588058a-cbd5-45e8-b767-25f19975dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:33.992194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1035/2105] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:36.704650 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e89b5a-a808-4b4a-869e-bf9e8fa831bf service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:36.706194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-00e89b5a-a808-4b4a-869e-bf9e8fa831bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:36.807236 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e89b5a-a808-4b4a-869e-bf9e8fa831bf service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:36.816642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:36.820823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:36.821129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:36.822242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] PATH_INFO: `/v3/users/282ed5ad0a394c35833f6125740a8b94` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:36.824238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=282ed5ad0a394c35833f6125740a8b94)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:36.826872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:36.840658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:36.878819 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '282ed5ad0a394c35833f6125740a8b94'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:36.887080 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '282ed5ad0a394c35833f6125740a8b94'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:36.899349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '282ed5ad0a394c35833f6125740a8b94'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:36.900074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '282ed5ad0a394c35833f6125740a8b94'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:36.900726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '282ed5ad0a394c35833f6125740a8b94'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:36.912780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1071/2106] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:36 2022] DELETE /identity/v3/users/282ed5ad0a394c35833f6125740a8b94 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:36.917798 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb9d7-81e4-4359-9bb9-92985d7a66ba None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:36.918285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb9d7-81e4-4359-9bb9-92985d7a66ba None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:36.918452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb9d7-81e4-4359-9bb9-92985d7a66ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:36.938100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e3acb9d7-81e4-4359-9bb9-92985d7a66ba None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:36.939338 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e3acb9d7-81e4-4359-9bb9-92985d7a66ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:36.968814 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:36.999812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1036/2107] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:37.009709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:37.011263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:37.068515 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad668f1-c2d4-4ef2-8f14-d749f4b5b97e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:37.073137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f3d38-a2ab-4248-8900-e1f878123ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:37.073748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f3d38-a2ab-4248-8900-e1f878123ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:37.074025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f3d38-a2ab-4248-8900-e1f878123ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:37.074296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f3d38-a2ab-4248-8900-e1f878123ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:37.083544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f3d38-a2ab-4248-8900-e1f878123ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:37.084970 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f3d38-a2ab-4248-8900-e1f878123ab6 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:37.095122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1072/2108] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:37.486951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb9d7-81e4-4359-9bb9-92985d7a66ba None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:37.488683 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e3acb9d7-81e4-4359-9bb9-92985d7a66ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:37.502288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb9d7-81e4-4359-9bb9-92985d7a66ba None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:37.507414 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:37.508788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:37.509985 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:37.510541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] PATH_INFO: `/v3/projects/9322fa22d73d4d3aa3ab7f75e97791c2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:37.512486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9322fa22d73d4d3aa3ab7f75e97791c2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:37.514428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:37.565894 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9322fa22d73d4d3aa3ab7f75e97791c2', 'request_id': 'req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.573849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9322fa22d73d4d3aa3ab7f75e97791c2', 'request_id': 'req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.581034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9322fa22d73d4d3aa3ab7f75e97791c2', 'request_id': 'req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.591694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] The token cache is being invalidate because project 9322fa22d73d4d3aa3ab7f75e97791c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:37.591980 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.592628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.594496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1037/2109] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:37 2022] DELETE /identity/v3/projects/9322fa22d73d4d3aa3ab7f75e97791c2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:37.598143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f3d38-a2ab-4248-8900-e1f878123ab6 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:37.607834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f3d38-a2ab-4248-8900-e1f878123ab6 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:37.662017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:37.663533 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:37.664588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f04aca-ad3b-4e19-a34e-43ce44ff354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:37.665254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04aca-ad3b-4e19-a34e-43ce44ff354b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:37.665520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04aca-ad3b-4e19-a34e-43ce44ff354b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:37.665797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f04aca-ad3b-4e19-a34e-43ce44ff354b admin admin] PATH_INFO: `/v3/users/8088b06f5e594e1285425863daa7662f` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:37.667238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f04aca-ad3b-4e19-a34e-43ce44ff354b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8088b06f5e594e1285425863daa7662f)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:37.669166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f04aca-ad3b-4e19-a34e-43ce44ff354b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:37.677365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3362c-082f-4f2c-9e2b-f922cc00c9a2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:37.683143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:37.683803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:37.684076 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:37.684345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] PATH_INFO: `/v3/users/362ba33b2cd746e0846dada383886e60` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:37.685693 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=362ba33b2cd746e0846dada383886e60)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:37.687639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:37.706259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:37.720904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-31f04aca-ad3b-4e19-a34e-43ce44ff354b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8088b06f5e594e1285425863daa7662f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.727873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-31f04aca-ad3b-4e19-a34e-43ce44ff354b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8088b06f5e594e1285425863daa7662f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.736315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362ba33b2cd746e0846dada383886e60'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.739857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-31f04aca-ad3b-4e19-a34e-43ce44ff354b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8088b06f5e594e1285425863daa7662f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.740521 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-31f04aca-ad3b-4e19-a34e-43ce44ff354b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8088b06f5e594e1285425863daa7662f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.741123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-31f04aca-ad3b-4e19-a34e-43ce44ff354b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8088b06f5e594e1285425863daa7662f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.744046 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362ba33b2cd746e0846dada383886e60'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.755163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1073/2110] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:37 2022] DELETE /identity/v3/users/8088b06f5e594e1285425863daa7662f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:37.757526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362ba33b2cd746e0846dada383886e60'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.758228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362ba33b2cd746e0846dada383886e60'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.758936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362ba33b2cd746e0846dada383886e60'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:37.773140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1038/2111] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:37 2022] DELETE /identity/v3/users/362ba33b2cd746e0846dada383886e60 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:37.778133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c4507-55c1-40f3-a1e1-da7501eea124 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:37.778448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c4507-55c1-40f3-a1e1-da7501eea124 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:37.778799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c4507-55c1-40f3-a1e1-da7501eea124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:37.799645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c88c4507-55c1-40f3-a1e1-da7501eea124 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:37.800146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c88c4507-55c1-40f3-a1e1-da7501eea124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:37.874580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1074/2112] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:37.886035 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:37.887862 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:37.940484 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:37.978801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcfa34-22d9-4c8c-8651-64a4d3c3eb52 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:37.982524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef581fa-24bd-4baf-9596-22e6187c7af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:37.983169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef581fa-24bd-4baf-9596-22e6187c7af6 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:37.983403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef581fa-24bd-4baf-9596-22e6187c7af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:37.983671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef581fa-24bd-4baf-9596-22e6187c7af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:37.994894 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef581fa-24bd-4baf-9596-22e6187c7af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:37.996618 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef581fa-24bd-4baf-9596-22e6187c7af6 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:38.010672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1039/2113] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:38.098247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c4507-55c1-40f3-a1e1-da7501eea124 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:38.100093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c88c4507-55c1-40f3-a1e1-da7501eea124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:38.117560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c4507-55c1-40f3-a1e1-da7501eea124 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:38.123963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:38.125003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:38.125717 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:38.125999 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] PATH_INFO: `/v3/projects/afffcf8759594739be017180cdc6f0a1` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:38.127481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] RBAC: Authorizing `identity:delete_project(project_id=afffcf8759594739be017180cdc6f0a1)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:38.144746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:38.225256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afffcf8759594739be017180cdc6f0a1', 'request_id': 'req-a167c3ea-e3d0-4788-afed-56e6eec0602c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.233468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afffcf8759594739be017180cdc6f0a1', 'request_id': 'req-a167c3ea-e3d0-4788-afed-56e6eec0602c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.242877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afffcf8759594739be017180cdc6f0a1', 'request_id': 'req-a167c3ea-e3d0-4788-afed-56e6eec0602c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.266011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] The token cache is being invalidate because project afffcf8759594739be017180cdc6f0a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:38.266403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.267213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.270110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1075/2114] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:38 2022] DELETE /identity/v3/projects/afffcf8759594739be017180cdc6f0a1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:38.275130 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef581fa-24bd-4baf-9596-22e6187c7af6 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:38.295140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef581fa-24bd-4baf-9596-22e6187c7af6 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:38.389936 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c9142-8bc6-46a6-bcaf-132f8aab982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:38.391745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c9142-8bc6-46a6-bcaf-132f8aab982d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:38.392233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c9142-8bc6-46a6-bcaf-132f8aab982d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:38.392766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c9142-8bc6-46a6-bcaf-132f8aab982d admin admin] PATH_INFO: `/v3/users/6e5b7bd8ed09405ca0ec0961ae6aa504` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:38.394853 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c9142-8bc6-46a6-bcaf-132f8aab982d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5b7bd8ed09405ca0ec0961ae6aa504)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:38.396948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c9142-8bc6-46a6-bcaf-132f8aab982d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:38.454860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0f4c9142-8bc6-46a6-bcaf-132f8aab982d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5b7bd8ed09405ca0ec0961ae6aa504'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.465085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0f4c9142-8bc6-46a6-bcaf-132f8aab982d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5b7bd8ed09405ca0ec0961ae6aa504'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.471256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:38.472795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:38.489777 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167c3ea-e3d0-4788-afed-56e6eec0602c admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:38.500989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0f4c9142-8bc6-46a6-bcaf-132f8aab982d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5b7bd8ed09405ca0ec0961ae6aa504'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.501722 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0f4c9142-8bc6-46a6-bcaf-132f8aab982d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5b7bd8ed09405ca0ec0961ae6aa504'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.502393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0f4c9142-8bc6-46a6-bcaf-132f8aab982d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5b7bd8ed09405ca0ec0961ae6aa504'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.515051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f835cfa-5921-436c-8d8a-e008ae0ee173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:38.516414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835cfa-5921-436c-8d8a-e008ae0ee173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:38.517215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835cfa-5921-436c-8d8a-e008ae0ee173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:38.517695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835cfa-5921-436c-8d8a-e008ae0ee173 admin admin] PATH_INFO: `/v3/projects/8a67d8f82803453fb0cc7ce449155792` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:38.519528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f835cfa-5921-436c-8d8a-e008ae0ee173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a67d8f82803453fb0cc7ce449155792)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:38.522485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f835cfa-5921-436c-8d8a-e008ae0ee173 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:38.535791 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1040/2115] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:38 2022] DELETE /identity/v3/users/6e5b7bd8ed09405ca0ec0961ae6aa504 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:38.568641 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:38.599096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9f835cfa-5921-436c-8d8a-e008ae0ee173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a67d8f82803453fb0cc7ce449155792', 'request_id': 'req-9f835cfa-5921-436c-8d8a-e008ae0ee173'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.608406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9f835cfa-5921-436c-8d8a-e008ae0ee173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a67d8f82803453fb0cc7ce449155792', 'request_id': 'req-9f835cfa-5921-436c-8d8a-e008ae0ee173'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.616570 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9f835cfa-5921-436c-8d8a-e008ae0ee173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a67d8f82803453fb0cc7ce449155792', 'request_id': 'req-9f835cfa-5921-436c-8d8a-e008ae0ee173'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.636827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9f835cfa-5921-436c-8d8a-e008ae0ee173 admin admin] The token cache is being invalidate because project 8a67d8f82803453fb0cc7ce449155792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:38.637330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9f835cfa-5921-436c-8d8a-e008ae0ee173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.638649 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9f835cfa-5921-436c-8d8a-e008ae0ee173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:38.642685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1076/2116] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:38 2022] DELETE /identity/v3/projects/8a67d8f82803453fb0cc7ce449155792 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:38.647233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b677b8-bd19-4d02-a926-642c0f9985c5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:38.656082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b677b8-bd19-4d02-a926-642c0f9985c5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:38.656386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b677b8-bd19-4d02-a926-642c0f9985c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:38.690651 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e2b677b8-bd19-4d02-a926-642c0f9985c5 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:38.692052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e2b677b8-bd19-4d02-a926-642c0f9985c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:38.759736 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:38.775599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1041/2117] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:38.785457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e67579-fae3-4a67-9310-109c3b24be8d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:38.786006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e67579-fae3-4a67-9310-109c3b24be8d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:38.786006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e67579-fae3-4a67-9310-109c3b24be8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:38.811960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-14e67579-fae3-4a67-9310-109c3b24be8d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:38.814108 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-14e67579-fae3-4a67-9310-109c3b24be8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:38.825282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1077/2118] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:38.829629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b677b8-bd19-4d02-a926-642c0f9985c5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:38.843087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b677b8-bd19-4d02-a926-642c0f9985c5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:38.849793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7e82e-55cb-4294-b6a8-7241428c82e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:38.850539 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7e82e-55cb-4294-b6a8-7241428c82e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:38.850739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7e82e-55cb-4294-b6a8-7241428c82e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:38.851079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7e82e-55cb-4294-b6a8-7241428c82e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:38.851677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7e82e-55cb-4294-b6a8-7241428c82e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:38.851947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7e82e-55cb-4294-b6a8-7241428c82e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:38.855912 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7e82e-55cb-4294-b6a8-7241428c82e1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:38.884469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e67579-fae3-4a67-9310-109c3b24be8d None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:38.886737 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-14e67579-fae3-4a67-9310-109c3b24be8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:38.890485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1042/2119] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:29:38.895746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7e82e-55cb-4294-b6a8-7241428c82e1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:38.909582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e67579-fae3-4a67-9310-109c3b24be8d None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:38.915881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:38.916998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:38.917344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:38.917847 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d admin admin] PATH_INFO: `/v3/projects/8f4a68ff64644eaf8e9044790e09100a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:38.919507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4a68ff64644eaf8e9044790e09100a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:38.922267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:38.950986 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7e82e-55cb-4294-b6a8-7241428c82e1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:38.964916 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58113ed2-b9fe-42d1-a117-d2dbbde943f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:38.966189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58113ed2-b9fe-42d1-a117-d2dbbde943f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:38.966544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58113ed2-b9fe-42d1-a117-d2dbbde943f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:38.968057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58113ed2-b9fe-42d1-a117-d2dbbde943f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:38.974549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58113ed2-b9fe-42d1-a117-d2dbbde943f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:38.982045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58113ed2-b9fe-42d1-a117-d2dbbde943f9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.013719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4a68ff64644eaf8e9044790e09100a', 'request_id': 'req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:39.021484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4a68ff64644eaf8e9044790e09100a', 'request_id': 'req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:39.032104 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4a68ff64644eaf8e9044790e09100a', 'request_id': 'req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:39.060795 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1043/2120] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:38 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:39.060996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d admin admin] The token cache is being invalidate because project 8f4a68ff64644eaf8e9044790e09100a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:39.060996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:39.061575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-eb2f089f-bb8d-4bbd-9d1f-c0d5c2e5729d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:39.061959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58113ed2-b9fe-42d1-a117-d2dbbde943f9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.065019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-58113ed2-b9fe-42d1-a117-d2dbbde943f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:39.066618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1078/2121] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:38 2022] DELETE /identity/v3/projects/8f4a68ff64644eaf8e9044790e09100a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:39.069314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597f4f7-1c1a-4076-94c7-0685098f4e7b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.069797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597f4f7-1c1a-4076-94c7-0685098f4e7b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.070145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597f4f7-1c1a-4076-94c7-0685098f4e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.097084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-d597f4f7-1c1a-4076-94c7-0685098f4e7b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:39.098617 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d597f4f7-1c1a-4076-94c7-0685098f4e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:39.160775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58113ed2-b9fe-42d1-a117-d2dbbde943f9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.178610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e54f3c-f0b8-4881-8b7d-4a2326a40e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.179238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e54f3c-f0b8-4881-8b7d-4a2326a40e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.179519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e54f3c-f0b8-4881-8b7d-4a2326a40e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.179791 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e54f3c-f0b8-4881-8b7d-4a2326a40e89 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.180429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e54f3c-f0b8-4881-8b7d-4a2326a40e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.183366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e54f3c-f0b8-4881-8b7d-4a2326a40e89 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.189107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1079/2122] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:39.192513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454164c-1547-4f4a-bae1-e01924a8310a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.192802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454164c-1547-4f4a-bae1-e01924a8310a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.193078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454164c-1547-4f4a-bae1-e01924a8310a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.206000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1044/2123] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:39 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:39.209881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e54f3c-f0b8-4881-8b7d-4a2326a40e89 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.215160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b454164c-1547-4f4a-bae1-e01924a8310a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:39.216398 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b454164c-1547-4f4a-bae1-e01924a8310a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:39.220127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e54f3c-f0b8-4881-8b7d-4a2326a40e89 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.224904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1080/2124] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:39.225020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf061c5d-7edc-4660-ac49-e54fd622d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.225420 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf061c5d-7edc-4660-ac49-e54fd622d9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.225696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf061c5d-7edc-4660-ac49-e54fd622d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.225969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf061c5d-7edc-4660-ac49-e54fd622d9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.226645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf061c5d-7edc-4660-ac49-e54fd622d9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.228317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf061c5d-7edc-4660-ac49-e54fd622d9e5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.229157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454164c-1547-4f4a-bae1-e01924a8310a None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.238609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454164c-1547-4f4a-bae1-e01924a8310a None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.238853 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1045/2125] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:39.242686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf061c5d-7edc-4660-ac49-e54fd622d9e5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.244349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213de8f-968f-4bca-8324-f846d402da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.245067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213de8f-968f-4bca-8324-f846d402da96 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.245342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213de8f-968f-4bca-8324-f846d402da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.245610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213de8f-968f-4bca-8324-f846d402da96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.246247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213de8f-968f-4bca-8324-f846d402da96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:39.246576 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213de8f-968f-4bca-8324-f846d402da96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.248218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213de8f-968f-4bca-8324-f846d402da96 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.253020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf061c5d-7edc-4660-ac49-e54fd622d9e5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.257905 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c40628-871a-43ec-9f3a-5f79ae97a804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.258527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c40628-871a-43ec-9f3a-5f79ae97a804 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.258809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c40628-871a-43ec-9f3a-5f79ae97a804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.259719 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c40628-871a-43ec-9f3a-5f79ae97a804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.260375 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c40628-871a-43ec-9f3a-5f79ae97a804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.260699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1081/2126] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:29:39.264902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213de8f-968f-4bca-8324-f846d402da96 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.265284 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c40628-871a-43ec-9f3a-5f79ae97a804 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.275090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213de8f-968f-4bca-8324-f846d402da96 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.280002 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1046/2127] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:39.281459 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c40628-871a-43ec-9f3a-5f79ae97a804 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.285376 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498659a-6dd1-48ab-a153-795d45e11399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.286022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498659a-6dd1-48ab-a153-795d45e11399 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.286305 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498659a-6dd1-48ab-a153-795d45e11399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.286779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498659a-6dd1-48ab-a153-795d45e11399 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.287240 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498659a-6dd1-48ab-a153-795d45e11399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.289158 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498659a-6dd1-48ab-a153-795d45e11399 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.292083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c40628-871a-43ec-9f3a-5f79ae97a804 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.297476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79c2aa-b578-4cf0-89bd-d8b7433d93ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.298340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79c2aa-b578-4cf0-89bd-d8b7433d93ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.298741 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79c2aa-b578-4cf0-89bd-d8b7433d93ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.299082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79c2aa-b578-4cf0-89bd-d8b7433d93ff admin admin] PATH_INFO: `/v3/projects/20b8cda10691459e9d9dda770f9e53d2/users/b8dfb50987a345758e414693c856f2e5/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.304176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:39.318977 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79c2aa-b578-4cf0-89bd-d8b7433d93ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b8cda10691459e9d9dda770f9e53d2, user_id=b8dfb50987a345758e414693c856f2e5, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.323442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79c2aa-b578-4cf0-89bd-d8b7433d93ff admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.344366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1082/2128] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:39 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:29:39.350417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1047/2129] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:39 2022] PUT /identity/v3/projects/20b8cda10691459e9d9dda770f9e53d2/users/b8dfb50987a345758e414693c856f2e5/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:39.350778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498659a-6dd1-48ab-a153-795d45e11399 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.361659 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bd861-fcc2-4862-bde1-504f9231510f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.362191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bd861-fcc2-4862-bde1-504f9231510f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.362793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bd861-fcc2-4862-bde1-504f9231510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.414873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-168bd861-fcc2-4862-bde1-504f9231510f None None] MFA Rules not processed for user `b8dfb50987a345758e414693c856f2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:39.417079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-168bd861-fcc2-4862-bde1-504f9231510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:39.457754 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498659a-6dd1-48ab-a153-795d45e11399 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.463207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa801b-f71d-4619-87f4-fcc0cfa4a5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.463850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa801b-f71d-4619-87f4-fcc0cfa4a5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.464127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa801b-f71d-4619-87f4-fcc0cfa4a5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.464394 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa801b-f71d-4619-87f4-fcc0cfa4a5f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.465048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa801b-f71d-4619-87f4-fcc0cfa4a5f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.467023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa801b-f71d-4619-87f4-fcc0cfa4a5f1 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.479969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:39.490440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1083/2130] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:39 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:39.495252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa801b-f71d-4619-87f4-fcc0cfa4a5f1 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.507083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1048/2131] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:39.508012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa801b-f71d-4619-87f4-fcc0cfa4a5f1 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.512906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bd861-fcc2-4862-bde1-504f9231510f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.514109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac5ffd-3ef4-4873-a0d7-333cde8fe77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.514766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac5ffd-3ef4-4873-a0d7-333cde8fe77f admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.515057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac5ffd-3ef4-4873-a0d7-333cde8fe77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.515467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac5ffd-3ef4-4873-a0d7-333cde8fe77f admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.516087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac5ffd-3ef4-4873-a0d7-333cde8fe77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.517655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac5ffd-3ef4-4873-a0d7-333cde8fe77f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.527290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bd861-fcc2-4862-bde1-504f9231510f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.529108 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1084/2132] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:39.534134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac5ffd-3ef4-4873-a0d7-333cde8fe77f admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.536613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3830d-fbee-4b35-b16f-99e8008910d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.538645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3830d-fbee-4b35-b16f-99e8008910d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.539161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3830d-fbee-4b35-b16f-99e8008910d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.539654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3830d-fbee-4b35-b16f-99e8008910d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.541944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3830d-fbee-4b35-b16f-99e8008910d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.544120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3830d-fbee-4b35-b16f-99e8008910d4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.545353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac5ffd-3ef4-4873-a0d7-333cde8fe77f admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.550338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4520b7-65e0-4d2e-8da3-e26b75e05192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.550961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4520b7-65e0-4d2e-8da3-e26b75e05192 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.551245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4520b7-65e0-4d2e-8da3-e26b75e05192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.551520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4520b7-65e0-4d2e-8da3-e26b75e05192 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.552180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4520b7-65e0-4d2e-8da3-e26b75e05192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.553770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4520b7-65e0-4d2e-8da3-e26b75e05192 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.565896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1085/2133] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:39.572824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4520b7-65e0-4d2e-8da3-e26b75e05192 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.580127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1049/2134] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:39 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:39.586612 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3830d-fbee-4b35-b16f-99e8008910d4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.590928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4520b7-65e0-4d2e-8da3-e26b75e05192 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.663136 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3830d-fbee-4b35-b16f-99e8008910d4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.677140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680e306-bd6a-4c4e-9143-89c778e141b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.677868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680e306-bd6a-4c4e-9143-89c778e141b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.678252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680e306-bd6a-4c4e-9143-89c778e141b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.678571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680e306-bd6a-4c4e-9143-89c778e141b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.679279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680e306-bd6a-4c4e-9143-89c778e141b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.681294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27eb4f0-f1b0-4e26-a46d-150ed7d53208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.681618 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680e306-bd6a-4c4e-9143-89c778e141b9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.682301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27eb4f0-f1b0-4e26-a46d-150ed7d53208 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.682619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27eb4f0-f1b0-4e26-a46d-150ed7d53208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.682896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27eb4f0-f1b0-4e26-a46d-150ed7d53208 admin admin] PATH_INFO: `/v3/projects/5335e5b4aa974213880ad23d6ea9d35d/users/3466ff657e8946ecbb93b62e94e89822/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.711374 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1050/2135] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:39 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:39.715934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680e306-bd6a-4c4e-9143-89c778e141b9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.723438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27eb4f0-f1b0-4e26-a46d-150ed7d53208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5335e5b4aa974213880ad23d6ea9d35d, user_id=3466ff657e8946ecbb93b62e94e89822, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.729603 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27eb4f0-f1b0-4e26-a46d-150ed7d53208 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.732154 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680e306-bd6a-4c4e-9143-89c778e141b9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.738462 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c95fbd-ab25-4fdc-aaea-e19f2cf2b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.739640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95fbd-ab25-4fdc-aaea-e19f2cf2b0be admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.740025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95fbd-ab25-4fdc-aaea-e19f2cf2b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.740316 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95fbd-ab25-4fdc-aaea-e19f2cf2b0be admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.741098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c95fbd-ab25-4fdc-aaea-e19f2cf2b0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.742925 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c95fbd-ab25-4fdc-aaea-e19f2cf2b0be admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.762439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1051/2136] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:39.762660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1086/2137] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:39 2022] PUT /identity/v3/projects/5335e5b4aa974213880ad23d6ea9d35d/users/3466ff657e8946ecbb93b62e94e89822/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:39.764535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c95fbd-ab25-4fdc-aaea-e19f2cf2b0be admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.773529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee4f89-10a5-4d52-9416-d65f607cd54f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.774100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee4f89-10a5-4d52-9416-d65f607cd54f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.775222 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee4f89-10a5-4d52-9416-d65f607cd54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.786098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c95fbd-ab25-4fdc-aaea-e19f2cf2b0be admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:39.823364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-2bee4f89-10a5-4d52-9416-d65f607cd54f None None] MFA Rules not processed for user `3466ff657e8946ecbb93b62e94e89822`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:39.826105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2bee4f89-10a5-4d52-9416-d65f607cd54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:39.850097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e66f8c-100c-4331-8f1d-82a09a54b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:39.850800 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66f8c-100c-4331-8f1d-82a09a54b379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:39.851199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66f8c-100c-4331-8f1d-82a09a54b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:39.851476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66f8c-100c-4331-8f1d-82a09a54b379 admin admin] PATH_INFO: `/v3/projects/3c0d6aec2fed44f1bc9141a8cc8cdb2a/users/6314b0fca718409cba9fbe486df4960f/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:39.871912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:39.872100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e66f8c-100c-4331-8f1d-82a09a54b379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c0d6aec2fed44f1bc9141a8cc8cdb2a, user_id=6314b0fca718409cba9fbe486df4960f, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:39.874867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e66f8c-100c-4331-8f1d-82a09a54b379 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:39.896342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1052/2138] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:39 2022] PUT /identity/v3/projects/3c0d6aec2fed44f1bc9141a8cc8cdb2a/users/6314b0fca718409cba9fbe486df4960f/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:39.900752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e66f8c-100c-4331-8f1d-82a09a54b379 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.934993 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1087/2139] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:39.946962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee4f89-10a5-4d52-9416-d65f607cd54f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:39.948451 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2bee4f89-10a5-4d52-9416-d65f607cd54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:39.953901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:39.999063 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e66f8c-100c-4331-8f1d-82a09a54b379 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:40.004397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329175b0-9a2b-49cb-8a2b-afd5ae467232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:40.005020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329175b0-9a2b-49cb-8a2b-afd5ae467232 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:40.005305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329175b0-9a2b-49cb-8a2b-afd5ae467232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:40.005584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329175b0-9a2b-49cb-8a2b-afd5ae467232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:40.006244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329175b0-9a2b-49cb-8a2b-afd5ae467232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:40.007906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329175b0-9a2b-49cb-8a2b-afd5ae467232 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:40.021900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1053/2140] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:29:40.022963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329175b0-9a2b-49cb-8a2b-afd5ae467232 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:40.033408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329175b0-9a2b-49cb-8a2b-afd5ae467232 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:40.034627 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee4f89-10a5-4d52-9416-d65f607cd54f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:40.038207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d78b13-7a45-4686-8969-f48317bdaf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:40.039034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d78b13-7a45-4686-8969-f48317bdaf95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:40.039320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d78b13-7a45-4686-8969-f48317bdaf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:40.039601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d78b13-7a45-4686-8969-f48317bdaf95 admin admin] PATH_INFO: `/v3/projects/3c0d6aec2fed44f1bc9141a8cc8cdb2a/users/6314b0fca718409cba9fbe486df4960f/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:40.042631 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d78b13-7a45-4686-8969-f48317bdaf95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c0d6aec2fed44f1bc9141a8cc8cdb2a, user_id=6314b0fca718409cba9fbe486df4960f, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:40.045537 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d78b13-7a45-4686-8969-f48317bdaf95 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:40.057162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1054/2141] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:40 2022] PUT /identity/v3/projects/3c0d6aec2fed44f1bc9141a8cc8cdb2a/users/6314b0fca718409cba9fbe486df4960f/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:40.067384 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9b7a0-45ab-43d6-a445-50c22594c3c7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:40.067708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9b7a0-45ab-43d6-a445-50c22594c3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:40.067993 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9b7a0-45ab-43d6-a445-50c22594c3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:40.111753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fcb9b7a0-45ab-43d6-a445-50c22594c3c7 None None] MFA Rules not processed for user `6314b0fca718409cba9fbe486df4960f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:40.111753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fcb9b7a0-45ab-43d6-a445-50c22594c3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:40.137135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d4ea1-9d98-43d9-a068-36a1ffc5448f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:40.139137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d4ea1-9d98-43d9-a068-36a1ffc5448f service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:40.139415 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d4ea1-9d98-43d9-a068-36a1ffc5448f service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:40.139687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d4ea1-9d98-43d9-a068-36a1ffc5448f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:40.206743 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1055/2142] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:29:40.217479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9b7a0-45ab-43d6-a445-50c22594c3c7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:40.220152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fcb9b7a0-45ab-43d6-a445-50c22594c3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:40.233825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d4ea1-9d98-43d9-a068-36a1ffc5448f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:40.235527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d4ea1-9d98-43d9-a068-36a1ffc5448f service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:40.259466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1088/2143] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:40.295863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9b7a0-45ab-43d6-a445-50c22594c3c7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:40.300084 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066318c-3516-4032-a98c-6b643de5e9a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:40.300713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066318c-3516-4032-a98c-6b643de5e9a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:40.301051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066318c-3516-4032-a98c-6b643de5e9a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:40.301336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066318c-3516-4032-a98c-6b643de5e9a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:40.366366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:40.373110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066318c-3516-4032-a98c-6b643de5e9a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:40.374736 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066318c-3516-4032-a98c-6b643de5e9a1 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:40.401636 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1056/2144] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:44.163799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d4ea1-9d98-43d9-a068-36a1ffc5448f service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:44.175245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d4ea1-9d98-43d9-a068-36a1ffc5448f service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:44.218663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:44.239324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:44.240008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:44.240281 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:44.240545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] PATH_INFO: `/v3/users/b8dfb50987a345758e414693c856f2e5` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:44.241760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8dfb50987a345758e414693c856f2e5)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:44.243969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:44.304761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8dfb50987a345758e414693c856f2e5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:44.312068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8dfb50987a345758e414693c856f2e5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:44.326366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8dfb50987a345758e414693c856f2e5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:44.327279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8dfb50987a345758e414693c856f2e5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:44.327907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8dfb50987a345758e414693c856f2e5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:44.340822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1089/2145] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:44 2022] DELETE /identity/v3/users/b8dfb50987a345758e414693c856f2e5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:44.345332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c079d-b117-4ff2-83a9-dd502aa6c4d4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:44.345794 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c079d-b117-4ff2-83a9-dd502aa6c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:44.346025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c079d-b117-4ff2-83a9-dd502aa6c4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:44.367754 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-677c079d-b117-4ff2-83a9-dd502aa6c4d4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:44.369027 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-677c079d-b117-4ff2-83a9-dd502aa6c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:44.441852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1057/2146] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:44.451735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:44.453157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:44.532380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e3da-4ff2-4b50-b4ab-58a900f18fc0 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:44.536653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c15a-313c-479e-a32d-1969c5243362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:44.537383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c15a-313c-479e-a32d-1969c5243362 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:44.537759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c15a-313c-479e-a32d-1969c5243362 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:44.538140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c15a-313c-479e-a32d-1969c5243362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:44.550595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957c15a-313c-479e-a32d-1969c5243362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:44.555551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957c15a-313c-479e-a32d-1969c5243362 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:44.581486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1090/2147] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:44.877555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c079d-b117-4ff2-83a9-dd502aa6c4d4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:44.879545 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-677c079d-b117-4ff2-83a9-dd502aa6c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:44.929071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c079d-b117-4ff2-83a9-dd502aa6c4d4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:44.935130 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:44.935770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:44.936045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:44.936317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] PATH_INFO: `/v3/projects/20b8cda10691459e9d9dda770f9e53d2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:44.937431 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b8cda10691459e9d9dda770f9e53d2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:44.939405 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:44.988160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b8cda10691459e9d9dda770f9e53d2', 'request_id': 'req-df71a904-74c4-404f-8a33-b7a8c9d4a756'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:44.996590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b8cda10691459e9d9dda770f9e53d2', 'request_id': 'req-df71a904-74c4-404f-8a33-b7a8c9d4a756'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.006749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b8cda10691459e9d9dda770f9e53d2', 'request_id': 'req-df71a904-74c4-404f-8a33-b7a8c9d4a756'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.019001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] The token cache is being invalidate because project 20b8cda10691459e9d9dda770f9e53d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:45.019288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.019970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.021576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1058/2148] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:44 2022] DELETE /identity/v3/projects/20b8cda10691459e9d9dda770f9e53d2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:45.027194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c15a-313c-479e-a32d-1969c5243362 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:45.038536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c15a-313c-479e-a32d-1969c5243362 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:45.127954 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:45.128941 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:45.129317 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:45.129754 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] PATH_INFO: `/v3/users/6314b0fca718409cba9fbe486df4960f` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:45.131144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6314b0fca718409cba9fbe486df4960f)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:45.133628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:45.146609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:45.213278 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6314b0fca718409cba9fbe486df4960f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.246942 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6314b0fca718409cba9fbe486df4960f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.261602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6314b0fca718409cba9fbe486df4960f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.262337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6314b0fca718409cba9fbe486df4960f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.263028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6314b0fca718409cba9fbe486df4960f'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.279911 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1091/2149] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:45 2022] DELETE /identity/v3/users/6314b0fca718409cba9fbe486df4960f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:45.596970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:45.599291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:45.654640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:45.656669 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:45.708257 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71a904-74c4-404f-8a33-b7a8c9d4a756 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:45.755734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:45.768079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90a06-766f-4d64-9241-160d7c09ac9d admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:45.773770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eae9cf-b952-452d-998f-02db9750235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:45.774990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eae9cf-b952-452d-998f-02db9750235b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:45.775480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eae9cf-b952-452d-998f-02db9750235b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:45.775823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eae9cf-b952-452d-998f-02db9750235b admin admin] PATH_INFO: `/v3/projects/3c0d6aec2fed44f1bc9141a8cc8cdb2a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:45.777330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eae9cf-b952-452d-998f-02db9750235b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c0d6aec2fed44f1bc9141a8cc8cdb2a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:45.779772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eae9cf-b952-452d-998f-02db9750235b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:45.784051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc082cf7-94a9-4336-bd78-99caf6972190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:45.784680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082cf7-94a9-4336-bd78-99caf6972190 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:45.784967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082cf7-94a9-4336-bd78-99caf6972190 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:45.785246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082cf7-94a9-4336-bd78-99caf6972190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:45.787262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fc082cf7-94a9-4336-bd78-99caf6972190 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:45.881619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-97eae9cf-b952-452d-998f-02db9750235b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c0d6aec2fed44f1bc9141a8cc8cdb2a', 'request_id': 'req-97eae9cf-b952-452d-998f-02db9750235b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.886037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc082cf7-94a9-4336-bd78-99caf6972190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:45.888977 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc082cf7-94a9-4336-bd78-99caf6972190 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:45.892011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-97eae9cf-b952-452d-998f-02db9750235b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c0d6aec2fed44f1bc9141a8cc8cdb2a', 'request_id': 'req-97eae9cf-b952-452d-998f-02db9750235b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.897242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-97eae9cf-b952-452d-998f-02db9750235b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c0d6aec2fed44f1bc9141a8cc8cdb2a', 'request_id': 'req-97eae9cf-b952-452d-998f-02db9750235b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.907624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1059/2150] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:45.928330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-97eae9cf-b952-452d-998f-02db9750235b admin admin] The token cache is being invalidate because project 3c0d6aec2fed44f1bc9141a8cc8cdb2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:45.928927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-97eae9cf-b952-452d-998f-02db9750235b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.930058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-97eae9cf-b952-452d-998f-02db9750235b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:45.932763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1092/2151] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:45 2022] DELETE /identity/v3/projects/3c0d6aec2fed44f1bc9141a8cc8cdb2a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:45.937629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1339-d0e9-4603-af2b-40df11849ca8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:45.937926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1339-d0e9-4603-af2b-40df11849ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:45.938265 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1339-d0e9-4603-af2b-40df11849ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:45.959074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4aee1339-d0e9-4603-af2b-40df11849ca8 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:45.960281 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4aee1339-d0e9-4603-af2b-40df11849ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:46.043999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1060/2152] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:46.051790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500350c-571a-4a97-9ed2-b4a4a3ce3b2d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:46.052083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500350c-571a-4a97-9ed2-b4a4a3ce3b2d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:46.052357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500350c-571a-4a97-9ed2-b4a4a3ce3b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:46.085169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-8500350c-571a-4a97-9ed2-b4a4a3ce3b2d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:46.086660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8500350c-571a-4a97-9ed2-b4a4a3ce3b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:46.095918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1093/2153] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:46.100996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee1339-d0e9-4603-af2b-40df11849ca8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:46.113706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee1339-d0e9-4603-af2b-40df11849ca8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:46.119492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3374d8f-fa2e-4469-a8e7-0b536423e296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:46.120262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3374d8f-fa2e-4469-a8e7-0b536423e296 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:46.120538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3374d8f-fa2e-4469-a8e7-0b536423e296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:46.120793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3374d8f-fa2e-4469-a8e7-0b536423e296 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:46.121457 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3374d8f-fa2e-4469-a8e7-0b536423e296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:46.121743 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3374d8f-fa2e-4469-a8e7-0b536423e296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:46.123385 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3374d8f-fa2e-4469-a8e7-0b536423e296 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:46.137413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1061/2154] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:29:46.141937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500350c-571a-4a97-9ed2-b4a4a3ce3b2d None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:46.151368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500350c-571a-4a97-9ed2-b4a4a3ce3b2d None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:46.155902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b353f-11c2-4fae-97b1-e75d4959249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:46.156489 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b353f-11c2-4fae-97b1-e75d4959249d admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:46.156761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b353f-11c2-4fae-97b1-e75d4959249d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:46.157026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b353f-11c2-4fae-97b1-e75d4959249d admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:46.157682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b353f-11c2-4fae-97b1-e75d4959249d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:46.159577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b353f-11c2-4fae-97b1-e75d4959249d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:46.163938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:46.191543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1094/2155] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:46 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:46.196126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3374d8f-fa2e-4469-a8e7-0b536423e296 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:46.206349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3374d8f-fa2e-4469-a8e7-0b536423e296 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:46.261967 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea355a8-b2ab-4f43-b24f-5853724b49ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:46.262529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea355a8-b2ab-4f43-b24f-5853724b49ef admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:46.262814 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea355a8-b2ab-4f43-b24f-5853724b49ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:46.263090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea355a8-b2ab-4f43-b24f-5853724b49ef admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:46.263713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea355a8-b2ab-4f43-b24f-5853724b49ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:46.265653 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea355a8-b2ab-4f43-b24f-5853724b49ef admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:46.282000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:46.291839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1062/2156] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:46 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:46.292872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b353f-11c2-4fae-97b1-e75d4959249d admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:46.303015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b353f-11c2-4fae-97b1-e75d4959249d admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:46.308203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc257f4c-788d-4a19-abcd-9fb60f43c2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:46.308800 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc257f4c-788d-4a19-abcd-9fb60f43c2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:46.309076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc257f4c-788d-4a19-abcd-9fb60f43c2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:46.309344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc257f4c-788d-4a19-abcd-9fb60f43c2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:46.309971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc257f4c-788d-4a19-abcd-9fb60f43c2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:46.311595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc257f4c-788d-4a19-abcd-9fb60f43c2e9 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:46.321479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1095/2157] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:46.325433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea355a8-b2ab-4f43-b24f-5853724b49ef admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:46.335242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea355a8-b2ab-4f43-b24f-5853724b49ef admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:46.340039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516857cc-38c8-47c0-b397-c4dfd2d0c409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:46.340633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516857cc-38c8-47c0-b397-c4dfd2d0c409 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:46.340912 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516857cc-38c8-47c0-b397-c4dfd2d0c409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:46.341183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516857cc-38c8-47c0-b397-c4dfd2d0c409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:46.341818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516857cc-38c8-47c0-b397-c4dfd2d0c409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:46.343453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516857cc-38c8-47c0-b397-c4dfd2d0c409 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:46.356856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1063/2158] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:46.360912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc257f4c-788d-4a19-abcd-9fb60f43c2e9 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:46.371522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc257f4c-788d-4a19-abcd-9fb60f43c2e9 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:46.376333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5295a-bdbf-4e6b-a289-a514f5988402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:46.376985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5295a-bdbf-4e6b-a289-a514f5988402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:46.377265 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5295a-bdbf-4e6b-a289-a514f5988402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:46.377649 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5295a-bdbf-4e6b-a289-a514f5988402 admin admin] PATH_INFO: `/v3/projects/085cc100372d48adb7c6ac1d27d74a52/users/e064c32007aa4f7994e81f5694b2bd14/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:46.392825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5295a-bdbf-4e6b-a289-a514f5988402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085cc100372d48adb7c6ac1d27d74a52, user_id=e064c32007aa4f7994e81f5694b2bd14, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:46.395544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5295a-bdbf-4e6b-a289-a514f5988402 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:46.408009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1096/2159] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:46 2022] PUT /identity/v3/projects/085cc100372d48adb7c6ac1d27d74a52/users/e064c32007aa4f7994e81f5694b2bd14/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:46.420136 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c489b-c7f7-4857-bc26-c49435ae9644 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:46.420422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c489b-c7f7-4857-bc26-c49435ae9644 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:46.420694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c489b-c7f7-4857-bc26-c49435ae9644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:46.449763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f79c489b-c7f7-4857-bc26-c49435ae9644 None None] MFA Rules not processed for user `e064c32007aa4f7994e81f5694b2bd14`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:46.450997 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f79c489b-c7f7-4857-bc26-c49435ae9644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:46.518513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1064/2160] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:46.531333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5295a-bdbf-4e6b-a289-a514f5988402 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:46.532673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d6b5295a-bdbf-4e6b-a289-a514f5988402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:46.599267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5295a-bdbf-4e6b-a289-a514f5988402 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:46.601581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b5178-9311-4102-9447-1e9b6b2aadb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:46.603526 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b5178-9311-4102-9447-1e9b6b2aadb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:46.603856 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b5178-9311-4102-9447-1e9b6b2aadb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:46.604216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b5178-9311-4102-9447-1e9b6b2aadb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:46.615253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b5178-9311-4102-9447-1e9b6b2aadb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:46.616796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b5178-9311-4102-9447-1e9b6b2aadb4 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:46.627079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1097/2161] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:46 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:51.755134 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c489b-c7f7-4857-bc26-c49435ae9644 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:51.821775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c489b-c7f7-4857-bc26-c49435ae9644 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:51.826351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:51.827008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:51.827347 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:51.827610 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] PATH_INFO: `/v3/users/e064c32007aa4f7994e81f5694b2bd14` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:51.828763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e064c32007aa4f7994e81f5694b2bd14)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:51.830819 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:51.878405 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e064c32007aa4f7994e81f5694b2bd14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:51.885439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e064c32007aa4f7994e81f5694b2bd14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:51.898711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e064c32007aa4f7994e81f5694b2bd14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:51.900109 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e064c32007aa4f7994e81f5694b2bd14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:51.900895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e064c32007aa4f7994e81f5694b2bd14'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:51.908342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:51.915933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1065/2162] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:51 2022] DELETE /identity/v3/users/e064c32007aa4f7994e81f5694b2bd14 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:51.920967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebbd31-c346-4281-98ff-90074fbdec00 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:51.921447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebbd31-c346-4281-98ff-90074fbdec00 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:51.921547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebbd31-c346-4281-98ff-90074fbdec00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:51.940208 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-45ebbd31-c346-4281-98ff-90074fbdec00 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:51.941338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-45ebbd31-c346-4281-98ff-90074fbdec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:51.999387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1098/2163] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:52.010061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:52.011612 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:52.073336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e535-3b96-4ab5-b304-054efd5480a4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:52.077045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d804e6-74da-4fe3-b4d7-0b10da77c56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:52.077650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d804e6-74da-4fe3-b4d7-0b10da77c56d service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:52.077929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d804e6-74da-4fe3-b4d7-0b10da77c56d service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:52.078203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d804e6-74da-4fe3-b4d7-0b10da77c56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:52.087280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d804e6-74da-4fe3-b4d7-0b10da77c56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:52.088896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d804e6-74da-4fe3-b4d7-0b10da77c56d service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:52.098551 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1066/2164] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:29:52.459578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebbd31-c346-4281-98ff-90074fbdec00 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:52.461121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-45ebbd31-c346-4281-98ff-90074fbdec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:52.474014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebbd31-c346-4281-98ff-90074fbdec00 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:52.480044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:52.480700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:52.480978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:52.481248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] PATH_INFO: `/v3/projects/085cc100372d48adb7c6ac1d27d74a52` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:52.482424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=085cc100372d48adb7c6ac1d27d74a52)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:52.484929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:52.537934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:52.539457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085cc100372d48adb7c6ac1d27d74a52', 'request_id': 'req-5742900c-2901-47cb-af9d-28f820bd4066'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:52.552868 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085cc100372d48adb7c6ac1d27d74a52', 'request_id': 'req-5742900c-2901-47cb-af9d-28f820bd4066'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:52.572210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085cc100372d48adb7c6ac1d27d74a52', 'request_id': 'req-5742900c-2901-47cb-af9d-28f820bd4066'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:52.603893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] The token cache is being invalidate because project 085cc100372d48adb7c6ac1d27d74a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:52.604865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:52.605819 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:52.608384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1099/2165] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:52 2022] DELETE /identity/v3/projects/085cc100372d48adb7c6ac1d27d74a52 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:56.976777 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d804e6-74da-4fe3-b4d7-0b10da77c56d service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:56.978209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b1d804e6-74da-4fe3-b4d7-0b10da77c56d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:56.991953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d804e6-74da-4fe3-b4d7-0b10da77c56d service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:57.050694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e98c9-743d-482e-a6d8-2813b45d429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:57.051344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e98c9-743d-482e-a6d8-2813b45d429c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:57.051626 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e98c9-743d-482e-a6d8-2813b45d429c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:57.051903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e98c9-743d-482e-a6d8-2813b45d429c admin admin] PATH_INFO: `/v3/users/b13cd0222e264cc8b6212b7c3ce9efb8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:57.053034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e98c9-743d-482e-a6d8-2813b45d429c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13cd0222e264cc8b6212b7c3ce9efb8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:57.055020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e98c9-743d-482e-a6d8-2813b45d429c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:57.101415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b1e98c9-743d-482e-a6d8-2813b45d429c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13cd0222e264cc8b6212b7c3ce9efb8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:57.110019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b1e98c9-743d-482e-a6d8-2813b45d429c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13cd0222e264cc8b6212b7c3ce9efb8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:57.123057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b1e98c9-743d-482e-a6d8-2813b45d429c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13cd0222e264cc8b6212b7c3ce9efb8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:57.124070 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b1e98c9-743d-482e-a6d8-2813b45d429c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13cd0222e264cc8b6212b7c3ce9efb8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:57.124717 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b1e98c9-743d-482e-a6d8-2813b45d429c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13cd0222e264cc8b6212b7c3ce9efb8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:57.139080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1067/2166] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:29:56 2022] DELETE /identity/v3/users/b13cd0222e264cc8b6212b7c3ce9efb8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:57.328249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:57.329812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:57.357873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742900c-2901-47cb-af9d-28f820bd4066 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:57.441264 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e099f-16ee-4568-aca2-d19cc64aa98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:57.441904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e099f-16ee-4568-aca2-d19cc64aa98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:57.442218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e099f-16ee-4568-aca2-d19cc64aa98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:57.442706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e099f-16ee-4568-aca2-d19cc64aa98c admin admin] PATH_INFO: `/v3/projects/e1dc5e20d199461eb674a0b5dc8d66ef` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:57.443906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e099f-16ee-4568-aca2-d19cc64aa98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1dc5e20d199461eb674a0b5dc8d66ef)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:57.446086 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e099f-16ee-4568-aca2-d19cc64aa98c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:57.516346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1b7e099f-16ee-4568-aca2-d19cc64aa98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1dc5e20d199461eb674a0b5dc8d66ef', 'request_id': 'req-1b7e099f-16ee-4568-aca2-d19cc64aa98c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:57.525655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1b7e099f-16ee-4568-aca2-d19cc64aa98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1dc5e20d199461eb674a0b5dc8d66ef', 'request_id': 'req-1b7e099f-16ee-4568-aca2-d19cc64aa98c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:57.533630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1b7e099f-16ee-4568-aca2-d19cc64aa98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1dc5e20d199461eb674a0b5dc8d66ef', 'request_id': 'req-1b7e099f-16ee-4568-aca2-d19cc64aa98c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:57.563096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1b7e099f-16ee-4568-aca2-d19cc64aa98c admin admin] The token cache is being invalidate because project e1dc5e20d199461eb674a0b5dc8d66ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:29:57.563700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1b7e099f-16ee-4568-aca2-d19cc64aa98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:57.564632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1b7e099f-16ee-4568-aca2-d19cc64aa98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:29:57.566464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1100/2167] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:29:57 2022] DELETE /identity/v3/projects/e1dc5e20d199461eb674a0b5dc8d66ef => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:29:57.571384 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b395c-076a-4f3d-b709-652ea7b5faca None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:57.571624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b395c-076a-4f3d-b709-652ea7b5faca None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:57.571917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b395c-076a-4f3d-b709-652ea7b5faca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:57.595827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9a8b395c-076a-4f3d-b709-652ea7b5faca None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:57.597099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9a8b395c-076a-4f3d-b709-652ea7b5faca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:57.632957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:57.685810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1068/2168] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:57.694199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91d8a-773b-4821-be22-e020b8442017 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:57.694547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91d8a-773b-4821-be22-e020b8442017 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:57.694780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91d8a-773b-4821-be22-e020b8442017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:57.716918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e3e91d8a-773b-4821-be22-e020b8442017 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:57.718132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e3e91d8a-773b-4821-be22-e020b8442017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:57.726439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1101/2169] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:57.732037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b395c-076a-4f3d-b709-652ea7b5faca None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:57.741296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b395c-076a-4f3d-b709-652ea7b5faca None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:57.746244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86f814-93c3-4cb4-afdc-5f54ce8d8b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:57.746879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f814-93c3-4cb4-afdc-5f54ce8d8b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:57.747156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f814-93c3-4cb4-afdc-5f54ce8d8b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:57.747424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f814-93c3-4cb4-afdc-5f54ce8d8b50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:57.748094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86f814-93c3-4cb4-afdc-5f54ce8d8b50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:29:57.748398 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86f814-93c3-4cb4-afdc-5f54ce8d8b50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:57.750101 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86f814-93c3-4cb4-afdc-5f54ce8d8b50 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:57.765822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1069/2170] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:29:57.766967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e91d8a-773b-4821-be22-e020b8442017 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:57.777704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e91d8a-773b-4821-be22-e020b8442017 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:57.782357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7d4fc-9f07-4fbd-9970-15ae20be99cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:57.782996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7d4fc-9f07-4fbd-9970-15ae20be99cb admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:57.783302 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7d4fc-9f07-4fbd-9970-15ae20be99cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:57.783707 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7d4fc-9f07-4fbd-9970-15ae20be99cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:57.784352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7d4fc-9f07-4fbd-9970-15ae20be99cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:57.786287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7d4fc-9f07-4fbd-9970-15ae20be99cb admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:57.815333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1102/2171] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:29:57 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:29:57.819587 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86f814-93c3-4cb4-afdc-5f54ce8d8b50 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:57.831240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86f814-93c3-4cb4-afdc-5f54ce8d8b50 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:57.896884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4ad49-e056-4570-a10b-45fae85b6475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:57.897506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4ad49-e056-4570-a10b-45fae85b6475 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:57.897790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4ad49-e056-4570-a10b-45fae85b6475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:57.898063 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4ad49-e056-4570-a10b-45fae85b6475 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:57.898747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4ad49-e056-4570-a10b-45fae85b6475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:57.901429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4ad49-e056-4570-a10b-45fae85b6475 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:57.927390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1070/2172] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:29:57 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:29:57.928897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7d4fc-9f07-4fbd-9970-15ae20be99cb admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:57.942884 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7d4fc-9f07-4fbd-9970-15ae20be99cb admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:57.948725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d129fe-2374-4422-86a4-b4048a2437f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:57.949615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d129fe-2374-4422-86a4-b4048a2437f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:57.949897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d129fe-2374-4422-86a4-b4048a2437f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:57.950168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d129fe-2374-4422-86a4-b4048a2437f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:57.950915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d129fe-2374-4422-86a4-b4048a2437f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:57.952572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d129fe-2374-4422-86a4-b4048a2437f7 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:57.963673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1103/2173] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:57.967622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4ad49-e056-4570-a10b-45fae85b6475 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:57.977686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4ad49-e056-4570-a10b-45fae85b6475 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:57.984316 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d29428-12ea-40a2-af75-f37babecd6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:57.985345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d29428-12ea-40a2-af75-f37babecd6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:57.985345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d29428-12ea-40a2-af75-f37babecd6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:57.985616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d29428-12ea-40a2-af75-f37babecd6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:57.986341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d29428-12ea-40a2-af75-f37babecd6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:57.988086 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d29428-12ea-40a2-af75-f37babecd6b9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:58.003774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1071/2174] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:29:58.007763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d129fe-2374-4422-86a4-b4048a2437f7 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:58.020878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d129fe-2374-4422-86a4-b4048a2437f7 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:58.027122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bb2b3-a50b-4fd8-bada-95a98cff0e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:58.027787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bb2b3-a50b-4fd8-bada-95a98cff0e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:58.028067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bb2b3-a50b-4fd8-bada-95a98cff0e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:58.028464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bb2b3-a50b-4fd8-bada-95a98cff0e32 admin admin] PATH_INFO: `/v3/projects/c626f07e739940ef970f9d386bc21638/users/83f5ffa7705f46c2b76fd2c8e91a701d/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:58.047291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bb2b3-a50b-4fd8-bada-95a98cff0e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c626f07e739940ef970f9d386bc21638, user_id=83f5ffa7705f46c2b76fd2c8e91a701d, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:58.050432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bb2b3-a50b-4fd8-bada-95a98cff0e32 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:58.066755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1104/2175] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:29:58 2022] PUT /identity/v3/projects/c626f07e739940ef970f9d386bc21638/users/83f5ffa7705f46c2b76fd2c8e91a701d/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:29:58.071874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd86eb-edb7-40e8-8074-990aa6e89c04 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:58.072229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd86eb-edb7-40e8-8074-990aa6e89c04 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:58.073113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd86eb-edb7-40e8-8074-990aa6e89c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:58.094526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-88cd86eb-edb7-40e8-8074-990aa6e89c04 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:58.095854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-88cd86eb-edb7-40e8-8074-990aa6e89c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:58.167961 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1072/2176] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:58.184508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bb2b3-a50b-4fd8-bada-95a98cff0e32 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:58.186279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b09bb2b3-a50b-4fd8-bada-95a98cff0e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:58.192437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:58.304566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bb2b3-a50b-4fd8-bada-95a98cff0e32 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:58.309598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184444eb-d5bf-45c6-b6e4-6e9f268f1ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:58.310416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184444eb-d5bf-45c6-b6e4-6e9f268f1ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:58.310699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184444eb-d5bf-45c6-b6e4-6e9f268f1ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:58.310958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184444eb-d5bf-45c6-b6e4-6e9f268f1ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:58.323417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184444eb-d5bf-45c6-b6e4-6e9f268f1ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:58.325026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184444eb-d5bf-45c6-b6e4-6e9f268f1ee7 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:58.338633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1105/2177] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:29:59.543366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284cd7e-90a0-47d6-9ac4-f7170ac78848 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:59.548035 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284cd7e-90a0-47d6-9ac4-f7170ac78848 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:59.549388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284cd7e-90a0-47d6-9ac4-f7170ac78848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:59.573827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1284cd7e-90a0-47d6-9ac4-f7170ac78848 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:29:59.575274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1284cd7e-90a0-47d6-9ac4-f7170ac78848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:59.606122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:59.650193 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1073/2178] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:29:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:29:59.703943 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184444eb-d5bf-45c6-b6e4-6e9f268f1ee7 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:29:59.705929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-184444eb-d5bf-45c6-b6e4-6e9f268f1ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:29:59.799505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184444eb-d5bf-45c6-b6e4-6e9f268f1ee7 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:29:59.805145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b5ff7-4e74-4938-8796-da2dfe83364a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:29:59.805859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b5ff7-4e74-4938-8796-da2dfe83364a service swift] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:29:59.806322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b5ff7-4e74-4938-8796-da2dfe83364a service swift] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:29:59.806692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b5ff7-4e74-4938-8796-da2dfe83364a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:29:59.816456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b5ff7-4e74-4938-8796-da2dfe83364a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:29:59.818084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b5ff7-4e74-4938-8796-da2dfe83364a service swift] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:29:59.829189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1106/2179] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:29:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:30:00.827355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ab0f9-2cd7-4004-a718-84eadf8c520d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:00.828533 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ab0f9-2cd7-4004-a718-84eadf8c520d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:00.829052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ab0f9-2cd7-4004-a718-84eadf8c520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:00.855072 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ac4ab0f9-2cd7-4004-a718-84eadf8c520d None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:00.856840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ac4ab0f9-2cd7-4004-a718-84eadf8c520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:00.868174 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1074/2180] 10.222.0.33 () {58 vars in 967 bytes} [Mon Sep 12 23:30:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:00.895962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b5ff7-4e74-4938-8796-da2dfe83364a service swift] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:00.909224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b5ff7-4e74-4938-8796-da2dfe83364a service swift] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:00.915630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eae242-fb5d-4652-8de1-cdd92168e0d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:00.917024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eae242-fb5d-4652-8de1-cdd92168e0d7 service swift] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:00.917024 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eae242-fb5d-4652-8de1-cdd92168e0d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:00.917223 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eae242-fb5d-4652-8de1-cdd92168e0d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:00.927822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eae242-fb5d-4652-8de1-cdd92168e0d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:00.929437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eae242-fb5d-4652-8de1-cdd92168e0d7 service swift] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:00.942658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1107/2181] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:30:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 23:30:01.241211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed06ba2-fa60-4394-8ed8-d39be4fbdbdb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:01.241450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed06ba2-fa60-4394-8ed8-d39be4fbdbdb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:01.242023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed06ba2-fa60-4394-8ed8-d39be4fbdbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:01.264332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3ed06ba2-fa60-4394-8ed8-d39be4fbdbdb None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:01.265580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3ed06ba2-fa60-4394-8ed8-d39be4fbdbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:01.273640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1075/2182] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:30:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:30:01.287031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eae242-fb5d-4652-8de1-cdd92168e0d7 service swift] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:01.299542 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eae242-fb5d-4652-8de1-cdd92168e0d7 service swift] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:01.304305 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4c479-aa81-4801-b6ef-7f0e4f93d636 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:01.304912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4c479-aa81-4801-b6ef-7f0e4f93d636 service swift] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:01.305186 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4c479-aa81-4801-b6ef-7f0e4f93d636 service swift] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:01.305855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4c479-aa81-4801-b6ef-7f0e4f93d636 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:01.316941 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4c479-aa81-4801-b6ef-7f0e4f93d636 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:01.318627 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4c479-aa81-4801-b6ef-7f0e4f93d636 service swift] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:01.328137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1108/2183] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:30:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:30:01.904900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214f6fa-2e66-47c6-9b8e-db700e2f7d11 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:01.905787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214f6fa-2e66-47c6-9b8e-db700e2f7d11 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:01.906208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214f6fa-2e66-47c6-9b8e-db700e2f7d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:01.930047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b214f6fa-2e66-47c6-9b8e-db700e2f7d11 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:01.931511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b214f6fa-2e66-47c6-9b8e-db700e2f7d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:01.940201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1076/2184] 10.222.0.33 () {58 vars in 967 bytes} [Mon Sep 12 23:30:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:01.957520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4c479-aa81-4801-b6ef-7f0e4f93d636 service swift] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:01.977434 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4c479-aa81-4801-b6ef-7f0e4f93d636 service swift] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:02.000951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c621-a994-4e58-90b3-7e19a5d2ba0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:02.001825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c621-a994-4e58-90b3-7e19a5d2ba0f service swift] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:02.002283 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c621-a994-4e58-90b3-7e19a5d2ba0f service swift] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:02.002714 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c621-a994-4e58-90b3-7e19a5d2ba0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:02.013828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875c621-a994-4e58-90b3-7e19a5d2ba0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:02.015728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875c621-a994-4e58-90b3-7e19a5d2ba0f service swift] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:02.035122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1109/2185] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:30:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:30:03.989628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8d073-c8c4-4e02-80a8-0accf000c72c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:03.990208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8d073-c8c4-4e02-80a8-0accf000c72c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:03.990411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8d073-c8c4-4e02-80a8-0accf000c72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:04.040323 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dec8d073-c8c4-4e02-80a8-0accf000c72c None None] MFA Rules not processed for user `83f5ffa7705f46c2b76fd2c8e91a701d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:04.043740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dec8d073-c8c4-4e02-80a8-0accf000c72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:04.123760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1077/2186] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:04.137737 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c621-a994-4e58-90b3-7e19a5d2ba0f service swift] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:04.139275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6875c621-a994-4e58-90b3-7e19a5d2ba0f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:04.203488 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:04.224468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c621-a994-4e58-90b3-7e19a5d2ba0f service swift] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:04.230976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8656d-581c-4fa0-bce9-e5f489e9cfda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:04.231991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8656d-581c-4fa0-bce9-e5f489e9cfda service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:04.232520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8656d-581c-4fa0-bce9-e5f489e9cfda service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:04.232833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8656d-581c-4fa0-bce9-e5f489e9cfda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:04.241854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8656d-581c-4fa0-bce9-e5f489e9cfda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:04.243519 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8656d-581c-4fa0-bce9-e5f489e9cfda service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:04.253599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1110/2187] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:04.730309 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8d073-c8c4-4e02-80a8-0accf000c72c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:04.739681 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dec8d073-c8c4-4e02-80a8-0accf000c72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:04.760612 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8d073-c8c4-4e02-80a8-0accf000c72c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:04.767811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:04.768541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:04.768922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:04.769285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] PATH_INFO: `/v3/users/c18f6dbaa5a74c8d8329df6d93861706` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:04.770628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18f6dbaa5a74c8d8329df6d93861706)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:04.772945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:04.889961 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18f6dbaa5a74c8d8329df6d93861706'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:04.910209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18f6dbaa5a74c8d8329df6d93861706'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:04.944239 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18f6dbaa5a74c8d8329df6d93861706'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:04.949641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18f6dbaa5a74c8d8329df6d93861706'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:04.951370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18f6dbaa5a74c8d8329df6d93861706'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:04.985925 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1078/2188] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:30:04 2022] DELETE /identity/v3/users/c18f6dbaa5a74c8d8329df6d93861706 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:04.991866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da583842-2845-40e6-89c5-f74d13d742df None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:04.992279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da583842-2845-40e6-89c5-f74d13d742df None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:04.992653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da583842-2845-40e6-89c5-f74d13d742df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:05.022661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-da583842-2845-40e6-89c5-f74d13d742df None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:05.024449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-da583842-2845-40e6-89c5-f74d13d742df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:05.124733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1111/2189] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:05.139759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:05.141778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:05.158613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:05.215062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b07774-fb4d-4845-98e2-4ed6c0ba97df admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:05.223214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050bb2c-bd2a-4ad8-a503-a0a7155e576b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:05.223912 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050bb2c-bd2a-4ad8-a503-a0a7155e576b service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:05.224275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050bb2c-bd2a-4ad8-a503-a0a7155e576b service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:05.224658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050bb2c-bd2a-4ad8-a503-a0a7155e576b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:05.236899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050bb2c-bd2a-4ad8-a503-a0a7155e576b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:05.238733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050bb2c-bd2a-4ad8-a503-a0a7155e576b service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:05.250022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1079/2190] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:05.449199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da583842-2845-40e6-89c5-f74d13d742df None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:05.450811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-da583842-2845-40e6-89c5-f74d13d742df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:05.488892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da583842-2845-40e6-89c5-f74d13d742df None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:05.496019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e358d-7c16-44d5-ad18-d03406806555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:05.496799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e358d-7c16-44d5-ad18-d03406806555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:05.497474 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e358d-7c16-44d5-ad18-d03406806555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:05.498012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e358d-7c16-44d5-ad18-d03406806555 admin admin] PATH_INFO: `/v3/projects/44fe14c0f228435bab1a110e2f6502c8` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:05.501167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e358d-7c16-44d5-ad18-d03406806555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44fe14c0f228435bab1a110e2f6502c8)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:05.503188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e358d-7c16-44d5-ad18-d03406806555 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:05.567455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-653e358d-7c16-44d5-ad18-d03406806555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44fe14c0f228435bab1a110e2f6502c8', 'request_id': 'req-653e358d-7c16-44d5-ad18-d03406806555'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:05.574964 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-653e358d-7c16-44d5-ad18-d03406806555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44fe14c0f228435bab1a110e2f6502c8', 'request_id': 'req-653e358d-7c16-44d5-ad18-d03406806555'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:05.581577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-653e358d-7c16-44d5-ad18-d03406806555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44fe14c0f228435bab1a110e2f6502c8', 'request_id': 'req-653e358d-7c16-44d5-ad18-d03406806555'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:05.597624 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-653e358d-7c16-44d5-ad18-d03406806555 admin admin] The token cache is being invalidate because project 44fe14c0f228435bab1a110e2f6502c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:30:05.598042 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-653e358d-7c16-44d5-ad18-d03406806555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:05.598862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-653e358d-7c16-44d5-ad18-d03406806555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:05.601402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1112/2191] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:30:05 2022] DELETE /identity/v3/projects/44fe14c0f228435bab1a110e2f6502c8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:05.607458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7efed-5edb-40d7-991e-1c0bb287e9ba None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:05.608025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7efed-5edb-40d7-991e-1c0bb287e9ba None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:05.608505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7efed-5edb-40d7-991e-1c0bb287e9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:05.631387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-66c7efed-5edb-40d7-991e-1c0bb287e9ba None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:05.632924 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-66c7efed-5edb-40d7-991e-1c0bb287e9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:05.711352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1080/2192] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:05.718653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e40d46-a0ee-47e2-91ad-7f979d5f9d8d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:05.719005 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e40d46-a0ee-47e2-91ad-7f979d5f9d8d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:05.719382 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e40d46-a0ee-47e2-91ad-7f979d5f9d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:05.751935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-31e40d46-a0ee-47e2-91ad-7f979d5f9d8d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:05.753606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-31e40d46-a0ee-47e2-91ad-7f979d5f9d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:05.769243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1113/2193] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:05.770792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7efed-5edb-40d7-991e-1c0bb287e9ba None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:05.783715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7efed-5edb-40d7-991e-1c0bb287e9ba None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:05.792163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f18ea-d5b0-4dbc-8251-1be5bd224a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:05.793133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f18ea-d5b0-4dbc-8251-1be5bd224a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:05.793735 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f18ea-d5b0-4dbc-8251-1be5bd224a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:05.794596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f18ea-d5b0-4dbc-8251-1be5bd224a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:05.797039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f18ea-d5b0-4dbc-8251-1be5bd224a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:30:05.797711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f18ea-d5b0-4dbc-8251-1be5bd224a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:05.799934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f18ea-d5b0-4dbc-8251-1be5bd224a36 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:05.818115 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1081/2194] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:30:05.822516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e40d46-a0ee-47e2-91ad-7f979d5f9d8d None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:05.833940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e40d46-a0ee-47e2-91ad-7f979d5f9d8d None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:05.847000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece36d74-9ca9-4933-9e0a-9f1a544f3d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:05.848309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36d74-9ca9-4933-9e0a-9f1a544f3d82 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:05.848592 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36d74-9ca9-4933-9e0a-9f1a544f3d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:05.848868 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36d74-9ca9-4933-9e0a-9f1a544f3d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:05.849521 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece36d74-9ca9-4933-9e0a-9f1a544f3d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:05.851468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece36d74-9ca9-4933-9e0a-9f1a544f3d82 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:05.890723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1114/2195] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:30:05 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:05.894307 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f18ea-d5b0-4dbc-8251-1be5bd224a36 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:05.906803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f18ea-d5b0-4dbc-8251-1be5bd224a36 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:05.995806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434ec10-b33b-4a12-bd3e-0db501ed2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:05.996432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434ec10-b33b-4a12-bd3e-0db501ed2888 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:05.996713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434ec10-b33b-4a12-bd3e-0db501ed2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:05.997052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434ec10-b33b-4a12-bd3e-0db501ed2888 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:05.997876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434ec10-b33b-4a12-bd3e-0db501ed2888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:06.002209 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434ec10-b33b-4a12-bd3e-0db501ed2888 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:06.047511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece36d74-9ca9-4933-9e0a-9f1a544f3d82 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:06.054189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1082/2196] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:30:05 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:30:06.062838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a547-417a-4552-8186-1cb24cebdbbe None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:06.063126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a547-417a-4552-8186-1cb24cebdbbe None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:06.063398 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a547-417a-4552-8186-1cb24cebdbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:06.064822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece36d74-9ca9-4933-9e0a-9f1a544f3d82 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:06.084195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a1a9f-5658-4bae-b4fe-5d6a14e61cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:06.084733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a1a9f-5658-4bae-b4fe-5d6a14e61cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:06.085195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a1a9f-5658-4bae-b4fe-5d6a14e61cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:06.085472 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a1a9f-5658-4bae-b4fe-5d6a14e61cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:06.086121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a1a9f-5658-4bae-b4fe-5d6a14e61cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:06.088027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a1a9f-5658-4bae-b4fe-5d6a14e61cc8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:06.120729 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-46e0a547-417a-4552-8186-1cb24cebdbbe None None] MFA Rules not processed for user `83f5ffa7705f46c2b76fd2c8e91a701d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:06.122869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-46e0a547-417a-4552-8186-1cb24cebdbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:06.143657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1115/2197] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:06.146357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a1a9f-5658-4bae-b4fe-5d6a14e61cc8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:06.159375 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:06.161773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a1a9f-5658-4bae-b4fe-5d6a14e61cc8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:06.182182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5299a3-16cd-4ff3-bb9c-8e4644022567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:06.183648 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5299a3-16cd-4ff3-bb9c-8e4644022567 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:06.184085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5299a3-16cd-4ff3-bb9c-8e4644022567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:06.184571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5299a3-16cd-4ff3-bb9c-8e4644022567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:06.186747 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5299a3-16cd-4ff3-bb9c-8e4644022567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:06.188992 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5299a3-16cd-4ff3-bb9c-8e4644022567 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:06.211759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1116/2198] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:06.212576 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5299a3-16cd-4ff3-bb9c-8e4644022567 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:06.214201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1083/2199] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:06.243785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5299a3-16cd-4ff3-bb9c-8e4644022567 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:06.251262 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bd1aa-76cf-4bd4-8fe0-21fb0ba7ad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:06.252242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bd1aa-76cf-4bd4-8fe0-21fb0ba7ad99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:06.253002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bd1aa-76cf-4bd4-8fe0-21fb0ba7ad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:06.253357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bd1aa-76cf-4bd4-8fe0-21fb0ba7ad99 admin admin] PATH_INFO: `/v3/projects/cbabc02ac4e94332a013b1d8565419a6/users/cf97527da5b946d8bf92de3b06f7ae0d/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:06.267621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:06.272268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bd1aa-76cf-4bd4-8fe0-21fb0ba7ad99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbabc02ac4e94332a013b1d8565419a6, user_id=cf97527da5b946d8bf92de3b06f7ae0d, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:06.276089 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bd1aa-76cf-4bd4-8fe0-21fb0ba7ad99 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:06.313248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1117/2200] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:06 2022] PUT /identity/v3/projects/cbabc02ac4e94332a013b1d8565419a6/users/cf97527da5b946d8bf92de3b06f7ae0d/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:06.319705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac185c08-5cb5-446f-b334-42cc8894bbff None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:06.320271 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac185c08-5cb5-446f-b334-42cc8894bbff None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:06.320748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac185c08-5cb5-446f-b334-42cc8894bbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:06.346981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ac185c08-5cb5-446f-b334-42cc8894bbff None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:06.348373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ac185c08-5cb5-446f-b334-42cc8894bbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:06.434804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1084/2201] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:30:06.459990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bd1aa-76cf-4bd4-8fe0-21fb0ba7ad99 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:06.464195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a18bd1aa-76cf-4bd4-8fe0-21fb0ba7ad99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:06.665558 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bd1aa-76cf-4bd4-8fe0-21fb0ba7ad99 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:06.678692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f3eb9-3989-421a-ae0b-ea9a561fd6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:06.680598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f3eb9-3989-421a-ae0b-ea9a561fd6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:06.682693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f3eb9-3989-421a-ae0b-ea9a561fd6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:06.685110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f3eb9-3989-421a-ae0b-ea9a561fd6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:06.706240 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f3eb9-3989-421a-ae0b-ea9a561fd6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:06.708546 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f3eb9-3989-421a-ae0b-ea9a561fd6a2 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:06.740251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1118/2202] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:14.724018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac185c08-5cb5-446f-b334-42cc8894bbff None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:14.726069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ac185c08-5cb5-446f-b334-42cc8894bbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:14.739013 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dfa5e-f4a5-4a41-9823-f8dd092d17de None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:14.739967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dfa5e-f4a5-4a41-9823-f8dd092d17de None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:14.740412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dfa5e-f4a5-4a41-9823-f8dd092d17de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:14.745102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac185c08-5cb5-446f-b334-42cc8894bbff None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:14.750867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:14.753674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:14.753979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:14.754307 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] PATH_INFO: `/v3/users/7e15be3b90284c8dba6f34354be1962e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:14.761827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e15be3b90284c8dba6f34354be1962e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:14.764032 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:14.797476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-561dfa5e-f4a5-4a41-9823-f8dd092d17de None None] MFA Rules not processed for user `cf97527da5b946d8bf92de3b06f7ae0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:14.799763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-561dfa5e-f4a5-4a41-9823-f8dd092d17de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:14.875613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e15be3b90284c8dba6f34354be1962e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:14.894592 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e15be3b90284c8dba6f34354be1962e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:14.906582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1119/2203] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:14.907959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dfa5e-f4a5-4a41-9823-f8dd092d17de None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:14.916741 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e15be3b90284c8dba6f34354be1962e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:14.917537 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e15be3b90284c8dba6f34354be1962e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:14.918218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e15be3b90284c8dba6f34354be1962e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:14.921733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dfa5e-f4a5-4a41-9823-f8dd092d17de None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:14.926851 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f766a3-b581-42cb-b09f-5b939149c085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:14.927439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f766a3-b581-42cb-b09f-5b939149c085 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:14.927774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f766a3-b581-42cb-b09f-5b939149c085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:14.927977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f766a3-b581-42cb-b09f-5b939149c085 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:14.928757 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f766a3-b581-42cb-b09f-5b939149c085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:14.930873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f766a3-b581-42cb-b09f-5b939149c085 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:14.936059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1085/2204] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:30:14 2022] DELETE /identity/v3/users/7e15be3b90284c8dba6f34354be1962e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:14.967495 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1120/2205] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:30:14 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:14.971301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:14.972808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:15.039417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:15.059118 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38d2f5-277b-4be8-b624-6c541bb2920b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:15.137893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a513f61-83d6-41ac-8cc9-9406a72d5f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:15.139044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a513f61-83d6-41ac-8cc9-9406a72d5f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:15.139412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a513f61-83d6-41ac-8cc9-9406a72d5f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:15.139960 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a513f61-83d6-41ac-8cc9-9406a72d5f4f admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:15.141023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a513f61-83d6-41ac-8cc9-9406a72d5f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:15.141619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f766a3-b581-42cb-b09f-5b939149c085 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:15.143292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a513f61-83d6-41ac-8cc9-9406a72d5f4f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:15.143412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a2f766a3-b581-42cb-b09f-5b939149c085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:15.161770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f766a3-b581-42cb-b09f-5b939149c085 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:15.168045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:15.168364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:15.168609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:15.168880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] PATH_INFO: `/v3/projects/4eec9115f83b4126a2df1fcd04e2e0d5` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:15.169761 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1086/2206] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:30:14 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:30:15.173160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eec9115f83b4126a2df1fcd04e2e0d5)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:15.173990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a513f61-83d6-41ac-8cc9-9406a72d5f4f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:15.175248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:15.185380 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a513f61-83d6-41ac-8cc9-9406a72d5f4f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:15.190605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df56717-8ccd-4502-8467-7f769466ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:15.191283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df56717-8ccd-4502-8467-7f769466ec76 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:15.191836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df56717-8ccd-4502-8467-7f769466ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:15.191836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df56717-8ccd-4502-8467-7f769466ec76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:15.192469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df56717-8ccd-4502-8467-7f769466ec76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:15.194241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df56717-8ccd-4502-8467-7f769466ec76 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:15.205204 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1087/2207] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:30:15.209237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df56717-8ccd-4502-8467-7f769466ec76 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:15.220231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df56717-8ccd-4502-8467-7f769466ec76 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:15.231195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eec9115f83b4126a2df1fcd04e2e0d5', 'request_id': 'req-cd4cd0d8-b74e-467d-aa29-28b70170be2b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:15.238057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eec9115f83b4126a2df1fcd04e2e0d5', 'request_id': 'req-cd4cd0d8-b74e-467d-aa29-28b70170be2b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:15.239412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:15.246251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eec9115f83b4126a2df1fcd04e2e0d5', 'request_id': 'req-cd4cd0d8-b74e-467d-aa29-28b70170be2b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:15.261121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] The token cache is being invalidate because project 4eec9115f83b4126a2df1fcd04e2e0d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:30:15.261489 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:15.262258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:15.263939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1121/2208] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:30:15 2022] DELETE /identity/v3/projects/4eec9115f83b4126a2df1fcd04e2e0d5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:30:15.267769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:15.269814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:15.285888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826e8c-d173-441a-97ed-ea6a0ff9bddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:15.286774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826e8c-d173-441a-97ed-ea6a0ff9bddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:15.287060 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826e8c-d173-441a-97ed-ea6a0ff9bddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:15.287338 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826e8c-d173-441a-97ed-ea6a0ff9bddf admin admin] PATH_INFO: `/v3/projects/828c35e4e5e94ca08661363c55e10677/users/8b1bf77787784d35854afa0643eaf7c9/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:15.304294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826e8c-d173-441a-97ed-ea6a0ff9bddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=828c35e4e5e94ca08661363c55e10677, user_id=8b1bf77787784d35854afa0643eaf7c9, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:15.308225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826e8c-d173-441a-97ed-ea6a0ff9bddf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:15.326520 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1088/2209] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:15 2022] PUT /identity/v3/projects/828c35e4e5e94ca08661363c55e10677/users/8b1bf77787784d35854afa0643eaf7c9/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:30:15.329843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826e8c-d173-441a-97ed-ea6a0ff9bddf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:15.332858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9f826e8c-d173-441a-97ed-ea6a0ff9bddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:15.344528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cd0d8-b74e-467d-aa29-28b70170be2b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:15.414861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826e8c-d173-441a-97ed-ea6a0ff9bddf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:15.420848 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f114df-0a14-4b83-a448-ebdd1751ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:15.421536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f114df-0a14-4b83-a448-ebdd1751ddcb admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:15.421886 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f114df-0a14-4b83-a448-ebdd1751ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:15.422266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f114df-0a14-4b83-a448-ebdd1751ddcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:15.423095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f114df-0a14-4b83-a448-ebdd1751ddcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:15.424782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f114df-0a14-4b83-a448-ebdd1751ddcb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:15.426642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:15.441253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1089/2210] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:30:15.445008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f114df-0a14-4b83-a448-ebdd1751ddcb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:15.445177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90710f90-786d-40ee-81e2-06e708f2b06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:15.445709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90710f90-786d-40ee-81e2-06e708f2b06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:15.445988 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90710f90-786d-40ee-81e2-06e708f2b06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:15.446260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90710f90-786d-40ee-81e2-06e708f2b06d admin admin] PATH_INFO: `/v3/users/f5aed4c00f444a138ae8fb29df090efd` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:15.447968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90710f90-786d-40ee-81e2-06e708f2b06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5aed4c00f444a138ae8fb29df090efd)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:15.449900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90710f90-786d-40ee-81e2-06e708f2b06d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:15.456490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f114df-0a14-4b83-a448-ebdd1751ddcb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:15.485325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829b589-f345-4caa-9db7-e38c740ba7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:15.487842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829b589-f345-4caa-9db7-e38c740ba7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:15.488162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829b589-f345-4caa-9db7-e38c740ba7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:15.488531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829b589-f345-4caa-9db7-e38c740ba7b6 admin admin] PATH_INFO: `/v3/projects/828c35e4e5e94ca08661363c55e10677/users/8b1bf77787784d35854afa0643eaf7c9/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:15.495354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829b589-f345-4caa-9db7-e38c740ba7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=828c35e4e5e94ca08661363c55e10677, user_id=8b1bf77787784d35854afa0643eaf7c9, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:15.502299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829b589-f345-4caa-9db7-e38c740ba7b6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:15.526431 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1090/2211] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:15 2022] PUT /identity/v3/projects/828c35e4e5e94ca08661363c55e10677/users/8b1bf77787784d35854afa0643eaf7c9/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:15.526623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-90710f90-786d-40ee-81e2-06e708f2b06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5aed4c00f444a138ae8fb29df090efd'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:15.534412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-90710f90-786d-40ee-81e2-06e708f2b06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5aed4c00f444a138ae8fb29df090efd'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:15.557383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-90710f90-786d-40ee-81e2-06e708f2b06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5aed4c00f444a138ae8fb29df090efd'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:15.558170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-90710f90-786d-40ee-81e2-06e708f2b06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5aed4c00f444a138ae8fb29df090efd'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:15.558973 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-90710f90-786d-40ee-81e2-06e708f2b06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5aed4c00f444a138ae8fb29df090efd'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:15.581102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1122/2212] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:30:15 2022] DELETE /identity/v3/users/f5aed4c00f444a138ae8fb29df090efd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:15.841417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829b589-f345-4caa-9db7-e38c740ba7b6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:15.843594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9829b589-f345-4caa-9db7-e38c740ba7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:16.058989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829b589-f345-4caa-9db7-e38c740ba7b6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:16.214064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029ab87-acae-4cf1-89e1-c745124062e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:16.215806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029ab87-acae-4cf1-89e1-c745124062e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:16.215896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029ab87-acae-4cf1-89e1-c745124062e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:16.216152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029ab87-acae-4cf1-89e1-c745124062e6 admin admin] PATH_INFO: `/v3/projects/9ee79b3793544baa83fa5f4a9124b2e7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:16.217335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029ab87-acae-4cf1-89e1-c745124062e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee79b3793544baa83fa5f4a9124b2e7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:16.221114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029ab87-acae-4cf1-89e1-c745124062e6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:16.307818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0029ab87-acae-4cf1-89e1-c745124062e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee79b3793544baa83fa5f4a9124b2e7', 'request_id': 'req-0029ab87-acae-4cf1-89e1-c745124062e6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:16.319969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0029ab87-acae-4cf1-89e1-c745124062e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee79b3793544baa83fa5f4a9124b2e7', 'request_id': 'req-0029ab87-acae-4cf1-89e1-c745124062e6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:16.339670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0029ab87-acae-4cf1-89e1-c745124062e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee79b3793544baa83fa5f4a9124b2e7', 'request_id': 'req-0029ab87-acae-4cf1-89e1-c745124062e6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:16.356584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0029ab87-acae-4cf1-89e1-c745124062e6 admin admin] The token cache is being invalidate because project 9ee79b3793544baa83fa5f4a9124b2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:30:16.356584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0029ab87-acae-4cf1-89e1-c745124062e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:16.357105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0029ab87-acae-4cf1-89e1-c745124062e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:16.358929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1091/2213] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:30:15 2022] DELETE /identity/v3/projects/9ee79b3793544baa83fa5f4a9124b2e7 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:16.364559 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004ddc5-e933-44ee-b703-79062856c1c4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:16.365088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004ddc5-e933-44ee-b703-79062856c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:16.366667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004ddc5-e933-44ee-b703-79062856c1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:16.397239 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-7004ddc5-e933-44ee-b703-79062856c1c4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:16.398845 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7004ddc5-e933-44ee-b703-79062856c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:16.406476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:16.564267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1123/2214] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:30:16.569874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b275f1e-5dec-40e6-9e5c-f1455b1fd206 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:16.570999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b275f1e-5dec-40e6-9e5c-f1455b1fd206 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:16.571471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b275f1e-5dec-40e6-9e5c-f1455b1fd206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:16.633374 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2b275f1e-5dec-40e6-9e5c-f1455b1fd206 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:16.642710 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2b275f1e-5dec-40e6-9e5c-f1455b1fd206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:16.667666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1092/2215] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:16.671530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004ddc5-e933-44ee-b703-79062856c1c4 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:16.696639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004ddc5-e933-44ee-b703-79062856c1c4 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:16.703040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a580f3-8ca3-4899-b0b6-7d0328c05bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:16.704017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a580f3-8ca3-4899-b0b6-7d0328c05bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:16.704931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a580f3-8ca3-4899-b0b6-7d0328c05bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:16.705364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a580f3-8ca3-4899-b0b6-7d0328c05bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:16.706197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a580f3-8ca3-4899-b0b6-7d0328c05bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:30:16.706781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a580f3-8ca3-4899-b0b6-7d0328c05bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:16.708645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a580f3-8ca3-4899-b0b6-7d0328c05bb6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:16.777394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b275f1e-5dec-40e6-9e5c-f1455b1fd206 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:16.778083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1124/2216] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:30:16.792439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b275f1e-5dec-40e6-9e5c-f1455b1fd206 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:16.806834 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123977b4-d243-40c2-8621-3e5868647b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:16.810563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123977b4-d243-40c2-8621-3e5868647b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:16.810857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123977b4-d243-40c2-8621-3e5868647b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:16.811645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123977b4-d243-40c2-8621-3e5868647b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:16.813624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123977b4-d243-40c2-8621-3e5868647b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:16.819998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123977b4-d243-40c2-8621-3e5868647b99 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:16.859816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:16.895992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1093/2217] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:30:16 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:16.900496 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a580f3-8ca3-4899-b0b6-7d0328c05bb6 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:16.913181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a580f3-8ca3-4899-b0b6-7d0328c05bb6 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:17.036402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3d521-9c06-4089-9606-425ac9ca5b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:17.037131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3d521-9c06-4089-9606-425ac9ca5b19 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:17.037455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3d521-9c06-4089-9606-425ac9ca5b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:17.037771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3d521-9c06-4089-9606-425ac9ca5b19 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:17.038812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3d521-9c06-4089-9606-425ac9ca5b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:17.042782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3d521-9c06-4089-9606-425ac9ca5b19 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:17.080644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1125/2218] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:30:16 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:17.084422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123977b4-d243-40c2-8621-3e5868647b99 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:17.104421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123977b4-d243-40c2-8621-3e5868647b99 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:17.112448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6888c-a746-4442-a85e-e7e04e63332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:17.113539 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6888c-a746-4442-a85e-e7e04e63332d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:17.114412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6888c-a746-4442-a85e-e7e04e63332d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:17.114737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6888c-a746-4442-a85e-e7e04e63332d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:17.115773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6888c-a746-4442-a85e-e7e04e63332d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:17.120486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6888c-a746-4442-a85e-e7e04e63332d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:17.142308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1094/2219] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:17.146179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3d521-9c06-4089-9606-425ac9ca5b19 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:17.161637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3d521-9c06-4089-9606-425ac9ca5b19 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:17.168841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12aa98-8d64-45d3-8c08-ffaec590ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:17.169480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12aa98-8d64-45d3-8c08-ffaec590ec31 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:17.169809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12aa98-8d64-45d3-8c08-ffaec590ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:17.170089 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12aa98-8d64-45d3-8c08-ffaec590ec31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:17.171620 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12aa98-8d64-45d3-8c08-ffaec590ec31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:17.173854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12aa98-8d64-45d3-8c08-ffaec590ec31 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:17.199262 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1126/2220] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:17.201198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6888c-a746-4442-a85e-e7e04e63332d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:17.226531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6888c-a746-4442-a85e-e7e04e63332d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:17.240613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9806e38-319d-45f6-8dda-c147aeb308b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:17.241400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806e38-319d-45f6-8dda-c147aeb308b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:17.241782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806e38-319d-45f6-8dda-c147aeb308b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:17.242063 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806e38-319d-45f6-8dda-c147aeb308b8 admin admin] PATH_INFO: `/v3/projects/1fd3b20a1aca481a89bfd7631a886a57/users/cbe61cfe7ee94a3c8f1edf7519687deb/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:17.281082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9806e38-319d-45f6-8dda-c147aeb308b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd3b20a1aca481a89bfd7631a886a57, user_id=cbe61cfe7ee94a3c8f1edf7519687deb, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:17.285638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9806e38-319d-45f6-8dda-c147aeb308b8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:17.317543 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1095/2221] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:17 2022] PUT /identity/v3/projects/1fd3b20a1aca481a89bfd7631a886a57/users/cbe61cfe7ee94a3c8f1edf7519687deb/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:17.328766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf4bfe-65e0-4ef4-965d-3985ec8fcc3e None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:17.329059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf4bfe-65e0-4ef4-965d-3985ec8fcc3e None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:17.329344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf4bfe-65e0-4ef4-965d-3985ec8fcc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:17.372353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cfdf4bfe-65e0-4ef4-965d-3985ec8fcc3e None None] MFA Rules not processed for user `cbe61cfe7ee94a3c8f1edf7519687deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:17.373754 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cfdf4bfe-65e0-4ef4-965d-3985ec8fcc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:17.517676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1127/2222] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:17.529940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9806e38-319d-45f6-8dda-c147aeb308b8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:17.534699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a9806e38-319d-45f6-8dda-c147aeb308b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:17.729680 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9806e38-319d-45f6-8dda-c147aeb308b8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:17.740641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01854a-2de5-427f-9f4d-b1c641acc8df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:17.743590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01854a-2de5-427f-9f4d-b1c641acc8df service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:17.744059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01854a-2de5-427f-9f4d-b1c641acc8df service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:17.746755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01854a-2de5-427f-9f4d-b1c641acc8df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:17.780430 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01854a-2de5-427f-9f4d-b1c641acc8df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:17.782016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01854a-2de5-427f-9f4d-b1c641acc8df service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:17.832878 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1096/2223] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:21.723117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf4bfe-65e0-4ef4-965d-3985ec8fcc3e None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:21.731643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cfdf4bfe-65e0-4ef4-965d-3985ec8fcc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:21.764377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:21.878391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf4bfe-65e0-4ef4-965d-3985ec8fcc3e None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:21.884476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:21.885526 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:21.885959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:21.887670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] PATH_INFO: `/v3/users/3466ff657e8946ecbb93b62e94e89822` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:21.889204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3466ff657e8946ecbb93b62e94e89822)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:21.891982 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:21.969300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3466ff657e8946ecbb93b62e94e89822'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:21.979115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3466ff657e8946ecbb93b62e94e89822'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:21.997109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3466ff657e8946ecbb93b62e94e89822'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:22.003574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3466ff657e8946ecbb93b62e94e89822'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:22.003574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3466ff657e8946ecbb93b62e94e89822'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:22.027393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1128/2224] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:30:21 2022] DELETE /identity/v3/users/3466ff657e8946ecbb93b62e94e89822 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:22.029384 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b37490-3fe6-46ad-884b-d479f012bc6c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:22.029910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b37490-3fe6-46ad-884b-d479f012bc6c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:22.030113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b37490-3fe6-46ad-884b-d479f012bc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:22.068686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-76b37490-3fe6-46ad-884b-d479f012bc6c None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:22.070136 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-76b37490-3fe6-46ad-884b-d479f012bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:22.179538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1097/2225] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:22.195794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:22.197477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:22.320156 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d83c-7c40-4623-be08-8769ba186216 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:22.327591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4227a-7f50-4827-b4a4-6ca34cfa5a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:22.328342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4227a-7f50-4827-b4a4-6ca34cfa5a59 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:22.328628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4227a-7f50-4827-b4a4-6ca34cfa5a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:22.328901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4227a-7f50-4827-b4a4-6ca34cfa5a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:22.369689 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4227a-7f50-4827-b4a4-6ca34cfa5a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:22.372174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4227a-7f50-4827-b4a4-6ca34cfa5a59 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:22.392629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1129/2226] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:22.988860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63b65d-d9c2-4c49-9e0e-2edd704bc46a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:22.989158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63b65d-d9c2-4c49-9e0e-2edd704bc46a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:22.989446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63b65d-d9c2-4c49-9e0e-2edd704bc46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:23.053496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8c63b65d-d9c2-4c49-9e0e-2edd704bc46a None None] MFA Rules not processed for user `8b1bf77787784d35854afa0643eaf7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:23.054797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8c63b65d-d9c2-4c49-9e0e-2edd704bc46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:23.156308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:23.188916 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1098/2227] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:23.202130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4227a-7f50-4827-b4a4-6ca34cfa5a59 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:23.204412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-56a4227a-7f50-4827-b4a4-6ca34cfa5a59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:23.238927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:23.277774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4227a-7f50-4827-b4a4-6ca34cfa5a59 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:23.281896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a0fa4-ae24-4543-983a-50ffee2cbb20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f96bbb14c04691ac403271de293224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:23.282486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a0fa4-ae24-4543-983a-50ffee2cbb20 service glance] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:23.282771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a0fa4-ae24-4543-983a-50ffee2cbb20 service glance] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:23.283060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a0fa4-ae24-4543-983a-50ffee2cbb20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:23.284868 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-207a0fa4-ae24-4543-983a-50ffee2cbb20 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:23.294656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63b65d-d9c2-4c49-9e0e-2edd704bc46a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:23.296403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8c63b65d-d9c2-4c49-9e0e-2edd704bc46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:23.321410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63b65d-d9c2-4c49-9e0e-2edd704bc46a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:23.327349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:23.328004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:23.328291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:23.328876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c admin admin] PATH_INFO: `/v3/projects/5335e5b4aa974213880ad23d6ea9d35d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:23.330054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5335e5b4aa974213880ad23d6ea9d35d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:23.332198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:23.415786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a0fa4-ae24-4543-983a-50ffee2cbb20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:23.418209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a0fa4-ae24-4543-983a-50ffee2cbb20 service glance] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:23.424976 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5335e5b4aa974213880ad23d6ea9d35d', 'request_id': 'req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:23.433403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5335e5b4aa974213880ad23d6ea9d35d', 'request_id': 'req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:23.433746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1130/2228] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:30:23.442611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5335e5b4aa974213880ad23d6ea9d35d', 'request_id': 'req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:23.464517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c admin admin] The token cache is being invalidate because project 5335e5b4aa974213880ad23d6ea9d35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:30:23.464813 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:23.470622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0406dd3e-ddc0-4ae9-b77a-e9b2f4231d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:23.472271 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1099/2229] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:30:23 2022] DELETE /identity/v3/projects/5335e5b4aa974213880ad23d6ea9d35d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:30:23.478441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d271-7ee2-4b6f-91bf-2794f9ef8242 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:23.478826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d271-7ee2-4b6f-91bf-2794f9ef8242 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:23.479117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d271-7ee2-4b6f-91bf-2794f9ef8242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:23.507488 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-7419d271-7ee2-4b6f-91bf-2794f9ef8242 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:23.508730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7419d271-7ee2-4b6f-91bf-2794f9ef8242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:23.626715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1131/2230] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:23.636642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94060925-283e-4c79-b4c3-43281eb13b71 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:23.638212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94060925-283e-4c79-b4c3-43281eb13b71 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:23.638602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94060925-283e-4c79-b4c3-43281eb13b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:23.653820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d37436-61cc-4961-a969-2d090b3d1e16 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:23.654085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d37436-61cc-4961-a969-2d090b3d1e16 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:23.654356 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d37436-61cc-4961-a969-2d090b3d1e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:23.669689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-94060925-283e-4c79-b4c3-43281eb13b71 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:23.671638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-94060925-283e-4c79-b4c3-43281eb13b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:23.678843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-67d37436-61cc-4961-a969-2d090b3d1e16 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:23.680126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-67d37436-61cc-4961-a969-2d090b3d1e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:23.680621 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1100/2231] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:23.686026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94060925-283e-4c79-b4c3-43281eb13b71 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:23.698069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94060925-283e-4c79-b4c3-43281eb13b71 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:23.704481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b2ea8-f97e-4979-b790-82934490a8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:23.706406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b2ea8-f97e-4979-b790-82934490a8dc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:23.707087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b2ea8-f97e-4979-b790-82934490a8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:23.708313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b2ea8-f97e-4979-b790-82934490a8dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:23.708724 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b2ea8-f97e-4979-b790-82934490a8dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:30:23.709149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b2ea8-f97e-4979-b790-82934490a8dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:23.711512 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b2ea8-f97e-4979-b790-82934490a8dc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:23.731361 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1101/2232] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:30:23.735475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b2ea8-f97e-4979-b790-82934490a8dc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:23.748625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b2ea8-f97e-4979-b790-82934490a8dc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:23.757292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412143b-23a6-4dbc-9209-ea8f93bf29f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:23.758074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412143b-23a6-4dbc-9209-ea8f93bf29f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:23.758518 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412143b-23a6-4dbc-9209-ea8f93bf29f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:23.759433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412143b-23a6-4dbc-9209-ea8f93bf29f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:23.760815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412143b-23a6-4dbc-9209-ea8f93bf29f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:23.762782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412143b-23a6-4dbc-9209-ea8f93bf29f7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:23.774178 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1132/2233] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:30:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:30:23.788366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d37436-61cc-4961-a969-2d090b3d1e16 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:23.790565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-67d37436-61cc-4961-a969-2d090b3d1e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:23.806526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1102/2234] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:30:23 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:23.807875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412143b-23a6-4dbc-9209-ea8f93bf29f7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:23.830833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:23.880028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d37436-61cc-4961-a969-2d090b3d1e16 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:23.890346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412143b-23a6-4dbc-9209-ea8f93bf29f7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:23.895507 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced1d01-3937-45a5-8bb7-ab82e5a18936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:23.897525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced1d01-3937-45a5-8bb7-ab82e5a18936 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:23.897836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced1d01-3937-45a5-8bb7-ab82e5a18936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:23.898112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced1d01-3937-45a5-8bb7-ab82e5a18936 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:23.898844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced1d01-3937-45a5-8bb7-ab82e5a18936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:23.901069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced1d01-3937-45a5-8bb7-ab82e5a18936 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:23.942128 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1103/2235] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:30:23 2022] POST /identity/v3/users => generated 286 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:23.944042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced1d01-3937-45a5-8bb7-ab82e5a18936 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:23.957249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced1d01-3937-45a5-8bb7-ab82e5a18936 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:23.964560 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb8fbd-6553-4ed2-a48d-953b3cb7a0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:23.965367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb8fbd-6553-4ed2-a48d-953b3cb7a0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:23.965930 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb8fbd-6553-4ed2-a48d-953b3cb7a0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:23.966732 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb8fbd-6553-4ed2-a48d-953b3cb7a0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:23.967556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88f212-ca66-4e4e-a400-4ea8c8dfa0d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:23.968456 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb8fbd-6553-4ed2-a48d-953b3cb7a0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:23.969232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88f212-ca66-4e4e-a400-4ea8c8dfa0d3 service swift] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:23.971427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88f212-ca66-4e4e-a400-4ea8c8dfa0d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:23.971808 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88f212-ca66-4e4e-a400-4ea8c8dfa0d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:23.972637 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb8fbd-6553-4ed2-a48d-953b3cb7a0b5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:24.002779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1104/2236] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:24.004078 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb8fbd-6553-4ed2-a48d-953b3cb7a0b5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:24.012316 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:24.024077 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb8fbd-6553-4ed2-a48d-953b3cb7a0b5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:24.033162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ac6b0-1ba0-4186-a417-06f782743bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:24.034301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ac6b0-1ba0-4186-a417-06f782743bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:24.034636 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ac6b0-1ba0-4186-a417-06f782743bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:24.034915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ac6b0-1ba0-4186-a417-06f782743bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:24.037992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ac6b0-1ba0-4186-a417-06f782743bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:24.039926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ac6b0-1ba0-4186-a417-06f782743bd3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:24.058585 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1105/2237] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:24.063339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ac6b0-1ba0-4186-a417-06f782743bd3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:24.077600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ac6b0-1ba0-4186-a417-06f782743bd3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:24.081205 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88f212-ca66-4e4e-a400-4ea8c8dfa0d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:24.083185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88f212-ca66-4e4e-a400-4ea8c8dfa0d3 service swift] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:24.083864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3907be-b80a-4e10-a571-f8b3ed7ccb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:24.084725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3907be-b80a-4e10-a571-f8b3ed7ccb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:24.085189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3907be-b80a-4e10-a571-f8b3ed7ccb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:24.085799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3907be-b80a-4e10-a571-f8b3ed7ccb3e admin admin] PATH_INFO: `/v3/projects/392a921f7bbf45a19e84b60938250a4c/users/f49fa74ba8b649eb871da0b154840751/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:24.099379 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1133/2238] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:30:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 23:30:24.115568 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3907be-b80a-4e10-a571-f8b3ed7ccb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=392a921f7bbf45a19e84b60938250a4c, user_id=f49fa74ba8b649eb871da0b154840751, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:24.124463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3907be-b80a-4e10-a571-f8b3ed7ccb3e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:24.173083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1106/2239] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:24 2022] PUT /identity/v3/projects/392a921f7bbf45a19e84b60938250a4c/users/f49fa74ba8b649eb871da0b154840751/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:24.178245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb1e1-7ec9-4972-bfa3-8b0114f3b9f0 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:24.178555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb1e1-7ec9-4972-bfa3-8b0114f3b9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:24.178841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb1e1-7ec9-4972-bfa3-8b0114f3b9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:24.231933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3907be-b80a-4e10-a571-f8b3ed7ccb3e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:24.233574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ea3907be-b80a-4e10-a571-f8b3ed7ccb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:24.237484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-d1bdb1e1-7ec9-4972-bfa3-8b0114f3b9f0 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:24.238758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d1bdb1e1-7ec9-4972-bfa3-8b0114f3b9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:24.392683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1134/2240] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:24.424080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3907be-b80a-4e10-a571-f8b3ed7ccb3e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:24.429851 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:24.430773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:24.431176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:24.431555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] PATH_INFO: `/v3/users/cbe61cfe7ee94a3c8f1edf7519687deb` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:24.434263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe61cfe7ee94a3c8f1edf7519687deb)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:24.436374 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:24.453692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdb1e1-7ec9-4972-bfa3-8b0114f3b9f0 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:24.455157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d1bdb1e1-7ec9-4972-bfa3-8b0114f3b9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:24.483015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:24.581900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe61cfe7ee94a3c8f1edf7519687deb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:24.602442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe61cfe7ee94a3c8f1edf7519687deb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:24.624945 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdb1e1-7ec9-4972-bfa3-8b0114f3b9f0 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:24.630523 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451f605-e938-453e-ab77-012e3c6ee743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:24.630722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451f605-e938-453e-ab77-012e3c6ee743 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:24.630946 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451f605-e938-453e-ab77-012e3c6ee743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:24.631166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451f605-e938-453e-ab77-012e3c6ee743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:24.646729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451f605-e938-453e-ab77-012e3c6ee743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:24.648621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451f605-e938-453e-ab77-012e3c6ee743 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:24.653531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe61cfe7ee94a3c8f1edf7519687deb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:24.654612 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe61cfe7ee94a3c8f1edf7519687deb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:24.655964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe61cfe7ee94a3c8f1edf7519687deb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:24.664408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1135/2241] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:30:24.679142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1107/2242] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:30:24 2022] DELETE /identity/v3/users/cbe61cfe7ee94a3c8f1edf7519687deb => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:24.685099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8102f-2f11-485b-9fab-683ed61d8cab None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:24.686275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8102f-2f11-485b-9fab-683ed61d8cab None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:24.686753 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8102f-2f11-485b-9fab-683ed61d8cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:24.725128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-bfe8102f-2f11-485b-9fab-683ed61d8cab None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:24.732346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bfe8102f-2f11-485b-9fab-683ed61d8cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:24.861952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1136/2243] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:24.877851 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:24.914503 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:24.994841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:25.000388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884a25f-bb79-4405-b4a7-475b97c3cf46 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:25.008090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94404ffd-2dc9-46de-818e-d99fc8f592dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:25.009062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404ffd-2dc9-46de-818e-d99fc8f592dc service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:25.009771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404ffd-2dc9-46de-818e-d99fc8f592dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:25.010058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404ffd-2dc9-46de-818e-d99fc8f592dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:25.023745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94404ffd-2dc9-46de-818e-d99fc8f592dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:25.027127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94404ffd-2dc9-46de-818e-d99fc8f592dc service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:25.042619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1108/2244] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:25.653295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8102f-2f11-485b-9fab-683ed61d8cab None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:25.655443 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bfe8102f-2f11-485b-9fab-683ed61d8cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:25.679564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8102f-2f11-485b-9fab-683ed61d8cab None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:25.716392 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cec428-8749-4651-9f2e-8771ef8b493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:25.717918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cec428-8749-4651-9f2e-8771ef8b493c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:25.718301 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cec428-8749-4651-9f2e-8771ef8b493c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:25.718700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cec428-8749-4651-9f2e-8771ef8b493c admin admin] PATH_INFO: `/v3/projects/1fd3b20a1aca481a89bfd7631a886a57` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:25.720527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cec428-8749-4651-9f2e-8771ef8b493c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd3b20a1aca481a89bfd7631a886a57)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:25.722787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cec428-8749-4651-9f2e-8771ef8b493c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:25.830961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-68cec428-8749-4651-9f2e-8771ef8b493c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd3b20a1aca481a89bfd7631a886a57', 'request_id': 'req-68cec428-8749-4651-9f2e-8771ef8b493c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:25.840669 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-68cec428-8749-4651-9f2e-8771ef8b493c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd3b20a1aca481a89bfd7631a886a57', 'request_id': 'req-68cec428-8749-4651-9f2e-8771ef8b493c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:25.851511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-68cec428-8749-4651-9f2e-8771ef8b493c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd3b20a1aca481a89bfd7631a886a57', 'request_id': 'req-68cec428-8749-4651-9f2e-8771ef8b493c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:25.912632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-68cec428-8749-4651-9f2e-8771ef8b493c admin admin] The token cache is being invalidate because project 1fd3b20a1aca481a89bfd7631a886a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:30:25.912935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-68cec428-8749-4651-9f2e-8771ef8b493c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:25.918829 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-68cec428-8749-4651-9f2e-8771ef8b493c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:25.921103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1137/2245] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:30:25 2022] DELETE /identity/v3/projects/1fd3b20a1aca481a89bfd7631a886a57 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:25.925943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01171e-c308-4b29-9a36-c74e26d33c04 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:25.926945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01171e-c308-4b29-9a36-c74e26d33c04 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:25.927224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01171e-c308-4b29-9a36-c74e26d33c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:25.968091 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8a01171e-c308-4b29-9a36-c74e26d33c04 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:25.971701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8a01171e-c308-4b29-9a36-c74e26d33c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:26.155074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1109/2246] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:26.162180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2772d-549d-487a-8e19-cbd64b178ce6 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:26.162491 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2772d-549d-487a-8e19-cbd64b178ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:26.162786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2772d-549d-487a-8e19-cbd64b178ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:26.228628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-37d2772d-549d-487a-8e19-cbd64b178ce6 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:26.230841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-37d2772d-549d-487a-8e19-cbd64b178ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:26.263235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1138/2247] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:26.268127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01171e-c308-4b29-9a36-c74e26d33c04 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:26.279015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01171e-c308-4b29-9a36-c74e26d33c04 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:26.314746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536e662-b873-4912-91dc-cd3d258315fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:26.319855 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536e662-b873-4912-91dc-cd3d258315fa admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:26.320193 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536e662-b873-4912-91dc-cd3d258315fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:26.320483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536e662-b873-4912-91dc-cd3d258315fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:26.321365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536e662-b873-4912-91dc-cd3d258315fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:30:26.321563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536e662-b873-4912-91dc-cd3d258315fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:26.338809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536e662-b873-4912-91dc-cd3d258315fa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:26.403183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1110/2248] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:30:26.407374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2772d-549d-487a-8e19-cbd64b178ce6 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:26.425986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2772d-549d-487a-8e19-cbd64b178ce6 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:26.438507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e80f8-2020-4583-bc6f-0d2cb7d645b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:26.439240 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e80f8-2020-4583-bc6f-0d2cb7d645b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:26.439519 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e80f8-2020-4583-bc6f-0d2cb7d645b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:26.439786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e80f8-2020-4583-bc6f-0d2cb7d645b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:26.440967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e80f8-2020-4583-bc6f-0d2cb7d645b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:26.442932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e80f8-2020-4583-bc6f-0d2cb7d645b3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:26.502433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1139/2249] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:30:26 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:26.503291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536e662-b873-4912-91dc-cd3d258315fa admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:26.522951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536e662-b873-4912-91dc-cd3d258315fa admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:26.711448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b0746-baa2-4d47-a359-75400ccf1ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:26.711651 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0746-baa2-4d47-a359-75400ccf1ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:26.711959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0746-baa2-4d47-a359-75400ccf1ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:26.712698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0746-baa2-4d47-a359-75400ccf1ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:26.713709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b0746-baa2-4d47-a359-75400ccf1ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:26.716599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b0746-baa2-4d47-a359-75400ccf1ea2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:26.766528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1111/2250] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:30:26 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:30:26.771259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e80f8-2020-4583-bc6f-0d2cb7d645b3 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:26.792180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e80f8-2020-4583-bc6f-0d2cb7d645b3 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:26.805250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e7dfe-c80c-4538-a059-ebd360f58d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:26.806068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e7dfe-c80c-4538-a059-ebd360f58d16 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:26.806350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e7dfe-c80c-4538-a059-ebd360f58d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:26.806762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e7dfe-c80c-4538-a059-ebd360f58d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:26.807309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e7dfe-c80c-4538-a059-ebd360f58d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:26.808925 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e7dfe-c80c-4538-a059-ebd360f58d16 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:26.813688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:26.832775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b0746-baa2-4d47-a359-75400ccf1ea2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:26.833305 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1140/2251] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:26.847566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b0746-baa2-4d47-a359-75400ccf1ea2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:26.864409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca41e95-611e-41a7-93b8-1191e6091b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:26.864953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca41e95-611e-41a7-93b8-1191e6091b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:26.865232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca41e95-611e-41a7-93b8-1191e6091b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:26.865502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca41e95-611e-41a7-93b8-1191e6091b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:26.866151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca41e95-611e-41a7-93b8-1191e6091b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:26.868480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca41e95-611e-41a7-93b8-1191e6091b8d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:26.895095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1112/2252] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:26.899025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e7dfe-c80c-4538-a059-ebd360f58d16 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:26.911060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e7dfe-c80c-4538-a059-ebd360f58d16 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:26.931540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677d0a0-75ed-4458-84e9-15d4c7dd61be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:26.932237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677d0a0-75ed-4458-84e9-15d4c7dd61be admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:26.932521 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677d0a0-75ed-4458-84e9-15d4c7dd61be admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:26.932790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677d0a0-75ed-4458-84e9-15d4c7dd61be admin admin] PATH_INFO: `/v3/projects/729af417d80e4e1d9232896abc472be8/users/4d827e04b69348208d4c34cc8d806cd0/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:26.966110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677d0a0-75ed-4458-84e9-15d4c7dd61be admin admin] RBAC: Authorizing `identity:create_grant(project_id=729af417d80e4e1d9232896abc472be8, user_id=4d827e04b69348208d4c34cc8d806cd0, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:26.970763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677d0a0-75ed-4458-84e9-15d4c7dd61be admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:26.995092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1141/2253] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:26 2022] PUT /identity/v3/projects/729af417d80e4e1d9232896abc472be8/users/4d827e04b69348208d4c34cc8d806cd0/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:27.005910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dedfd-9ce1-4896-b4fc-ecd633b60bcd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:27.007102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dedfd-9ce1-4896-b4fc-ecd633b60bcd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:27.007374 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dedfd-9ce1-4896-b4fc-ecd633b60bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:27.062786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-aa2dedfd-9ce1-4896-b4fc-ecd633b60bcd None None] MFA Rules not processed for user `4d827e04b69348208d4c34cc8d806cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:27.064732 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aa2dedfd-9ce1-4896-b4fc-ecd633b60bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:27.209744 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:27.303248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1113/2254] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:27.312933 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677d0a0-75ed-4458-84e9-15d4c7dd61be admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:27.314685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8677d0a0-75ed-4458-84e9-15d4c7dd61be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:27.523618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677d0a0-75ed-4458-84e9-15d4c7dd61be admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:27.537785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30936c33-99b8-43b1-b377-248ddbfcdb2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:27.540700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936c33-99b8-43b1-b377-248ddbfcdb2e service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:27.543057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936c33-99b8-43b1-b377-248ddbfcdb2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:27.543348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936c33-99b8-43b1-b377-248ddbfcdb2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:27.574704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30936c33-99b8-43b1-b377-248ddbfcdb2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:27.576989 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30936c33-99b8-43b1-b377-248ddbfcdb2e service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:27.621836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1142/2255] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:32.628161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dedfd-9ce1-4896-b4fc-ecd633b60bcd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:32.797588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dedfd-9ce1-4896-b4fc-ecd633b60bcd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:32.803848 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:32.804747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:32.805257 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:32.805915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] PATH_INFO: `/v3/users/4d827e04b69348208d4c34cc8d806cd0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:32.807903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d827e04b69348208d4c34cc8d806cd0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:32.811020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:32.909605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d827e04b69348208d4c34cc8d806cd0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:32.932910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d827e04b69348208d4c34cc8d806cd0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:32.975264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d827e04b69348208d4c34cc8d806cd0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:32.976190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d827e04b69348208d4c34cc8d806cd0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:32.978642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d827e04b69348208d4c34cc8d806cd0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:33.015369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1114/2256] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:30:32 2022] DELETE /identity/v3/users/4d827e04b69348208d4c34cc8d806cd0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:30:33.018997 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e846031-d648-4ba3-9519-66d9278d449e None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:33.019615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e846031-d648-4ba3-9519-66d9278d449e None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:33.019721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e846031-d648-4ba3-9519-66d9278d449e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:33.083706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-5e846031-d648-4ba3-9519-66d9278d449e None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:33.088060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5e846031-d648-4ba3-9519-66d9278d449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:33.199217 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1143/2257] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:33.210287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:33.212892 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:33.405741 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66141f-f5f1-45b4-a1c6-3cfc49648fa3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:33.420231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaffd9f-e18e-44c9-9a5b-c9033c2826ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:33.424586 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaffd9f-e18e-44c9-9a5b-c9033c2826ec service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:33.428899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaffd9f-e18e-44c9-9a5b-c9033c2826ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:33.428995 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaffd9f-e18e-44c9-9a5b-c9033c2826ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:33.479864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaffd9f-e18e-44c9-9a5b-c9033c2826ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:33.481395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaffd9f-e18e-44c9-9a5b-c9033c2826ec service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:33.530279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1115/2258] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:34.844261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e846031-d648-4ba3-9519-66d9278d449e None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:34.845921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5e846031-d648-4ba3-9519-66d9278d449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:34.890299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e846031-d648-4ba3-9519-66d9278d449e None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:34.908041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e01770-4fff-4e9c-b349-d6f35cfc16ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:34.909957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e01770-4fff-4e9c-b349-d6f35cfc16ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:34.913653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e01770-4fff-4e9c-b349-d6f35cfc16ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:34.914043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e01770-4fff-4e9c-b349-d6f35cfc16ef admin admin] PATH_INFO: `/v3/projects/729af417d80e4e1d9232896abc472be8` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:34.921435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e01770-4fff-4e9c-b349-d6f35cfc16ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=729af417d80e4e1d9232896abc472be8)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:34.930146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e01770-4fff-4e9c-b349-d6f35cfc16ef admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:35.067841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-59e01770-4fff-4e9c-b349-d6f35cfc16ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729af417d80e4e1d9232896abc472be8', 'request_id': 'req-59e01770-4fff-4e9c-b349-d6f35cfc16ef'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:35.079802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-59e01770-4fff-4e9c-b349-d6f35cfc16ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729af417d80e4e1d9232896abc472be8', 'request_id': 'req-59e01770-4fff-4e9c-b349-d6f35cfc16ef'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:35.103625 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-59e01770-4fff-4e9c-b349-d6f35cfc16ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729af417d80e4e1d9232896abc472be8', 'request_id': 'req-59e01770-4fff-4e9c-b349-d6f35cfc16ef'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:35.121947 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:35.129660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-59e01770-4fff-4e9c-b349-d6f35cfc16ef admin admin] The token cache is being invalidate because project 729af417d80e4e1d9232896abc472be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:30:35.129857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-59e01770-4fff-4e9c-b349-d6f35cfc16ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:35.139462 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-59e01770-4fff-4e9c-b349-d6f35cfc16ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:35.143340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1144/2259] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:30:34 2022] DELETE /identity/v3/projects/729af417d80e4e1d9232896abc472be8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:35.148335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e752ef-2cb9-44bb-ba96-7d06511c23dc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:35.148882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e752ef-2cb9-44bb-ba96-7d06511c23dc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:35.148882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e752ef-2cb9-44bb-ba96-7d06511c23dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:35.240160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-77e752ef-2cb9-44bb-ba96-7d06511c23dc None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:35.241914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-77e752ef-2cb9-44bb-ba96-7d06511c23dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:35.257635 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:35.481641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1116/2260] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:35.493034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eca53-5daa-4dec-8a64-3dbdb164c0d5 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:35.493876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eca53-5daa-4dec-8a64-3dbdb164c0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:35.494331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eca53-5daa-4dec-8a64-3dbdb164c0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:35.552605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b94eca53-5daa-4dec-8a64-3dbdb164c0d5 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:35.553706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b94eca53-5daa-4dec-8a64-3dbdb164c0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:35.596099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1145/2261] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:35.601273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e752ef-2cb9-44bb-ba96-7d06511c23dc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:35.637196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e752ef-2cb9-44bb-ba96-7d06511c23dc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:35.657861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea070209-f749-46c4-a341-8910dfda2d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:35.658527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea070209-f749-46c4-a341-8910dfda2d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:35.658809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea070209-f749-46c4-a341-8910dfda2d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:35.659083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea070209-f749-46c4-a341-8910dfda2d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:35.659746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea070209-f749-46c4-a341-8910dfda2d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:30:35.660053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea070209-f749-46c4-a341-8910dfda2d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:35.670812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea070209-f749-46c4-a341-8910dfda2d41 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:35.696347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ec0ad-6d83-4823-a8a4-7c9320371fd9 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:35.697389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ec0ad-6d83-4823-a8a4-7c9320371fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:35.697389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ec0ad-6d83-4823-a8a4-7c9320371fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:35.712603 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1117/2262] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:30:35.720399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea070209-f749-46c4-a341-8910dfda2d41 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:35.769578 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea070209-f749-46c4-a341-8910dfda2d41 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:35.790372 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9fecd-5501-446e-a54e-a30529261ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:35.791334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9fecd-5501-446e-a54e-a30529261ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:35.791614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9fecd-5501-446e-a54e-a30529261ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:35.791888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9fecd-5501-446e-a54e-a30529261ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:35.792570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9fecd-5501-446e-a54e-a30529261ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:35.802831 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9fecd-5501-446e-a54e-a30529261ea9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:35.804615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c93ec0ad-6d83-4823-a8a4-7c9320371fd9 None None] MFA Rules not processed for user `f49fa74ba8b649eb871da0b154840751`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:35.805941 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c93ec0ad-6d83-4823-a8a4-7c9320371fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:35.920424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1118/2263] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:30:35 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:35.921938 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9fecd-5501-446e-a54e-a30529261ea9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:35.988604 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1146/2264] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:35.993652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ec0ad-6d83-4823-a8a4-7c9320371fd9 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:35.996536 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c93ec0ad-6d83-4823-a8a4-7c9320371fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:36.035525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ec0ad-6d83-4823-a8a4-7c9320371fd9 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:36.149544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9fecd-5501-446e-a54e-a30529261ea9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:36.168224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fac07-393a-42bd-ab65-3127b2456e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:36.168947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fac07-393a-42bd-ab65-3127b2456e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:36.169138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fac07-393a-42bd-ab65-3127b2456e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:36.169440 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fac07-393a-42bd-ab65-3127b2456e52 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:36.170935 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fac07-393a-42bd-ab65-3127b2456e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:36.177850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fac07-393a-42bd-ab65-3127b2456e52 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:36.193959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafa29b-9856-43fb-90ec-0ac64437de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:36.195900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafa29b-9856-43fb-90ec-0ac64437de68 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:36.195900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafa29b-9856-43fb-90ec-0ac64437de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:36.195900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafa29b-9856-43fb-90ec-0ac64437de68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:36.195900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafa29b-9856-43fb-90ec-0ac64437de68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:36.203179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafa29b-9856-43fb-90ec-0ac64437de68 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:36.237216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1119/2265] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:30:35 2022] POST /identity/v3/users => generated 289 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:36.238067 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fac07-393a-42bd-ab65-3127b2456e52 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:36.279698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fac07-393a-42bd-ab65-3127b2456e52 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:36.297253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1147/2266] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:30:35 2022] POST /identity/v3/projects => generated 369 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:36.298507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafa29b-9856-43fb-90ec-0ac64437de68 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:36.300760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e409a45-82d0-4174-8c95-8050dff90cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:36.304064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e409a45-82d0-4174-8c95-8050dff90cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:36.314623 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e409a45-82d0-4174-8c95-8050dff90cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:36.315212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e409a45-82d0-4174-8c95-8050dff90cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:36.315644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e409a45-82d0-4174-8c95-8050dff90cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:36.317315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e409a45-82d0-4174-8c95-8050dff90cbb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:36.345478 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1120/2267] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:36.350304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e409a45-82d0-4174-8c95-8050dff90cbb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:36.391079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e409a45-82d0-4174-8c95-8050dff90cbb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:36.488199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafa29b-9856-43fb-90ec-0ac64437de68 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:36.502616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4fa72-5d02-49a1-869c-d9e6a000aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:36.503471 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4fa72-5d02-49a1-869c-d9e6a000aca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:36.504414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4fa72-5d02-49a1-869c-d9e6a000aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:36.506039 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4fa72-5d02-49a1-869c-d9e6a000aca1 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:36.510295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4fa72-5d02-49a1-869c-d9e6a000aca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:36.512705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4fa72-5d02-49a1-869c-d9e6a000aca1 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:36.534304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:36.553608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c6333-02f3-47f7-9656-eafcb8da3522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:36.554654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c6333-02f3-47f7-9656-eafcb8da3522 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:36.555531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c6333-02f3-47f7-9656-eafcb8da3522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:36.556297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c6333-02f3-47f7-9656-eafcb8da3522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:36.558807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c6333-02f3-47f7-9656-eafcb8da3522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:36.560955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c6333-02f3-47f7-9656-eafcb8da3522 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:36.567807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:36.582373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1148/2268] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:30:36 2022] POST /identity/v3/users => generated 291 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:36.587258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1121/2269] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:36.593484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4fa72-5d02-49a1-869c-d9e6a000aca1 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:36.597827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c6333-02f3-47f7-9656-eafcb8da3522 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:36.623529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4fa72-5d02-49a1-869c-d9e6a000aca1 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:36.633598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c6333-02f3-47f7-9656-eafcb8da3522 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:36.650117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f034302-cbf9-4b3c-a5d4-9cf37668093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:36.655050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506606a-f363-453d-a591-52cdc0bfb1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:36.658838 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f034302-cbf9-4b3c-a5d4-9cf37668093e admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:36.659224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f034302-cbf9-4b3c-a5d4-9cf37668093e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:36.659392 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f034302-cbf9-4b3c-a5d4-9cf37668093e admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:36.660094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f034302-cbf9-4b3c-a5d4-9cf37668093e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:36.660803 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506606a-f363-453d-a591-52cdc0bfb1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:36.661352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506606a-f363-453d-a591-52cdc0bfb1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:36.661688 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506606a-f363-453d-a591-52cdc0bfb1dc admin admin] PATH_INFO: `/v3/projects/c3a1e1d9943143a0a227ddfbe858e910/users/3460d8fdf1f948d8b0f4df1902d558d5/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:36.664404 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f034302-cbf9-4b3c-a5d4-9cf37668093e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:36.697497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506606a-f363-453d-a591-52cdc0bfb1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a1e1d9943143a0a227ddfbe858e910, user_id=3460d8fdf1f948d8b0f4df1902d558d5, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:36.707754 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1149/2270] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:36.707982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506606a-f363-453d-a591-52cdc0bfb1dc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:36.709609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f034302-cbf9-4b3c-a5d4-9cf37668093e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:36.736253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f034302-cbf9-4b3c-a5d4-9cf37668093e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:36.757519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1122/2271] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:36 2022] PUT /identity/v3/projects/c3a1e1d9943143a0a227ddfbe858e910/users/3460d8fdf1f948d8b0f4df1902d558d5/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:36.774537 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986e41-f683-4d63-896e-5deaf5a8ca46 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:36.774832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986e41-f683-4d63-896e-5deaf5a8ca46 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:36.775100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986e41-f683-4d63-896e-5deaf5a8ca46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:36.858184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f0986e41-f683-4d63-896e-5deaf5a8ca46 None None] MFA Rules not processed for user `3460d8fdf1f948d8b0f4df1902d558d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:36.865102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f0986e41-f683-4d63-896e-5deaf5a8ca46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:36.954939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1401a5-673d-4a4e-8091-886e408d59cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:36.956504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1401a5-673d-4a4e-8091-886e408d59cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:36.959202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1401a5-673d-4a4e-8091-886e408d59cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:36.960164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1401a5-673d-4a4e-8091-886e408d59cc admin admin] PATH_INFO: `/v3/projects/7238992108d14f18b392cee049a3e092/users/a20d7700bd124f1e849987786d756fea/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:37.024418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1401a5-673d-4a4e-8091-886e408d59cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7238992108d14f18b392cee049a3e092, user_id=a20d7700bd124f1e849987786d756fea, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:37.034357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1401a5-673d-4a4e-8091-886e408d59cc admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:37.084304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1150/2272] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:36 2022] PUT /identity/v3/projects/7238992108d14f18b392cee049a3e092/users/a20d7700bd124f1e849987786d756fea/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:37.085504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1401a5-673d-4a4e-8091-886e408d59cc admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:37.102557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1123/2273] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:37.111710 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0986e41-f683-4d63-896e-5deaf5a8ca46 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:37.143121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0986e41-f683-4d63-896e-5deaf5a8ca46 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:37.303374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1401a5-673d-4a4e-8091-886e408d59cc admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:37.310593 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ba2a8-566d-40b0-8caf-9258a4834130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:37.310593 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ba2a8-566d-40b0-8caf-9258a4834130 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:37.310593 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ba2a8-566d-40b0-8caf-9258a4834130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:37.311588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ba2a8-566d-40b0-8caf-9258a4834130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:37.313001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ba2a8-566d-40b0-8caf-9258a4834130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:37.315878 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ba2a8-566d-40b0-8caf-9258a4834130 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:37.324678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e339e6-bb6c-42d9-ba45-d52f9a941683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:37.325688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e339e6-bb6c-42d9-ba45-d52f9a941683 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:37.326190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e339e6-bb6c-42d9-ba45-d52f9a941683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:37.326729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e339e6-bb6c-42d9-ba45-d52f9a941683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:37.327724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e339e6-bb6c-42d9-ba45-d52f9a941683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:37.329816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e339e6-bb6c-42d9-ba45-d52f9a941683 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:37.353617 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1151/2274] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:37.355674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91747-aa7d-4c62-b046-015b9a4153db None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:37.356383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91747-aa7d-4c62-b046-015b9a4153db None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:37.357022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91747-aa7d-4c62-b046-015b9a4153db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:37.399658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-1ff91747-aa7d-4c62-b046-015b9a4153db None None] MFA Rules not processed for user `e3a473b5ad2f43db852f57f83d48240b`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:37.403653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-1ff91747-aa7d-4c62-b046-015b9a4153db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:37.414621 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1124/2275] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:30:37 2022] POST /identity/v3/projects => generated 375 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:37.419156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ba2a8-566d-40b0-8caf-9258a4834130 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:37.512095 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1152/2276] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:37.513173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91747-aa7d-4c62-b046-015b9a4153db None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:37.522167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:37.538619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:37.575236 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ba2a8-566d-40b0-8caf-9258a4834130 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:37.589210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecf312-2e0d-4713-9eb5-b07bca30d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:37.589904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecf312-2e0d-4713-9eb5-b07bca30d800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:37.590195 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecf312-2e0d-4713-9eb5-b07bca30d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:37.590509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecf312-2e0d-4713-9eb5-b07bca30d800 admin admin] PATH_INFO: `/v3/projects/7238992108d14f18b392cee049a3e092/users/a20d7700bd124f1e849987786d756fea/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:37.595604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecf312-2e0d-4713-9eb5-b07bca30d800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7238992108d14f18b392cee049a3e092, user_id=a20d7700bd124f1e849987786d756fea, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:37.599714 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecf312-2e0d-4713-9eb5-b07bca30d800 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:37.638840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1125/2277] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:37 2022] PUT /identity/v3/projects/7238992108d14f18b392cee049a3e092/users/a20d7700bd124f1e849987786d756fea/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:37.657016 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91747-aa7d-4c62-b046-015b9a4153db None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:37.833933 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3ce9c-6141-4563-a2d2-bfe16dd1a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:37.839269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3ce9c-6141-4563-a2d2-bfe16dd1a65e admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:37.842053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3ce9c-6141-4563-a2d2-bfe16dd1a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:37.843466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3ce9c-6141-4563-a2d2-bfe16dd1a65e admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:37.844591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3ce9c-6141-4563-a2d2-bfe16dd1a65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:37.860668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3ce9c-6141-4563-a2d2-bfe16dd1a65e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:37.955018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1153/2278] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:30:37 2022] POST /identity/v3/users => generated 288 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:37.959025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecf312-2e0d-4713-9eb5-b07bca30d800 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:37.979580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecf312-2e0d-4713-9eb5-b07bca30d800 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:37.996932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a1854-c5c0-4e5c-9c24-747df5c1cefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:37.998667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a1854-c5c0-4e5c-9c24-747df5c1cefc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:37.999245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a1854-c5c0-4e5c-9c24-747df5c1cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:37.999755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a1854-c5c0-4e5c-9c24-747df5c1cefc admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:38.000658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a1854-c5c0-4e5c-9c24-747df5c1cefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:38.002632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a1854-c5c0-4e5c-9c24-747df5c1cefc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:38.023674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1126/2279] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:38.029758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3ce9c-6141-4563-a2d2-bfe16dd1a65e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:38.048008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3ce9c-6141-4563-a2d2-bfe16dd1a65e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:38.056282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2c9c2-4385-456b-bedd-4969a620e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:38.057273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2c9c2-4385-456b-bedd-4969a620e808 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:38.060348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2c9c2-4385-456b-bedd-4969a620e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:38.061175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2c9c2-4385-456b-bedd-4969a620e808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:38.063118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2c9c2-4385-456b-bedd-4969a620e808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:38.065842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2c9c2-4385-456b-bedd-4969a620e808 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:38.093639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1154/2280] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:38.099701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a1854-c5c0-4e5c-9c24-747df5c1cefc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:38.118459 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a1854-c5c0-4e5c-9c24-747df5c1cefc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:38.127608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d941181-23b2-4b8c-b7a3-2559b6319999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:38.128734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d941181-23b2-4b8c-b7a3-2559b6319999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:38.129519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d941181-23b2-4b8c-b7a3-2559b6319999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:38.129902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d941181-23b2-4b8c-b7a3-2559b6319999 admin admin] PATH_INFO: `/v3/projects/fdca972aa4844b16a014365982d2eecd/users/7559c3b6c12d4844b3be52facbc451d5/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:38.166931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d941181-23b2-4b8c-b7a3-2559b6319999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdca972aa4844b16a014365982d2eecd, user_id=7559c3b6c12d4844b3be52facbc451d5, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:38.170007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d941181-23b2-4b8c-b7a3-2559b6319999 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:38.233474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1127/2281] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:38 2022] PUT /identity/v3/projects/fdca972aa4844b16a014365982d2eecd/users/7559c3b6c12d4844b3be52facbc451d5/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:30:38.235744 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37384056-e280-48b3-88dd-306199d371c5 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:38.238805 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37384056-e280-48b3-88dd-306199d371c5 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:38.239330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37384056-e280-48b3-88dd-306199d371c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:38.373354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-37384056-e280-48b3-88dd-306199d371c5 None None] MFA Rules not processed for user `7559c3b6c12d4844b3be52facbc451d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:38.380395 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-37384056-e280-48b3-88dd-306199d371c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:38.690773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1155/2282] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:38.692204 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d941181-23b2-4b8c-b7a3-2559b6319999 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:38.992195 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d941181-23b2-4b8c-b7a3-2559b6319999 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:39.004031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf0d20-9113-469a-8de5-ee6a8fd21067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:39.006278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf0d20-9113-469a-8de5-ee6a8fd21067 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:39.007649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf0d20-9113-469a-8de5-ee6a8fd21067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:39.008893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf0d20-9113-469a-8de5-ee6a8fd21067 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:39.010228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf0d20-9113-469a-8de5-ee6a8fd21067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:39.013568 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf0d20-9113-469a-8de5-ee6a8fd21067 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:39.087799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1128/2283] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:30:38 2022] POST /identity/v3/projects => generated 375 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:39.088913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37384056-e280-48b3-88dd-306199d371c5 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:39.135452 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37384056-e280-48b3-88dd-306199d371c5 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:39.206486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:39.275675 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb933f9-903a-4570-9704-c2d7e8d793c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:39.276488 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb933f9-903a-4570-9704-c2d7e8d793c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:39.276893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb933f9-903a-4570-9704-c2d7e8d793c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:39.277291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb933f9-903a-4570-9704-c2d7e8d793c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:39.278014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb933f9-903a-4570-9704-c2d7e8d793c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:39.282425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb933f9-903a-4570-9704-c2d7e8d793c8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:39.333804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1156/2284] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:30:39 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:39.337580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf0d20-9113-469a-8de5-ee6a8fd21067 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:39.407283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf0d20-9113-469a-8de5-ee6a8fd21067 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:39.438868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed9c25-f645-4fb7-a589-1e56cce1fe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:39.439710 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed9c25-f645-4fb7-a589-1e56cce1fe25 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:39.439951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed9c25-f645-4fb7-a589-1e56cce1fe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:39.440182 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed9c25-f645-4fb7-a589-1e56cce1fe25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:39.440825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed9c25-f645-4fb7-a589-1e56cce1fe25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:39.445160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed9c25-f645-4fb7-a589-1e56cce1fe25 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:39.504922 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1129/2285] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:39.507131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb933f9-903a-4570-9704-c2d7e8d793c8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:39.522998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb933f9-903a-4570-9704-c2d7e8d793c8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:39.534098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c03841-a767-4233-8d3c-aacf5364fc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:39.535813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c03841-a767-4233-8d3c-aacf5364fc44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:39.536117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c03841-a767-4233-8d3c-aacf5364fc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:39.536985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c03841-a767-4233-8d3c-aacf5364fc44 admin admin] PATH_INFO: `/v3/projects/5464701a9d094525ba5f92f818e832de/users/0b592e01bd2a47c39b96fcc7dd83115a/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:39.579670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c03841-a767-4233-8d3c-aacf5364fc44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5464701a9d094525ba5f92f818e832de, user_id=0b592e01bd2a47c39b96fcc7dd83115a, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:39.587421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c03841-a767-4233-8d3c-aacf5364fc44 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:39.661659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1157/2286] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:39 2022] PUT /identity/v3/projects/5464701a9d094525ba5f92f818e832de/users/0b592e01bd2a47c39b96fcc7dd83115a/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:39.663509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed9c25-f645-4fb7-a589-1e56cce1fe25 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:39.683443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed9c25-f645-4fb7-a589-1e56cce1fe25 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:39.892943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a09e20-2585-43ea-80b4-d04ae6b3a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:39.893766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a09e20-2585-43ea-80b4-d04ae6b3a0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:39.893886 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a09e20-2585-43ea-80b4-d04ae6b3a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:39.894173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a09e20-2585-43ea-80b4-d04ae6b3a0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:39.894842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a09e20-2585-43ea-80b4-d04ae6b3a0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:39.896469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a09e20-2585-43ea-80b4-d04ae6b3a0c8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:39.939376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1130/2287] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:39.941790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c03841-a767-4233-8d3c-aacf5364fc44 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:39.957260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c03841-a767-4233-8d3c-aacf5364fc44 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:39.978775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df57d37-06d4-4a35-ac79-5a8e4de95dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:39.979491 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df57d37-06d4-4a35-ac79-5a8e4de95dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:39.979775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df57d37-06d4-4a35-ac79-5a8e4de95dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:39.980051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df57d37-06d4-4a35-ac79-5a8e4de95dbc admin admin] PATH_INFO: `/v3/projects/5464701a9d094525ba5f92f818e832de/users/0b592e01bd2a47c39b96fcc7dd83115a/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:39.988698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df57d37-06d4-4a35-ac79-5a8e4de95dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5464701a9d094525ba5f92f818e832de, user_id=0b592e01bd2a47c39b96fcc7dd83115a, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:39.999897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df57d37-06d4-4a35-ac79-5a8e4de95dbc admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:40.054465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1158/2288] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:39 2022] PUT /identity/v3/projects/5464701a9d094525ba5f92f818e832de/users/0b592e01bd2a47c39b96fcc7dd83115a/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:40.137131 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419800a9-8dad-4d5e-a441-0112cb00d7e2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:40.137490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419800a9-8dad-4d5e-a441-0112cb00d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:40.137688 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419800a9-8dad-4d5e-a441-0112cb00d7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:40.227454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:40.295443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-419800a9-8dad-4d5e-a441-0112cb00d7e2 None None] MFA Rules not processed for user `0b592e01bd2a47c39b96fcc7dd83115a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:40.297716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-419800a9-8dad-4d5e-a441-0112cb00d7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:40.797690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1131/2289] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 662 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:40.838329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df57d37-06d4-4a35-ac79-5a8e4de95dbc admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:40.844760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6df57d37-06d4-4a35-ac79-5a8e4de95dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:41.191136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df57d37-06d4-4a35-ac79-5a8e4de95dbc admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:41.209522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7518b-9579-4c92-bf40-0f63d429912e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:41.210414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7518b-9579-4c92-bf40-0f63d429912e service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:41.214168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7518b-9579-4c92-bf40-0f63d429912e service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:41.214611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7518b-9579-4c92-bf40-0f63d429912e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:41.454692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7518b-9579-4c92-bf40-0f63d429912e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:41.456043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7518b-9579-4c92-bf40-0f63d429912e service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:41.491599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1159/2290] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:43.903758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419800a9-8dad-4d5e-a441-0112cb00d7e2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:43.905211 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-419800a9-8dad-4d5e-a441-0112cb00d7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:43.926937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419800a9-8dad-4d5e-a441-0112cb00d7e2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:43.933689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d46cd-ffc7-42dd-9e01-90ba361d148b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:43.934662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d46cd-ffc7-42dd-9e01-90ba361d148b service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:43.935122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d46cd-ffc7-42dd-9e01-90ba361d148b service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:43.945766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d46cd-ffc7-42dd-9e01-90ba361d148b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:44.135189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d46cd-ffc7-42dd-9e01-90ba361d148b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:44.139570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d46cd-ffc7-42dd-9e01-90ba361d148b service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:44.179143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1132/2291] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:45.433611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7518b-9579-4c92-bf40-0f63d429912e service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:45.445930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7518b-9579-4c92-bf40-0f63d429912e service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:45.464572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88caedb-514a-4bf2-9a6c-c5296c0cbdf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:45.465215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88caedb-514a-4bf2-9a6c-c5296c0cbdf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:45.465920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88caedb-514a-4bf2-9a6c-c5296c0cbdf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:45.465920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88caedb-514a-4bf2-9a6c-c5296c0cbdf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:45.495615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88caedb-514a-4bf2-9a6c-c5296c0cbdf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:45.507269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88caedb-514a-4bf2-9a6c-c5296c0cbdf4 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:45.563666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1160/2292] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:47.554021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2412ed-f823-4583-b0c5-33b372f18e5e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:47.554552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2412ed-f823-4583-b0c5-33b372f18e5e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:47.555024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2412ed-f823-4583-b0c5-33b372f18e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:47.604376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6b2412ed-f823-4583-b0c5-33b372f18e5e None None] MFA Rules not processed for user `a20d7700bd124f1e849987786d756fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:47.605321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6b2412ed-f823-4583-b0c5-33b372f18e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:47.706294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1133/2293] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:47.712975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88caedb-514a-4bf2-9a6c-c5296c0cbdf4 service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:47.716705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f88caedb-514a-4bf2-9a6c-c5296c0cbdf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:47.747403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:47.829435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88caedb-514a-4bf2-9a6c-c5296c0cbdf4 service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:47.842089 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dcebb-5d6c-4aaf-bc56-10fd4a5bfe5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:47.842907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dcebb-5d6c-4aaf-bc56-10fd4a5bfe5d service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:47.843239 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dcebb-5d6c-4aaf-bc56-10fd4a5bfe5d service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:47.843565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dcebb-5d6c-4aaf-bc56-10fd4a5bfe5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:47.932656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dcebb-5d6c-4aaf-bc56-10fd4a5bfe5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:47.934326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dcebb-5d6c-4aaf-bc56-10fd4a5bfe5d service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:47.955648 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1161/2294] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:49.576776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028589-51db-4e02-a5d2-32bfda9702c0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:49.577657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028589-51db-4e02-a5d2-32bfda9702c0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:49.578096 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028589-51db-4e02-a5d2-32bfda9702c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:49.600454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-74028589-51db-4e02-a5d2-32bfda9702c0 None None] MFA Rules not processed for user `cf97527da5b946d8bf92de3b06f7ae0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:49.601757 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-74028589-51db-4e02-a5d2-32bfda9702c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:49.615614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:49.688306 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1134/2295] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:49.731840 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d1d8e-e1a5-456e-91a2-67afb96d64bc None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:49.733006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d1d8e-e1a5-456e-91a2-67afb96d64bc None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:49.733504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d1d8e-e1a5-456e-91a2-67afb96d64bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:49.757877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b05d1d8e-e1a5-456e-91a2-67afb96d64bc None None] MFA Rules not processed for user `f49fa74ba8b649eb871da0b154840751`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:49.759943 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b05d1d8e-e1a5-456e-91a2-67afb96d64bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:49.772703 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1162/2296] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:50.236471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74028589-51db-4e02-a5d2-32bfda9702c0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:50.366425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74028589-51db-4e02-a5d2-32bfda9702c0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:50.382515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:50.383444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:50.383947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:50.384229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] PATH_INFO: `/v3/users/3460d8fdf1f948d8b0f4df1902d558d5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:50.385523 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3460d8fdf1f948d8b0f4df1902d558d5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:50.390722 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:50.506166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3460d8fdf1f948d8b0f4df1902d558d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:50.520480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3460d8fdf1f948d8b0f4df1902d558d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:50.536506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3460d8fdf1f948d8b0f4df1902d558d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:50.537346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3460d8fdf1f948d8b0f4df1902d558d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:50.538063 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3460d8fdf1f948d8b0f4df1902d558d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:50.557841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1135/2297] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:30:50 2022] DELETE /identity/v3/users/3460d8fdf1f948d8b0f4df1902d558d5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:50.562597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84d176-134b-4e28-b55b-eb7dedf24bbf None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:50.562992 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84d176-134b-4e28-b55b-eb7dedf24bbf None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:50.563421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84d176-134b-4e28-b55b-eb7dedf24bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:50.588012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-da84d176-134b-4e28-b55b-eb7dedf24bbf None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:50.590274 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-da84d176-134b-4e28-b55b-eb7dedf24bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:50.684236 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1163/2298] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:30:50.694793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:50.697474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:50.758985 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:50.781099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f886e9-a467-46b4-add4-acf7d417e83c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:50.786540 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d06392-4c08-4bb8-86e5-b8c3deafc833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:50.787344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d06392-4c08-4bb8-86e5-b8c3deafc833 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:50.788235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d06392-4c08-4bb8-86e5-b8c3deafc833 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:50.788235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d06392-4c08-4bb8-86e5-b8c3deafc833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:50.799733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d06392-4c08-4bb8-86e5-b8c3deafc833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:50.801346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d06392-4c08-4bb8-86e5-b8c3deafc833 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:50.818582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1136/2299] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:30:51.443454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84d176-134b-4e28-b55b-eb7dedf24bbf None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:51.446068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-da84d176-134b-4e28-b55b-eb7dedf24bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:51.464116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84d176-134b-4e28-b55b-eb7dedf24bbf None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:51.475423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:51.476307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:51.477717 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:51.478282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] PATH_INFO: `/v3/projects/c3a1e1d9943143a0a227ddfbe858e910` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:51.480079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a1e1d9943143a0a227ddfbe858e910)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:51.483349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:51.584977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:51.589334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a1e1d9943143a0a227ddfbe858e910', 'request_id': 'req-7ab04fe9-ab53-4a31-a510-9662c124ed01'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:51.596700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a1e1d9943143a0a227ddfbe858e910', 'request_id': 'req-7ab04fe9-ab53-4a31-a510-9662c124ed01'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:51.605170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a1e1d9943143a0a227ddfbe858e910', 'request_id': 'req-7ab04fe9-ab53-4a31-a510-9662c124ed01'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:51.620607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] The token cache is being invalidate because project c3a1e1d9943143a0a227ddfbe858e910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:30:51.620900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:51.621588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:51.623124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1164/2300] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:30:51 2022] DELETE /identity/v3/projects/c3a1e1d9943143a0a227ddfbe858e910 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:51.627143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d06392-4c08-4bb8-86e5-b8c3deafc833 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:51.637669 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d06392-4c08-4bb8-86e5-b8c3deafc833 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:51.736458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:51.737099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:51.737550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:51.737986 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] PATH_INFO: `/v3/users/7559c3b6c12d4844b3be52facbc451d5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:51.739481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7559c3b6c12d4844b3be52facbc451d5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:51.742258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:51.804624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7559c3b6c12d4844b3be52facbc451d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:51.812726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7559c3b6c12d4844b3be52facbc451d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:51.828684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7559c3b6c12d4844b3be52facbc451d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:51.829444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7559c3b6c12d4844b3be52facbc451d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:51.830049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7559c3b6c12d4844b3be52facbc451d5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:51.847187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1137/2301] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:30:51 2022] DELETE /identity/v3/users/7559c3b6c12d4844b3be52facbc451d5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:52.235960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:52.241419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:52.260577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab04fe9-ab53-4a31-a510-9662c124ed01 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:52.325932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:52.326621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:52.326903 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:52.327174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] PATH_INFO: `/v3/projects/fdca972aa4844b16a014365982d2eecd` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:52.328292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdca972aa4844b16a014365982d2eecd)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:52.330247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:52.390242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdca972aa4844b16a014365982d2eecd', 'request_id': 'req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:52.397525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdca972aa4844b16a014365982d2eecd', 'request_id': 'req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:52.405718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdca972aa4844b16a014365982d2eecd', 'request_id': 'req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:52.422215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] The token cache is being invalidate because project fdca972aa4844b16a014365982d2eecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:30:52.422540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:52.423168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:52.424655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1165/2302] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:30:52 2022] DELETE /identity/v3/projects/fdca972aa4844b16a014365982d2eecd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:52.428609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:52.430535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:52.443345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81d26e-c753-4fbd-a471-6f35b4c16cf5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:52.508269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffd80a-693a-4423-b523-b2d44b62cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:52.509166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffd80a-693a-4423-b523-b2d44b62cabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:52.509531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffd80a-693a-4423-b523-b2d44b62cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:52.509859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffd80a-693a-4423-b523-b2d44b62cabb admin admin] PATH_INFO: `/v3/users/0b592e01bd2a47c39b96fcc7dd83115a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:52.511082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffd80a-693a-4423-b523-b2d44b62cabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b592e01bd2a47c39b96fcc7dd83115a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:52.514805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffd80a-693a-4423-b523-b2d44b62cabb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:52.520151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:52.590433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d4ffd80a-693a-4423-b523-b2d44b62cabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b592e01bd2a47c39b96fcc7dd83115a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:52.605352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d4ffd80a-693a-4423-b523-b2d44b62cabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b592e01bd2a47c39b96fcc7dd83115a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:52.619495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d4ffd80a-693a-4423-b523-b2d44b62cabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b592e01bd2a47c39b96fcc7dd83115a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:52.629909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d4ffd80a-693a-4423-b523-b2d44b62cabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b592e01bd2a47c39b96fcc7dd83115a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:52.632458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d4ffd80a-693a-4423-b523-b2d44b62cabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b592e01bd2a47c39b96fcc7dd83115a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:52.654093 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1138/2303] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:30:52 2022] DELETE /identity/v3/users/0b592e01bd2a47c39b96fcc7dd83115a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:52.970986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:52.972611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:52.989834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386cd6e-1eb1-4f5f-b6d0-33617a65d561 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:53.065843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aabbcc-561a-411c-b102-204df912f45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:53.066547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aabbcc-561a-411c-b102-204df912f45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:53.066818 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aabbcc-561a-411c-b102-204df912f45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:53.067162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aabbcc-561a-411c-b102-204df912f45c admin admin] PATH_INFO: `/v3/projects/5464701a9d094525ba5f92f818e832de` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:53.068758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aabbcc-561a-411c-b102-204df912f45c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5464701a9d094525ba5f92f818e832de)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:53.074828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aabbcc-561a-411c-b102-204df912f45c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:53.084279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:53.139606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-04aabbcc-561a-411c-b102-204df912f45c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5464701a9d094525ba5f92f818e832de', 'request_id': 'req-04aabbcc-561a-411c-b102-204df912f45c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:53.147370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-04aabbcc-561a-411c-b102-204df912f45c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5464701a9d094525ba5f92f818e832de', 'request_id': 'req-04aabbcc-561a-411c-b102-204df912f45c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:53.154952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-04aabbcc-561a-411c-b102-204df912f45c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5464701a9d094525ba5f92f818e832de', 'request_id': 'req-04aabbcc-561a-411c-b102-204df912f45c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:53.171096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-04aabbcc-561a-411c-b102-204df912f45c admin admin] The token cache is being invalidate because project 5464701a9d094525ba5f92f818e832de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:30:53.171383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-04aabbcc-561a-411c-b102-204df912f45c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:53.172065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-04aabbcc-561a-411c-b102-204df912f45c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:30:53.173980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1166/2304] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:30:52 2022] DELETE /identity/v3/projects/5464701a9d094525ba5f92f818e832de => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:30:53.178839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f9834-7317-4841-9da7-1edf9963b2ec None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:53.179340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f9834-7317-4841-9da7-1edf9963b2ec None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:53.179778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f9834-7317-4841-9da7-1edf9963b2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:53.204748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7f7f9834-7317-4841-9da7-1edf9963b2ec None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:53.206677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7f7f9834-7317-4841-9da7-1edf9963b2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:53.277894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c888c25-8051-40c1-a066-7f24a2a07814 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:53.278264 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c888c25-8051-40c1-a066-7f24a2a07814 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:53.278638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c888c25-8051-40c1-a066-7f24a2a07814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:53.298090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1139/2305] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:53.306040 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885c6c6-3dd9-4c0b-b22e-48d5fceae089 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:53.306606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885c6c6-3dd9-4c0b-b22e-48d5fceae089 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:53.307051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885c6c6-3dd9-4c0b-b22e-48d5fceae089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:53.316319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-4c888c25-8051-40c1-a066-7f24a2a07814 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:53.317810 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4c888c25-8051-40c1-a066-7f24a2a07814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:53.328474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4885c6c6-3dd9-4c0b-b22e-48d5fceae089 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:53.329719 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4885c6c6-3dd9-4c0b-b22e-48d5fceae089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:53.343632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1140/2306] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:53.347985 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885c6c6-3dd9-4c0b-b22e-48d5fceae089 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:53.360609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885c6c6-3dd9-4c0b-b22e-48d5fceae089 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:53.367183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c16a4-1f7d-40bf-bbf9-92db31e6936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:53.367870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c16a4-1f7d-40bf-bbf9-92db31e6936f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:53.368284 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c16a4-1f7d-40bf-bbf9-92db31e6936f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:53.368645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c16a4-1f7d-40bf-bbf9-92db31e6936f admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:53.369448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c16a4-1f7d-40bf-bbf9-92db31e6936f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:30:53.369823 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c16a4-1f7d-40bf-bbf9-92db31e6936f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:53.380939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c16a4-1f7d-40bf-bbf9-92db31e6936f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:53.410472 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1141/2307] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:30:53.417025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c16a4-1f7d-40bf-bbf9-92db31e6936f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:53.431989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c16a4-1f7d-40bf-bbf9-92db31e6936f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:53.438605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf40085-7faf-4966-84e8-5ba790cdd31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:53.439332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf40085-7faf-4966-84e8-5ba790cdd31e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:53.439668 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf40085-7faf-4966-84e8-5ba790cdd31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:53.439999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf40085-7faf-4966-84e8-5ba790cdd31e admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:53.440700 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf40085-7faf-4966-84e8-5ba790cdd31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:53.442899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf40085-7faf-4966-84e8-5ba790cdd31e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:53.443723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1167/2308] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:30:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:53.457740 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c888c25-8051-40c1-a066-7f24a2a07814 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:53.459443 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-4c888c25-8051-40c1-a066-7f24a2a07814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:53.501311 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1142/2309] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:30:53 2022] POST /identity/v3/projects => generated 391 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:30:53.505626 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf40085-7faf-4966-84e8-5ba790cdd31e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:53.558283 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c888c25-8051-40c1-a066-7f24a2a07814 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:53.579978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:53.617184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf40085-7faf-4966-84e8-5ba790cdd31e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:53.627294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814fa25-e8a8-46bc-a07c-1cd4c77fccdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:53.629652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814fa25-e8a8-46bc-a07c-1cd4c77fccdc admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:53.629979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814fa25-e8a8-46bc-a07c-1cd4c77fccdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:53.630341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814fa25-e8a8-46bc-a07c-1cd4c77fccdc admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:53.631274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814fa25-e8a8-46bc-a07c-1cd4c77fccdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:53.635564 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814fa25-e8a8-46bc-a07c-1cd4c77fccdc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:53.647539 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:53.680649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1143/2310] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:30:53 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:30:53.685208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814fa25-e8a8-46bc-a07c-1cd4c77fccdc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:53.689320 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f00d0-1d87-42f7-8420-11027125e4d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:53.690360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f00d0-1d87-42f7-8420-11027125e4d4 service swift] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:53.694886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f00d0-1d87-42f7-8420-11027125e4d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:53.696093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f00d0-1d87-42f7-8420-11027125e4d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:53.708181 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814fa25-e8a8-46bc-a07c-1cd4c77fccdc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:53.714735 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de753-f8b9-4d41-9afb-589134673707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:53.715858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de753-f8b9-4d41-9afb-589134673707 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:53.716134 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de753-f8b9-4d41-9afb-589134673707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:53.716411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de753-f8b9-4d41-9afb-589134673707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:53.717194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0de753-f8b9-4d41-9afb-589134673707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:53.719865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0de753-f8b9-4d41-9afb-589134673707 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:53.738429 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1144/2311] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:53.740612 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de753-f8b9-4d41-9afb-589134673707 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:53.756349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de753-f8b9-4d41-9afb-589134673707 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:53.763852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ee8a9-3b4a-40f5-93de-1e8be765bd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:53.764695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ee8a9-3b4a-40f5-93de-1e8be765bd2e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:53.765040 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ee8a9-3b4a-40f5-93de-1e8be765bd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:53.765386 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ee8a9-3b4a-40f5-93de-1e8be765bd2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:53.766111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ee8a9-3b4a-40f5-93de-1e8be765bd2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:53.778503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f00d0-1d87-42f7-8420-11027125e4d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:53.781530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ee8a9-3b4a-40f5-93de-1e8be765bd2e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:53.788096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f00d0-1d87-42f7-8420-11027125e4d4 service swift] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:53.800228 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1168/2312] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:30:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 23:30:53.833150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f00d0-1d87-42f7-8420-11027125e4d4 service swift] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:53.834957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1145/2313] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:30:53.852848 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f00d0-1d87-42f7-8420-11027125e4d4 service swift] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:53.873336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b4ab3-1720-4065-8292-cfef202ae413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:53.874045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b4ab3-1720-4065-8292-cfef202ae413 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:53.874322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b4ab3-1720-4065-8292-cfef202ae413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:53.877368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b4ab3-1720-4065-8292-cfef202ae413 admin admin] PATH_INFO: `/v3/projects/b74f76a4ae1c42209351d07e42707c6f/users/8d165cbfb51a498aba3407f1ae7096ff/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:53.956213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b4ab3-1720-4065-8292-cfef202ae413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74f76a4ae1c42209351d07e42707c6f, user_id=8d165cbfb51a498aba3407f1ae7096ff, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:53.960368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b4ab3-1720-4065-8292-cfef202ae413 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:53.993379 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1169/2314] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:30:53 2022] PUT /identity/v3/projects/b74f76a4ae1c42209351d07e42707c6f/users/8d165cbfb51a498aba3407f1ae7096ff/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:30:54.005994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b8746-e87e-4edd-aead-2998964b39fc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:54.006264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b8746-e87e-4edd-aead-2998964b39fc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:54.006575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b8746-e87e-4edd-aead-2998964b39fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:54.090237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-747b8746-e87e-4edd-aead-2998964b39fc None None] MFA Rules not processed for user `8d165cbfb51a498aba3407f1ae7096ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:30:54.091531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-747b8746-e87e-4edd-aead-2998964b39fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:54.319029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1146/2315] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:30:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:30:54.331833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b4ab3-1720-4065-8292-cfef202ae413 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:30:54.333835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b94b4ab3-1720-4065-8292-cfef202ae413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:30:54.442115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b4ab3-1720-4065-8292-cfef202ae413 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:30:54.451845 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd14bb-2326-4d64-995c-8c2bcf713542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:30:54.452498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd14bb-2326-4d64-995c-8c2bcf713542 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:30:54.452781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd14bb-2326-4d64-995c-8c2bcf713542 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:30:54.453218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd14bb-2326-4d64-995c-8c2bcf713542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:30:54.467606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd14bb-2326-4d64-995c-8c2bcf713542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:30:54.471528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd14bb-2326-4d64-995c-8c2bcf713542 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:30:54.482468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1170/2316] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:30:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:31:04.305721 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=52,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:04.477435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=71,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:07.137264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b8746-e87e-4edd-aead-2998964b39fc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:31:07.203934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b8746-e87e-4edd-aead-2998964b39fc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:31:07.208400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:31:07.209036 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:07.209413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:07.209691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] PATH_INFO: `/v3/users/8d165cbfb51a498aba3407f1ae7096ff` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:07.211032 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d165cbfb51a498aba3407f1ae7096ff)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:31:07.213881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:31:07.265455 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d165cbfb51a498aba3407f1ae7096ff'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:31:07.272495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d165cbfb51a498aba3407f1ae7096ff'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:31:07.286193 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d165cbfb51a498aba3407f1ae7096ff'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:31:07.286974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d165cbfb51a498aba3407f1ae7096ff'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:31:07.287593 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d165cbfb51a498aba3407f1ae7096ff'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:31:07.304515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1147/2317] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:31:07 2022] DELETE /identity/v3/users/8d165cbfb51a498aba3407f1ae7096ff => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:31:07.308974 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720ea1-79d7-4fd6-a600-74e2a5e5de14 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:07.309530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720ea1-79d7-4fd6-a600-74e2a5e5de14 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:07.309530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720ea1-79d7-4fd6-a600-74e2a5e5de14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:07.329522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b5720ea1-79d7-4fd6-a600-74e2a5e5de14 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:31:07.330788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b5720ea1-79d7-4fd6-a600-74e2a5e5de14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:07.394977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1171/2318] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:31:07.405561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:31:07.406990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:07.468319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95bf96-cf2a-4687-990f-7c9d0a21dbf0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:31:07.472010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483105e6-675d-4a7d-adec-a5706d3d6819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:31:07.472618 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483105e6-675d-4a7d-adec-a5706d3d6819 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:07.472903 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483105e6-675d-4a7d-adec-a5706d3d6819 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:07.473174 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483105e6-675d-4a7d-adec-a5706d3d6819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:07.482998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483105e6-675d-4a7d-adec-a5706d3d6819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:31:07.484925 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483105e6-675d-4a7d-adec-a5706d3d6819 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:31:07.497171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1148/2319] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:31:07.780388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5720ea1-79d7-4fd6-a600-74e2a5e5de14 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:31:07.782215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b5720ea1-79d7-4fd6-a600-74e2a5e5de14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:07.798753 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5720ea1-79d7-4fd6-a600-74e2a5e5de14 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:31:07.804354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fa465-763a-46b0-8d32-577c0f414a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:31:07.805418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fa465-763a-46b0-8d32-577c0f414a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:07.805725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fa465-763a-46b0-8d32-577c0f414a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:07.806015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fa465-763a-46b0-8d32-577c0f414a48 admin admin] PATH_INFO: `/v3/projects/b74f76a4ae1c42209351d07e42707c6f` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:07.807284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fa465-763a-46b0-8d32-577c0f414a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74f76a4ae1c42209351d07e42707c6f)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:31:07.812949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fa465-763a-46b0-8d32-577c0f414a48 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:31:07.868254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-780fa465-763a-46b0-8d32-577c0f414a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74f76a4ae1c42209351d07e42707c6f', 'request_id': 'req-780fa465-763a-46b0-8d32-577c0f414a48'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:31:07.874956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-780fa465-763a-46b0-8d32-577c0f414a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74f76a4ae1c42209351d07e42707c6f', 'request_id': 'req-780fa465-763a-46b0-8d32-577c0f414a48'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:31:07.881488 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-780fa465-763a-46b0-8d32-577c0f414a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74f76a4ae1c42209351d07e42707c6f', 'request_id': 'req-780fa465-763a-46b0-8d32-577c0f414a48'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:31:07.904666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-780fa465-763a-46b0-8d32-577c0f414a48 admin admin] The token cache is being invalidate because project b74f76a4ae1c42209351d07e42707c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:31:07.904960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-780fa465-763a-46b0-8d32-577c0f414a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:31:07.905591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-780fa465-763a-46b0-8d32-577c0f414a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:31:07.907356 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1172/2320] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:31:07 2022] DELETE /identity/v3/projects/b74f76a4ae1c42209351d07e42707c6f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:31:17.492853 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:17.901426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:38.462820 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483105e6-675d-4a7d-adec-a5706d3d6819 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:31:38.464224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-483105e6-675d-4a7d-adec-a5706d3d6819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:38.475869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483105e6-675d-4a7d-adec-a5706d3d6819 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:31:38.524020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ab38a-2617-4438-9d75-8ce5718a2f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:31:38.524538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ab38a-2617-4438-9d75-8ce5718a2f49 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:38.524815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ab38a-2617-4438-9d75-8ce5718a2f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:38.525084 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ab38a-2617-4438-9d75-8ce5718a2f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:38.526866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4c9ab38a-2617-4438-9d75-8ce5718a2f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:38.589289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ab38a-2617-4438-9d75-8ce5718a2f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:31:38.590766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ab38a-2617-4438-9d75-8ce5718a2f49 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:31:38.600613 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1149/2321] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:31:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:31:39.474354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253253a-4808-4d6d-be4a-4cb0e2a1af17 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:39.475452 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253253a-4808-4d6d-be4a-4cb0e2a1af17 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:39.476029 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253253a-4808-4d6d-be4a-4cb0e2a1af17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:39.504102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-d253253a-4808-4d6d-be4a-4cb0e2a1af17 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:31:39.506796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d253253a-4808-4d6d-be4a-4cb0e2a1af17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:39.564618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1173/2322] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:31:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:31:39.591341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ab38a-2617-4438-9d75-8ce5718a2f49 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:31:39.593276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4c9ab38a-2617-4438-9d75-8ce5718a2f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:39.669317 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ab38a-2617-4438-9d75-8ce5718a2f49 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:31:39.674474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf94169-431e-41eb-a078-e168880d21a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:31:39.675077 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf94169-431e-41eb-a078-e168880d21a2 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:39.675353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf94169-431e-41eb-a078-e168880d21a2 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:39.675620 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf94169-431e-41eb-a078-e168880d21a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:39.685086 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf94169-431e-41eb-a078-e168880d21a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:31:39.686809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf94169-431e-41eb-a078-e168880d21a2 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:31:39.696116 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1150/2323] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:31:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:31:42.509008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253253a-4808-4d6d-be4a-4cb0e2a1af17 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:31:42.510723 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d253253a-4808-4d6d-be4a-4cb0e2a1af17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:42.523257 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253253a-4808-4d6d-be4a-4cb0e2a1af17 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:31:42.526954 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fb333-6f68-4b76-9d34-45fb42ea6091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:31:42.527613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fb333-6f68-4b76-9d34-45fb42ea6091 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:42.527882 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fb333-6f68-4b76-9d34-45fb42ea6091 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:42.528151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fb333-6f68-4b76-9d34-45fb42ea6091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:42.529917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ab1fb333-6f68-4b76-9d34-45fb42ea6091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:42.603423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1fb333-6f68-4b76-9d34-45fb42ea6091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:31:42.604918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1fb333-6f68-4b76-9d34-45fb42ea6091 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:31:42.616197 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1174/2324] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:31:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:31:49.692227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=82 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:52.610541 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=55 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:54.211132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf94169-431e-41eb-a078-e168880d21a2 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:31:54.212539 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2cf94169-431e-41eb-a078-e168880d21a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:54.283436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf94169-431e-41eb-a078-e168880d21a2 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:31:54.288520 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba90a1c-2821-4985-bbb4-40f12c656790 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '559a4af215324597b203e6866cb51fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:31:54.289133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba90a1c-2821-4985-bbb4-40f12c656790 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:54.289415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba90a1c-2821-4985-bbb4-40f12c656790 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:54.289688 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba90a1c-2821-4985-bbb4-40f12c656790 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:54.291745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aba90a1c-2821-4985-bbb4-40f12c656790 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:54.303908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba90a1c-2821-4985-bbb4-40f12c656790 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:31:54.305502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba90a1c-2821-4985-bbb4-40f12c656790 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:31:54.315504 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1151/2325] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:31:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:31:56.151924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de02e02-c46f-4f3a-a96f-0bb11535c0b7 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:56.152482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de02e02-c46f-4f3a-a96f-0bb11535c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:56.152587 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de02e02-c46f-4f3a-a96f-0bb11535c0b7 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:56.154245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1175/2326] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:31:56.159657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f31945-41b6-435c-9d18-14e3df081c62 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:56.160155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f31945-41b6-435c-9d18-14e3df081c62 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:56.160407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f31945-41b6-435c-9d18-14e3df081c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:56.182052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-98f31945-41b6-435c-9d18-14e3df081c62 None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:31:56.183641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-98f31945-41b6-435c-9d18-14e3df081c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:56.254443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1152/2327] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:31:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:31:56.266152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de02e02-c46f-4f3a-a96f-0bb11535c0b7 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:31:56.267916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6de02e02-c46f-4f3a-a96f-0bb11535c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:56.332510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de02e02-c46f-4f3a-a96f-0bb11535c0b7 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:31:56.336255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84012d05-8c99-4578-a7ca-b9108988d067 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f96bbb14c04691ac403271de293224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:31:56.336853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012d05-8c99-4578-a7ca-b9108988d067 service glance] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:56.337130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012d05-8c99-4578-a7ca-b9108988d067 service glance] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:56.337397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012d05-8c99-4578-a7ca-b9108988d067 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:56.347693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84012d05-8c99-4578-a7ca-b9108988d067 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:31:56.349923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84012d05-8c99-4578-a7ca-b9108988d067 service glance] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:31:56.360895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1176/2328] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:31:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:31:56.433502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc14a5-8345-4940-9fa3-9455fe0e44ce None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:56.433916 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc14a5-8345-4940-9fa3-9455fe0e44ce None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:56.434283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc14a5-8345-4940-9fa3-9455fe0e44ce None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:56.435969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1153/2329] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:31:56.441534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c05af-d1d7-4fcb-bdf0-8dae2a31499f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:56.441967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c05af-d1d7-4fcb-bdf0-8dae2a31499f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:56.442251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c05af-d1d7-4fcb-bdf0-8dae2a31499f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:56.462179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-fe5c05af-d1d7-4fcb-bdf0-8dae2a31499f None None] MFA Rules not processed for user `b1d4b0f322c741c5b69b922071aab3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:31:56.463410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-fe5c05af-d1d7-4fcb-bdf0-8dae2a31499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:56.469881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1177/2330] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:31:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:31:56.482326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc14a5-8345-4940-9fa3-9455fe0e44ce None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:31:56.493668 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc14a5-8345-4940-9fa3-9455fe0e44ce None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:31:56.497221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a8b80-e64d-4e80-acd0-8eac2f9f3d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:31:56.497816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a8b80-e64d-4e80-acd0-8eac2f9f3d0e service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:56.498092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a8b80-e64d-4e80-acd0-8eac2f9f3d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:56.498357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a8b80-e64d-4e80-acd0-8eac2f9f3d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:56.505253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a8b80-e64d-4e80-acd0-8eac2f9f3d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:31:56.506724 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a8b80-e64d-4e80-acd0-8eac2f9f3d0e service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:31:56.514241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1154/2331] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:31:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:31:56.596590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bb0b0-3be5-4da8-8938-e641df7d02f5 None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:56.596870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bb0b0-3be5-4da8-8938-e641df7d02f5 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:56.597140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bb0b0-3be5-4da8-8938-e641df7d02f5 None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:56.598496 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1178/2332] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:31:56.604334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd2821-3f75-423a-abec-6966cfd37eb7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:56.604642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd2821-3f75-423a-abec-6966cfd37eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:56.604916 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd2821-3f75-423a-abec-6966cfd37eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:56.624701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4abd2821-3f75-423a-abec-6966cfd37eb7 None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:31:56.625905 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4abd2821-3f75-423a-abec-6966cfd37eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:56.635134 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1155/2333] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:31:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:31:56.645215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bb0b0-3be5-4da8-8938-e641df7d02f5 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:31:56.656630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bb0b0-3be5-4da8-8938-e641df7d02f5 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:31:56.660341 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596c227-8172-4569-aa77-81e064ecd9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:31:56.660945 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596c227-8172-4569-aa77-81e064ecd9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:56.661272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596c227-8172-4569-aa77-81e064ecd9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:56.662161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596c227-8172-4569-aa77-81e064ecd9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:56.672611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596c227-8172-4569-aa77-81e064ecd9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:31:56.674037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596c227-8172-4569-aa77-81e064ecd9b9 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:31:56.684771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1179/2334] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:31:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:31:59.384121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb5c93-7530-40a8-a154-02a55dc29e23 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:59.384614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb5c93-7530-40a8-a154-02a55dc29e23 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:59.384706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb5c93-7530-40a8-a154-02a55dc29e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:59.403906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-20eb5c93-7530-40a8-a154-02a55dc29e23 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:31:59.405079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-20eb5c93-7530-40a8-a154-02a55dc29e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:31:59.413156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1156/2335] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:31:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:31:59.425357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596c227-8172-4569-aa77-81e064ecd9b9 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:31:59.437104 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596c227-8172-4569-aa77-81e064ecd9b9 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:31:59.442109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bfcd1-b803-4e07-bd22-7c9c1f6a3499 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:31:59.442744 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfcd1-b803-4e07-bd22-7c9c1f6a3499 service swift] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:31:59.443019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfcd1-b803-4e07-bd22-7c9c1f6a3499 service swift] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:31:59.443288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfcd1-b803-4e07-bd22-7c9c1f6a3499 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:31:59.451240 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bfcd1-b803-4e07-bd22-7c9c1f6a3499 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:31:59.452809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bfcd1-b803-4e07-bd22-7c9c1f6a3499 service swift] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:31:59.460823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1180/2336] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:31:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:32:09.398635 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=75 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:09.457613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=41 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:24.436874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16827603-2836-4481-99d5-59f7b902bf4e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:32:24.437433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16827603-2836-4481-99d5-59f7b902bf4e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:32:24.437433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16827603-2836-4481-99d5-59f7b902bf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:32:24.456296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-16827603-2836-4481-99d5-59f7b902bf4e None None] MFA Rules not processed for user `83f5ffa7705f46c2b76fd2c8e91a701d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:32:24.457489 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-16827603-2836-4481-99d5-59f7b902bf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:32:24.514568 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1157/2337] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:32:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:32:27.956159 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b6642-e33c-4cbe-86ed-3e13453fe252 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:32:27.956722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b6642-e33c-4cbe-86ed-3e13453fe252 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:32:27.956722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b6642-e33c-4cbe-86ed-3e13453fe252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:32:27.977595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-2f1b6642-e33c-4cbe-86ed-3e13453fe252 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:32:27.978858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2f1b6642-e33c-4cbe-86ed-3e13453fe252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:32:27.986219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1181/2338] 10.222.0.33 () {58 vars in 967 bytes} [Mon Sep 12 23:32:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:32:27.999240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16827603-2836-4481-99d5-59f7b902bf4e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:32:28.011202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16827603-2836-4481-99d5-59f7b902bf4e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:32:28.016311 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac68377-75a1-49d6-8e33-3966849d599b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:32:28.016906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac68377-75a1-49d6-8e33-3966849d599b service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:32:28.017191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac68377-75a1-49d6-8e33-3966849d599b service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:32:28.017452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac68377-75a1-49d6-8e33-3966849d599b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:32:28.026711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac68377-75a1-49d6-8e33-3966849d599b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:32:28.028328 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac68377-75a1-49d6-8e33-3966849d599b service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:32:28.036456 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1158/2339] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:32:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:32:37.971582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:38.033094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=31 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:19.582449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b6642-e33c-4cbe-86ed-3e13453fe252 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:33:19.592552 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b6642-e33c-4cbe-86ed-3e13453fe252 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:33:19.596110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff13305-386c-40f5-8427-95000100317d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:33:19.596702 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff13305-386c-40f5-8427-95000100317d service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:33:19.596980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff13305-386c-40f5-8427-95000100317d service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:33:19.597251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff13305-386c-40f5-8427-95000100317d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:33:19.598970 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7ff13305-386c-40f5-8427-95000100317d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:33:19.612597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff13305-386c-40f5-8427-95000100317d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:33:19.614016 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff13305-386c-40f5-8427-95000100317d service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:33:19.626895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1182/2340] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:33:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:33:20.819947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac68377-75a1-49d6-8e33-3966849d599b service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:33:20.829328 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac68377-75a1-49d6-8e33-3966849d599b service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:33:20.832932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f077ec7-b498-4251-96a7-ee0ab0fd613e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:33:20.833521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f077ec7-b498-4251-96a7-ee0ab0fd613e service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:33:20.833795 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f077ec7-b498-4251-96a7-ee0ab0fd613e service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:33:20.834125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f077ec7-b498-4251-96a7-ee0ab0fd613e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:33:20.835927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9f077ec7-b498-4251-96a7-ee0ab0fd613e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:33:20.848815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f077ec7-b498-4251-96a7-ee0ab0fd613e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:33:20.850823 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f077ec7-b498-4251-96a7-ee0ab0fd613e service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:33:20.861479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1159/2341] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:33:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:33:22.351082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27cc78-ce0d-4ce1-9000-e1ed9d1ed606 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:33:22.351572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27cc78-ce0d-4ce1-9000-e1ed9d1ed606 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:33:22.351572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27cc78-ce0d-4ce1-9000-e1ed9d1ed606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:33:22.370908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-5a27cc78-ce0d-4ce1-9000-e1ed9d1ed606 None None] MFA Rules not processed for user `e3a473b5ad2f43db852f57f83d48240b`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:33:22.372110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5a27cc78-ce0d-4ce1-9000-e1ed9d1ed606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:33:22.429276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1183/2342] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:33:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:33:30.856594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:32.422060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=31 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:46.547775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f077ec7-b498-4251-96a7-ee0ab0fd613e service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:33:46.550074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9f077ec7-b498-4251-96a7-ee0ab0fd613e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:33:46.565484 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f077ec7-b498-4251-96a7-ee0ab0fd613e service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:33:46.571207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993791a5-e3cf-428c-a1fa-5b10cdd0a67f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:33:46.571811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993791a5-e3cf-428c-a1fa-5b10cdd0a67f service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:33:46.572089 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993791a5-e3cf-428c-a1fa-5b10cdd0a67f service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:33:46.572363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993791a5-e3cf-428c-a1fa-5b10cdd0a67f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:33:46.574073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-993791a5-e3cf-428c-a1fa-5b10cdd0a67f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:33:46.635097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993791a5-e3cf-428c-a1fa-5b10cdd0a67f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:33:46.637195 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993791a5-e3cf-428c-a1fa-5b10cdd0a67f service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:33:46.647113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1160/2343] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:33:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:33:54.896773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627379bc-42b7-4004-8279-7d7310c8e7c6 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:33:54.897308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627379bc-42b7-4004-8279-7d7310c8e7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:33:54.897308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627379bc-42b7-4004-8279-7d7310c8e7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:33:54.917976 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-627379bc-42b7-4004-8279-7d7310c8e7c6 None None] MFA Rules not processed for user `a0ada49dfcb54b2b8e551e9d89f831a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:33:54.919219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-627379bc-42b7-4004-8279-7d7310c8e7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:33:54.926708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1184/2344] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:33:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:33:55.227869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993791a5-e3cf-428c-a1fa-5b10cdd0a67f service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:33:55.237049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993791a5-e3cf-428c-a1fa-5b10cdd0a67f service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:33:55.240761 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6396e12-2a2a-4f78-a504-4c0c7ba9d4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:33:55.241353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6396e12-2a2a-4f78-a504-4c0c7ba9d4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:33:55.241632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6396e12-2a2a-4f78-a504-4c0c7ba9d4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:33:55.241904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6396e12-2a2a-4f78-a504-4c0c7ba9d4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:33:55.243660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a6396e12-2a2a-4f78-a504-4c0c7ba9d4b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:33:55.253888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6396e12-2a2a-4f78-a504-4c0c7ba9d4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:33:55.255533 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6396e12-2a2a-4f78-a504-4c0c7ba9d4b8 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:33:55.263818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1161/2345] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:33:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:33:55.580671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627379bc-42b7-4004-8279-7d7310c8e7c6 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:33:55.592969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627379bc-42b7-4004-8279-7d7310c8e7c6 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:33:55.597903 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38a448-8bce-4cbf-a409-9122388f4350 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '559a4af215324597b203e6866cb51fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:33:55.598571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38a448-8bce-4cbf-a409-9122388f4350 service placement] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:33:55.599340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38a448-8bce-4cbf-a409-9122388f4350 service placement] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:33:55.599655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38a448-8bce-4cbf-a409-9122388f4350 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:33:55.601362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cf38a448-8bce-4cbf-a409-9122388f4350 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:33:55.612947 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38a448-8bce-4cbf-a409-9122388f4350 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:33:55.615381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38a448-8bce-4cbf-a409-9122388f4350 service placement] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:33:55.625622 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1185/2346] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:33:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:33:57.743318 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6396e12-2a2a-4f78-a504-4c0c7ba9d4b8 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:33:57.754242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6396e12-2a2a-4f78-a504-4c0c7ba9d4b8 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:33:57.759283 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066209c-084b-42ab-9b2c-84065afb4e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:33:57.760076 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066209c-084b-42ab-9b2c-84065afb4e34 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:33:57.760263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066209c-084b-42ab-9b2c-84065afb4e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:33:57.760547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066209c-084b-42ab-9b2c-84065afb4e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:33:57.762456 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3066209c-084b-42ab-9b2c-84065afb4e34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:33:57.773846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066209c-084b-42ab-9b2c-84065afb4e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:33:57.775336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066209c-084b-42ab-9b2c-84065afb4e34 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:33:57.784597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1162/2347] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:33:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:34:05.621129 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=9 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:07.780193 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=40 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:09.707514 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38a448-8bce-4cbf-a409-9122388f4350 service placement] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:34:09.709207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cf38a448-8bce-4cbf-a409-9122388f4350 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:09.724504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38a448-8bce-4cbf-a409-9122388f4350 service placement] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:34:09.730040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8327c1-6841-4a5b-9062-913a110e287d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:34:09.730785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8327c1-6841-4a5b-9062-913a110e287d service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:09.731066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8327c1-6841-4a5b-9062-913a110e287d service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:09.731338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8327c1-6841-4a5b-9062-913a110e287d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:09.733062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-fa8327c1-6841-4a5b-9062-913a110e287d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:09.745610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8327c1-6841-4a5b-9062-913a110e287d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:34:09.747229 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8327c1-6841-4a5b-9062-913a110e287d service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:34:09.757564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1186/2348] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:34:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:34:19.753163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=6 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:24.870254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b427f30-8c53-4066-98d8-4344ccda011e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:24.870811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b427f30-8c53-4066-98d8-4344ccda011e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:24.870917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b427f30-8c53-4066-98d8-4344ccda011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:24.890960 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3b427f30-8c53-4066-98d8-4344ccda011e None None] MFA Rules not processed for user `83f5ffa7705f46c2b76fd2c8e91a701d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:34:24.892156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3b427f30-8c53-4066-98d8-4344ccda011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:24.899785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1163/2349] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:34:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:34:25.203646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8327c1-6841-4a5b-9062-913a110e287d service nova] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:34:25.213321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8327c1-6841-4a5b-9062-913a110e287d service nova] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:34:25.216882 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d887381-bde1-408b-bd63-cadacf1d5342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:34:25.217478 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d887381-bde1-408b-bd63-cadacf1d5342 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:25.217757 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d887381-bde1-408b-bd63-cadacf1d5342 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:25.218029 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d887381-bde1-408b-bd63-cadacf1d5342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:25.219776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2d887381-bde1-408b-bd63-cadacf1d5342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:25.229238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d887381-bde1-408b-bd63-cadacf1d5342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:34:25.230695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d887381-bde1-408b-bd63-cadacf1d5342 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:34:25.238944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1187/2350] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:34:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:34:30.029246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b427f30-8c53-4066-98d8-4344ccda011e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:34:30.030707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3b427f30-8c53-4066-98d8-4344ccda011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:30.086441 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b427f30-8c53-4066-98d8-4344ccda011e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:34:30.090054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0926f-e11b-44c6-a873-f094750af683 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:34:30.090696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0926f-e11b-44c6-a873-f094750af683 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:30.090989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0926f-e11b-44c6-a873-f094750af683 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:30.091247 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0926f-e11b-44c6-a873-f094750af683 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:30.092956 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ecb0926f-e11b-44c6-a873-f094750af683 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:30.151198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0926f-e11b-44c6-a873-f094750af683 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:34:30.152651 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0926f-e11b-44c6-a873-f094750af683 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:34:30.161522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1164/2351] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:34:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:34:35.008722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d887381-bde1-408b-bd63-cadacf1d5342 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:34:35.024384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d887381-bde1-408b-bd63-cadacf1d5342 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:34:35.028614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79025563-9b8a-46fa-a4eb-94be16220274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:34:35.029514 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79025563-9b8a-46fa-a4eb-94be16220274 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:35.030004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79025563-9b8a-46fa-a4eb-94be16220274 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:35.030597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79025563-9b8a-46fa-a4eb-94be16220274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:35.032822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-79025563-9b8a-46fa-a4eb-94be16220274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:35.060183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0926f-e11b-44c6-a873-f094750af683 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:34:35.062764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79025563-9b8a-46fa-a4eb-94be16220274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:34:35.064663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79025563-9b8a-46fa-a4eb-94be16220274 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:34:35.078268 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1188/2352] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:34:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:34:35.079081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0926f-e11b-44c6-a873-f094750af683 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:34:35.086738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef530b-840d-4ac0-9bde-69d659858b58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:34:35.087374 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef530b-840d-4ac0-9bde-69d659858b58 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:35.087658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef530b-840d-4ac0-9bde-69d659858b58 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:35.087932 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef530b-840d-4ac0-9bde-69d659858b58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:35.089759 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-25ef530b-840d-4ac0-9bde-69d659858b58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:35.104054 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef530b-840d-4ac0-9bde-69d659858b58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:34:35.106577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef530b-840d-4ac0-9bde-69d659858b58 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:34:35.136389 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1165/2353] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:34:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:34:36.032891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79025563-9b8a-46fa-a4eb-94be16220274 service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:34:36.047386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79025563-9b8a-46fa-a4eb-94be16220274 service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:34:36.056319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d59d4-84e5-484c-95a9-010c265c412c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:34:36.057254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d59d4-84e5-484c-95a9-010c265c412c service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:36.057752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d59d4-84e5-484c-95a9-010c265c412c service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:36.058636 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d59d4-84e5-484c-95a9-010c265c412c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:36.060807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7c6d59d4-84e5-484c-95a9-010c265c412c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:36.080700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d59d4-84e5-484c-95a9-010c265c412c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:34:36.082494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d59d4-84e5-484c-95a9-010c265c412c service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:34:36.094002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1189/2354] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:34:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:34:39.727278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cb44a-9630-4fc4-8caa-cb69d4283b93 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:39.727785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cb44a-9630-4fc4-8caa-cb69d4283b93 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:39.727883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cb44a-9630-4fc4-8caa-cb69d4283b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:39.747858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-846cb44a-9630-4fc4-8caa-cb69d4283b93 None None] MFA Rules not processed for user `8b7e7f9af2cd4ac0bebb2a65f08a4398`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:34:39.749059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-846cb44a-9630-4fc4-8caa-cb69d4283b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:39.756168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1166/2355] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:34:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:34:46.089352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=18 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:49.741304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=60 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:53.579007 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb334b0-7142-4dc4-a6f7-63a78979f83c None None] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:53.579600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb334b0-7142-4dc4-a6f7-63a78979f83c None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:53.579600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb334b0-7142-4dc4-a6f7-63a78979f83c None None] PATH_INFO: `/` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:53.581010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1190/2356] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:34:53.588896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075af9c1-4379-45f0-8677-ccf2a01448e6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:53.589291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075af9c1-4379-45f0-8677-ccf2a01448e6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:53.589291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075af9c1-4379-45f0-8677-ccf2a01448e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:53.610366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-075af9c1-4379-45f0-8677-ccf2a01448e6 None None] MFA Rules not processed for user `b1d4b0f322c741c5b69b922071aab3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:34:53.611611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-075af9c1-4379-45f0-8677-ccf2a01448e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:53.618636 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1167/2357] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:34:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:34:53.632238 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb334b0-7142-4dc4-a6f7-63a78979f83c None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:34:53.634288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6cb334b0-7142-4dc4-a6f7-63a78979f83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:53.647908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb334b0-7142-4dc4-a6f7-63a78979f83c None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:34:53.651443 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07fcf7-cd0e-4a2c-9276-f2a914fe7c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:34:53.652040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fcf7-cd0e-4a2c-9276-f2a914fe7c14 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:53.652311 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fcf7-cd0e-4a2c-9276-f2a914fe7c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:53.652573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fcf7-cd0e-4a2c-9276-f2a914fe7c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:53.659673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07fcf7-cd0e-4a2c-9276-f2a914fe7c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:34:53.661972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07fcf7-cd0e-4a2c-9276-f2a914fe7c14 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:34:53.670349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1191/2358] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:34:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:34:53.754044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308c794-2279-4a80-a46d-e3cbccb7a0bc None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:53.754528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308c794-2279-4a80-a46d-e3cbccb7a0bc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:53.754832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308c794-2279-4a80-a46d-e3cbccb7a0bc None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:53.756222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1168/2359] 10.222.0.33 () {54 vars in 921 bytes} [Mon Sep 12 23:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:34:53.761392 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94999e-362e-49d6-962d-bd042313358a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:53.761674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94999e-362e-49d6-962d-bd042313358a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:53.761947 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94999e-362e-49d6-962d-bd042313358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:53.781499 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ec94999e-362e-49d6-962d-bd042313358a None None] MFA Rules not processed for user `67b0698294e94845ae0dbdfb87059755`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:34:53.782759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ec94999e-362e-49d6-962d-bd042313358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:34:53.793269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1192/2360] 10.222.0.33 () {58 vars in 1018 bytes} [Mon Sep 12 23:34:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:34:53.804624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308c794-2279-4a80-a46d-e3cbccb7a0bc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:34:53.828754 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308c794-2279-4a80-a46d-e3cbccb7a0bc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:34:53.833600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06654166-a183-4b23-a20a-8df6607b2c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:34:53.835120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06654166-a183-4b23-a20a-8df6607b2c23 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:34:53.835399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06654166-a183-4b23-a20a-8df6607b2c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:34:53.835712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06654166-a183-4b23-a20a-8df6607b2c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:34:53.846690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06654166-a183-4b23-a20a-8df6607b2c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:34:53.849080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06654166-a183-4b23-a20a-8df6607b2c23 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:34:53.863113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1169/2361] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:34:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:35:02.078201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41493a4-58f4-4dee-bd00-9c0db91c6762 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:02.078771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41493a4-58f4-4dee-bd00-9c0db91c6762 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:02.078771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41493a4-58f4-4dee-bd00-9c0db91c6762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:02.103596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-a41493a4-58f4-4dee-bd00-9c0db91c6762 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:02.104811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a41493a4-58f4-4dee-bd00-9c0db91c6762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:02.114542 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1193/2362] 10.222.0.33 () {58 vars in 967 bytes} [Mon Sep 12 23:35:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:02.170423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06654166-a183-4b23-a20a-8df6607b2c23 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:02.182844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06654166-a183-4b23-a20a-8df6607b2c23 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:02.191372 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f782810-de16-4ad8-bd0b-63ab0414f0fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:02.191986 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f782810-de16-4ad8-bd0b-63ab0414f0fe service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:02.192261 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f782810-de16-4ad8-bd0b-63ab0414f0fe service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:02.192530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f782810-de16-4ad8-bd0b-63ab0414f0fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:02.201513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f782810-de16-4ad8-bd0b-63ab0414f0fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:02.203918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f782810-de16-4ad8-bd0b-63ab0414f0fe service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:02.213961 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1170/2363] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:35:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:35:02.994146 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41493a4-58f4-4dee-bd00-9c0db91c6762 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:03.003637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41493a4-58f4-4dee-bd00-9c0db91c6762 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:03.008107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4575b-d727-4fb6-939a-aa954d6b884e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:03.008798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4575b-d727-4fb6-939a-aa954d6b884e service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:03.009141 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4575b-d727-4fb6-939a-aa954d6b884e service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:03.009405 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4575b-d727-4fb6-939a-aa954d6b884e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:03.011173 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-50c4575b-d727-4fb6-939a-aa954d6b884e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:03.077427 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4575b-d727-4fb6-939a-aa954d6b884e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:03.078917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4575b-d727-4fb6-939a-aa954d6b884e service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:03.089112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1194/2364] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:35:06.244426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43507d1-0dc4-4360-8e79-975ddf87c0f2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:06.244874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43507d1-0dc4-4360-8e79-975ddf87c0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:06.244994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43507d1-0dc4-4360-8e79-975ddf87c0f2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:06.246531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1171/2365] 10.222.0.33 () {54 vars in 961 bytes} [Mon Sep 12 23:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:35:06.254285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d9771-98bb-4223-9ff7-223ac8b282e6 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:06.255476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d9771-98bb-4223-9ff7-223ac8b282e6 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:06.255908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d9771-98bb-4223-9ff7-223ac8b282e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:06.295144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-5b6d9771-98bb-4223-9ff7-223ac8b282e6 None None] MFA Rules not processed for user `559a4af215324597b203e6866cb51fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:06.297131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5b6d9771-98bb-4223-9ff7-223ac8b282e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:06.341133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1195/2366] 10.222.0.33 () {58 vars in 1058 bytes} [Mon Sep 12 23:35:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:35:06.365073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43507d1-0dc4-4360-8e79-975ddf87c0f2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:06.387656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43507d1-0dc4-4360-8e79-975ddf87c0f2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:06.404639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cde69-b489-4e0b-8d8f-bf5bc5927800 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '559a4af215324597b203e6866cb51fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:06.407630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cde69-b489-4e0b-8d8f-bf5bc5927800 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:06.408079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cde69-b489-4e0b-8d8f-bf5bc5927800 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:06.408522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cde69-b489-4e0b-8d8f-bf5bc5927800 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:06.422906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cf4cde69-b489-4e0b-8d8f-bf5bc5927800 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:06.454965 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cde69-b489-4e0b-8d8f-bf5bc5927800 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:06.457222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cde69-b489-4e0b-8d8f-bf5bc5927800 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:06.489322 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1172/2367] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:35:06.736599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d9771-98bb-4223-9ff7-223ac8b282e6 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:06.755220 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d9771-98bb-4223-9ff7-223ac8b282e6 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:06.770138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b6640-234b-4d93-af93-ea5f6d45df5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '559a4af215324597b203e6866cb51fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:06.776697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b6640-234b-4d93-af93-ea5f6d45df5e service placement] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:06.776969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b6640-234b-4d93-af93-ea5f6d45df5e service placement] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:06.778038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b6640-234b-4d93-af93-ea5f6d45df5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:06.784257 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-fe9b6640-234b-4d93-af93-ea5f6d45df5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:06.819374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b6640-234b-4d93-af93-ea5f6d45df5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:06.821504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b6640-234b-4d93-af93-ea5f6d45df5e service placement] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:06.852377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1196/2368] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:35:06.855180 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cde69-b489-4e0b-8d8f-bf5bc5927800 service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:06.856560 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cf4cde69-b489-4e0b-8d8f-bf5bc5927800 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:06.885639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cde69-b489-4e0b-8d8f-bf5bc5927800 service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:06.890275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64681ae3-8981-4e01-a476-84f6dcbeaa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:06.891021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64681ae3-8981-4e01-a476-84f6dcbeaa09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:06.891219 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64681ae3-8981-4e01-a476-84f6dcbeaa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:06.891498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64681ae3-8981-4e01-a476-84f6dcbeaa09 admin admin] PATH_INFO: `/v3/users/e3a473b5ad2f43db852f57f83d48240b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:06.899335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64681ae3-8981-4e01-a476-84f6dcbeaa09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a473b5ad2f43db852f57f83d48240b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:06.901398 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64681ae3-8981-4e01-a476-84f6dcbeaa09 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:06.977267 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-64681ae3-8981-4e01-a476-84f6dcbeaa09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a473b5ad2f43db852f57f83d48240b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:06.986431 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-64681ae3-8981-4e01-a476-84f6dcbeaa09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a473b5ad2f43db852f57f83d48240b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:07.002676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-64681ae3-8981-4e01-a476-84f6dcbeaa09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a473b5ad2f43db852f57f83d48240b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:07.004226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-64681ae3-8981-4e01-a476-84f6dcbeaa09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a473b5ad2f43db852f57f83d48240b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:07.005063 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-64681ae3-8981-4e01-a476-84f6dcbeaa09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a473b5ad2f43db852f57f83d48240b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:07.040627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1173/2369] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:35:06 2022] DELETE /identity/v3/users/e3a473b5ad2f43db852f57f83d48240b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:07.232476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b6640-234b-4d93-af93-ea5f6d45df5e service placement] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:07.246117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b6640-234b-4d93-af93-ea5f6d45df5e service placement] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:07.310925 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fab9c-7ace-4208-8f25-24aeeba42e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:07.311693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fab9c-7ace-4208-8f25-24aeeba42e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:07.311875 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fab9c-7ace-4208-8f25-24aeeba42e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:07.312149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fab9c-7ace-4208-8f25-24aeeba42e5b admin admin] PATH_INFO: `/v3/projects/b49f5e8682184d7e95f9be4ecb95c270` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:07.313299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fab9c-7ace-4208-8f25-24aeeba42e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49f5e8682184d7e95f9be4ecb95c270)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:07.315264 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fab9c-7ace-4208-8f25-24aeeba42e5b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:07.366669 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-903fab9c-7ace-4208-8f25-24aeeba42e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49f5e8682184d7e95f9be4ecb95c270', 'request_id': 'req-903fab9c-7ace-4208-8f25-24aeeba42e5b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:07.367868 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:07.382980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-903fab9c-7ace-4208-8f25-24aeeba42e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49f5e8682184d7e95f9be4ecb95c270', 'request_id': 'req-903fab9c-7ace-4208-8f25-24aeeba42e5b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:07.389621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-903fab9c-7ace-4208-8f25-24aeeba42e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49f5e8682184d7e95f9be4ecb95c270', 'request_id': 'req-903fab9c-7ace-4208-8f25-24aeeba42e5b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:07.404290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-903fab9c-7ace-4208-8f25-24aeeba42e5b admin admin] The token cache is being invalidate because project b49f5e8682184d7e95f9be4ecb95c270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:35:07.404529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-903fab9c-7ace-4208-8f25-24aeeba42e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:07.405135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-903fab9c-7ace-4208-8f25-24aeeba42e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:07.406677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1197/2370] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:35:07 2022] DELETE /identity/v3/projects/b49f5e8682184d7e95f9be4ecb95c270 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:07.417978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3235529-4456-4715-8a64-22c7445f1a31 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:07.418595 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3235529-4456-4715-8a64-22c7445f1a31 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:07.418595 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3235529-4456-4715-8a64-22c7445f1a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:07.440313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b3235529-4456-4715-8a64-22c7445f1a31 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:07.441719 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b3235529-4456-4715-8a64-22c7445f1a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:07.503720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1174/2371] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:07.511792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec22b6f-6a67-4bfb-a4c1-c1781018c23d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:07.512114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec22b6f-6a67-4bfb-a4c1-c1781018c23d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:07.512394 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec22b6f-6a67-4bfb-a4c1-c1781018c23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:07.533257 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cec22b6f-6a67-4bfb-a4c1-c1781018c23d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:07.534499 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cec22b6f-6a67-4bfb-a4c1-c1781018c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:07.543205 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1198/2372] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:35:07.547327 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3235529-4456-4715-8a64-22c7445f1a31 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:07.558723 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3235529-4456-4715-8a64-22c7445f1a31 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:07.563389 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926703a-67f2-4dac-be48-d771917fa4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:07.563995 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926703a-67f2-4dac-be48-d771917fa4af admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:07.564278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926703a-67f2-4dac-be48-d771917fa4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:07.564546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926703a-67f2-4dac-be48-d771917fa4af admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:07.565198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926703a-67f2-4dac-be48-d771917fa4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:35:07.565500 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926703a-67f2-4dac-be48-d771917fa4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:07.567828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926703a-67f2-4dac-be48-d771917fa4af admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:07.579856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1175/2373] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:35:07.585471 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec22b6f-6a67-4bfb-a4c1-c1781018c23d None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:07.594881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec22b6f-6a67-4bfb-a4c1-c1781018c23d None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:07.600200 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebfb7d-62e6-4752-b80e-38ea511eb41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:07.601073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebfb7d-62e6-4752-b80e-38ea511eb41f admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:07.601256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebfb7d-62e6-4752-b80e-38ea511eb41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:07.601524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebfb7d-62e6-4752-b80e-38ea511eb41f admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:07.602189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebfb7d-62e6-4752-b80e-38ea511eb41f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:07.604161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebfb7d-62e6-4752-b80e-38ea511eb41f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:07.633377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1199/2374] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:35:07 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:35:07.637575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926703a-67f2-4dac-be48-d771917fa4af admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:07.648392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926703a-67f2-4dac-be48-d771917fa4af admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:07.657264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:07.708951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13940369-ec02-44d4-ba60-dbc04bb54941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:07.709560 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13940369-ec02-44d4-ba60-dbc04bb54941 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:07.709840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13940369-ec02-44d4-ba60-dbc04bb54941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:07.710128 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13940369-ec02-44d4-ba60-dbc04bb54941 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:07.710795 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13940369-ec02-44d4-ba60-dbc04bb54941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:07.712718 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13940369-ec02-44d4-ba60-dbc04bb54941 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:07.735357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1176/2375] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:35:07 2022] POST /identity/v3/users => generated 278 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:35:07.739650 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebfb7d-62e6-4752-b80e-38ea511eb41f admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:07.751008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebfb7d-62e6-4752-b80e-38ea511eb41f admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:07.757231 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fa4ed-f930-4a16-926c-adace8ef28fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:07.757904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fa4ed-f930-4a16-926c-adace8ef28fd admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:07.758227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fa4ed-f930-4a16-926c-adace8ef28fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:07.758859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fa4ed-f930-4a16-926c-adace8ef28fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:07.759203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fa4ed-f930-4a16-926c-adace8ef28fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:07.760833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fa4ed-f930-4a16-926c-adace8ef28fd admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:07.775749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1200/2376] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:07.776789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13940369-ec02-44d4-ba60-dbc04bb54941 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:07.786809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13940369-ec02-44d4-ba60-dbc04bb54941 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:07.791745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbb869-0323-45e4-ba8b-56419499d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:07.792341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbb869-0323-45e4-ba8b-56419499d131 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:07.792619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbb869-0323-45e4-ba8b-56419499d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:07.792894 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbb869-0323-45e4-ba8b-56419499d131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:07.793532 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbb869-0323-45e4-ba8b-56419499d131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:07.795184 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbb869-0323-45e4-ba8b-56419499d131 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:07.807125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1177/2377] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:07.811308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fa4ed-f930-4a16-926c-adace8ef28fd admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:07.822426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fa4ed-f930-4a16-926c-adace8ef28fd admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:07.827015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bbcc7-ba3d-47a4-9722-f999023f92e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:07.827663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bbcc7-ba3d-47a4-9722-f999023f92e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:07.827937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bbcc7-ba3d-47a4-9722-f999023f92e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:07.828488 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bbcc7-ba3d-47a4-9722-f999023f92e1 admin admin] PATH_INFO: `/v3/projects/b3b417b862374eabadb6e976053a369c/users/c4c8844e82be44c38164501c26df46aa/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:07.846013 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bbcc7-ba3d-47a4-9722-f999023f92e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b417b862374eabadb6e976053a369c, user_id=c4c8844e82be44c38164501c26df46aa, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:07.848986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bbcc7-ba3d-47a4-9722-f999023f92e1 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:07.870359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1201/2378] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:35:07 2022] PUT /identity/v3/projects/b3b417b862374eabadb6e976053a369c/users/c4c8844e82be44c38164501c26df46aa/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:07.882279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bbca8-9494-4fad-891c-a9c4637c0ec8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:07.882782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bbca8-9494-4fad-891c-a9c4637c0ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:07.883060 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bbca8-9494-4fad-891c-a9c4637c0ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:07.915637 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f46bbca8-9494-4fad-891c-a9c4637c0ec8 None None] MFA Rules not processed for user `c4c8844e82be44c38164501c26df46aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:07.916982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f46bbca8-9494-4fad-891c-a9c4637c0ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:07.994874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1178/2379] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:07.999424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bbcc7-ba3d-47a4-9722-f999023f92e1 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:08.077428 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bbcc7-ba3d-47a4-9722-f999023f92e1 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:08.082814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e975a0-0bdb-4ebf-9bea-7631b898117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:08.083518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e975a0-0bdb-4ebf-9bea-7631b898117e admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:08.083872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e975a0-0bdb-4ebf-9bea-7631b898117e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:08.084216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e975a0-0bdb-4ebf-9bea-7631b898117e admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:08.084932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e975a0-0bdb-4ebf-9bea-7631b898117e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:08.086994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e975a0-0bdb-4ebf-9bea-7631b898117e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:08.123685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1202/2380] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:35:07 2022] POST /identity/v3/projects => generated 355 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:35:08.125671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bbca8-9494-4fad-891c-a9c4637c0ec8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:08.141706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bbca8-9494-4fad-891c-a9c4637c0ec8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:08.212019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039f522-379d-4298-9cc7-096517d23a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:08.212534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039f522-379d-4298-9cc7-096517d23a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:08.212801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039f522-379d-4298-9cc7-096517d23a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:08.213075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039f522-379d-4298-9cc7-096517d23a6c admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:08.214605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039f522-379d-4298-9cc7-096517d23a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:08.216870 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039f522-379d-4298-9cc7-096517d23a6c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:08.245771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1179/2381] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:35:08 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:35:08.247158 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e975a0-0bdb-4ebf-9bea-7631b898117e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:08.259572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e975a0-0bdb-4ebf-9bea-7631b898117e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:08.265784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748f446-e9a8-40cf-b812-76650ecd7b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:08.266436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748f446-e9a8-40cf-b812-76650ecd7b63 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:08.274506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748f446-e9a8-40cf-b812-76650ecd7b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:08.274891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748f446-e9a8-40cf-b812-76650ecd7b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:08.275602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748f446-e9a8-40cf-b812-76650ecd7b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:08.277247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748f446-e9a8-40cf-b812-76650ecd7b63 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:08.290447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1203/2382] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:08.295908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039f522-379d-4298-9cc7-096517d23a6c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:08.327558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039f522-379d-4298-9cc7-096517d23a6c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:08.336220 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da9803-052d-46fa-b4c1-d9816316d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:08.337061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da9803-052d-46fa-b4c1-d9816316d3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:08.337446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da9803-052d-46fa-b4c1-d9816316d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:08.337796 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da9803-052d-46fa-b4c1-d9816316d3ea admin admin] PATH_INFO: `/v3/projects/5249fc0b52ec4f1a9eb3deb84093b974/users/8c1fa4bedd0143d995854a47b925b712/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:08.348307 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:08.357918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da9803-052d-46fa-b4c1-d9816316d3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5249fc0b52ec4f1a9eb3deb84093b974, user_id=8c1fa4bedd0143d995854a47b925b712, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:08.370404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da9803-052d-46fa-b4c1-d9816316d3ea admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:08.384679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1180/2383] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:35:08 2022] PUT /identity/v3/projects/5249fc0b52ec4f1a9eb3deb84093b974/users/8c1fa4bedd0143d995854a47b925b712/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:08.388957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748f446-e9a8-40cf-b812-76650ecd7b63 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:08.406445 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748f446-e9a8-40cf-b812-76650ecd7b63 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:08.457074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:08.471992 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391b6e0-aab5-49ce-b4c9-1cb98510bfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:08.472837 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391b6e0-aab5-49ce-b4c9-1cb98510bfde admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:08.474329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391b6e0-aab5-49ce-b4c9-1cb98510bfde admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:08.474631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391b6e0-aab5-49ce-b4c9-1cb98510bfde admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:08.476096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391b6e0-aab5-49ce-b4c9-1cb98510bfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:08.477757 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391b6e0-aab5-49ce-b4c9-1cb98510bfde admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:08.486997 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da9803-052d-46fa-b4c1-d9816316d3ea admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:08.489212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e4da9803-052d-46fa-b4c1-d9816316d3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:08.494112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1204/2384] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:08.495480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391b6e0-aab5-49ce-b4c9-1cb98510bfde admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:08.506151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391b6e0-aab5-49ce-b4c9-1cb98510bfde admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:08.511106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2007c-3670-49c6-8b15-97b5eec7ee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:08.511774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2007c-3670-49c6-8b15-97b5eec7ee51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:08.512059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2007c-3670-49c6-8b15-97b5eec7ee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:08.512331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2007c-3670-49c6-8b15-97b5eec7ee51 admin admin] PATH_INFO: `/v3/projects/5249fc0b52ec4f1a9eb3deb84093b974/users/8c1fa4bedd0143d995854a47b925b712/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:08.514272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2007c-3670-49c6-8b15-97b5eec7ee51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5249fc0b52ec4f1a9eb3deb84093b974, user_id=8c1fa4bedd0143d995854a47b925b712, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:08.517206 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2007c-3670-49c6-8b15-97b5eec7ee51 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:08.535771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1205/2385] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:35:08 2022] PUT /identity/v3/projects/5249fc0b52ec4f1a9eb3deb84093b974/users/8c1fa4bedd0143d995854a47b925b712/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:08.544533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea196f-46aa-46e5-9a1a-8b08bfa66efe None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:08.545108 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea196f-46aa-46e5-9a1a-8b08bfa66efe None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:08.545392 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea196f-46aa-46e5-9a1a-8b08bfa66efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:08.561443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da9803-052d-46fa-b4c1-d9816316d3ea admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:08.594270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-95ea196f-46aa-46e5-9a1a-8b08bfa66efe None None] MFA Rules not processed for user `8c1fa4bedd0143d995854a47b925b712`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:08.595689 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-95ea196f-46aa-46e5-9a1a-8b08bfa66efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:08.623349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340e8a1-26d5-4993-8126-0e12f46fb32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:08.624160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340e8a1-26d5-4993-8126-0e12f46fb32e service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:08.624653 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340e8a1-26d5-4993-8126-0e12f46fb32e service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:08.625033 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340e8a1-26d5-4993-8126-0e12f46fb32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:08.627073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c340e8a1-26d5-4993-8126-0e12f46fb32e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:08.693811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1206/2386] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:08.706156 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea196f-46aa-46e5-9a1a-8b08bfa66efe None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:08.708058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-95ea196f-46aa-46e5-9a1a-8b08bfa66efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:08.714015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340e8a1-26d5-4993-8126-0e12f46fb32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:08.715768 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340e8a1-26d5-4993-8126-0e12f46fb32e service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:08.730987 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1181/2387] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:35:08.778677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea196f-46aa-46e5-9a1a-8b08bfa66efe None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:08.782250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36636293-b1c8-49b0-8a9d-27c918160073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:08.782992 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36636293-b1c8-49b0-8a9d-27c918160073 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:08.783524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36636293-b1c8-49b0-8a9d-27c918160073 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:08.783892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36636293-b1c8-49b0-8a9d-27c918160073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:08.798333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36636293-b1c8-49b0-8a9d-27c918160073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:08.799713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36636293-b1c8-49b0-8a9d-27c918160073 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:08.810332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1207/2388] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:35:08.896541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340e8a1-26d5-4993-8126-0e12f46fb32e service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:08.906349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340e8a1-26d5-4993-8126-0e12f46fb32e service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:08.910628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aced9-31f3-4c14-8c51-bc2ace24c575 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:08.911458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aced9-31f3-4c14-8c51-bc2ace24c575 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:08.911742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aced9-31f3-4c14-8c51-bc2ace24c575 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:08.912011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aced9-31f3-4c14-8c51-bc2ace24c575 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:08.968844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:08.983252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aced9-31f3-4c14-8c51-bc2ace24c575 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:08.984629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aced9-31f3-4c14-8c51-bc2ace24c575 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:08.995700 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1182/2389] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:35:10.526049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36636293-b1c8-49b0-8a9d-27c918160073 service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:10.527600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-36636293-b1c8-49b0-8a9d-27c918160073 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:10.543366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36636293-b1c8-49b0-8a9d-27c918160073 service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:10.548326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:10.549266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:10.551101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:10.551457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] PATH_INFO: `/v3/users/cf97527da5b946d8bf92de3b06f7ae0d` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:10.552730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf97527da5b946d8bf92de3b06f7ae0d)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:10.554878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:10.605787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf97527da5b946d8bf92de3b06f7ae0d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:10.611818 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:10.614410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf97527da5b946d8bf92de3b06f7ae0d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:10.628479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf97527da5b946d8bf92de3b06f7ae0d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:10.631187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf97527da5b946d8bf92de3b06f7ae0d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:10.631824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf97527da5b946d8bf92de3b06f7ae0d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:10.646697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1208/2390] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:35:10 2022] DELETE /identity/v3/users/cf97527da5b946d8bf92de3b06f7ae0d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:10.846052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aced9-31f3-4c14-8c51-bc2ace24c575 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:10.859134 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aced9-31f3-4c14-8c51-bc2ace24c575 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:10.932338 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:10.932992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:10.933270 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:10.933538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] PATH_INFO: `/v3/projects/cbabc02ac4e94332a013b1d8565419a6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:10.934673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbabc02ac4e94332a013b1d8565419a6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:10.936574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:10.983658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbabc02ac4e94332a013b1d8565419a6', 'request_id': 'req-d934b80a-edb2-4169-b74c-8206836daf93'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:10.990894 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbabc02ac4e94332a013b1d8565419a6', 'request_id': 'req-d934b80a-edb2-4169-b74c-8206836daf93'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:10.997514 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbabc02ac4e94332a013b1d8565419a6', 'request_id': 'req-d934b80a-edb2-4169-b74c-8206836daf93'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.008782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] The token cache is being invalidate because project cbabc02ac4e94332a013b1d8565419a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:35:11.009066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.010082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.011630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1183/2391] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:35:10 2022] DELETE /identity/v3/projects/cbabc02ac4e94332a013b1d8565419a6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:11.015832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:11.017234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:11.030935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17da2b-589d-4298-9643-93e0a8469f1a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:11.088604 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:11.089237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:11.089518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:11.089793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] PATH_INFO: `/v3/users/8b1bf77787784d35854afa0643eaf7c9` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:11.090942 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1bf77787784d35854afa0643eaf7c9)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:11.092872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:11.146464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1bf77787784d35854afa0643eaf7c9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.154936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1bf77787784d35854afa0643eaf7c9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.169437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1bf77787784d35854afa0643eaf7c9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.170187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1bf77787784d35854afa0643eaf7c9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.170861 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1bf77787784d35854afa0643eaf7c9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.186121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1209/2392] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:35:11 2022] DELETE /identity/v3/users/8b1bf77787784d35854afa0643eaf7c9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:11.369443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:11.370963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:11.385137 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934b80a-edb2-4169-b74c-8206836daf93 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:11.446857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f542-8b48-4b50-a749-d6d5fc086f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:11.447550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f542-8b48-4b50-a749-d6d5fc086f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:11.447834 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f542-8b48-4b50-a749-d6d5fc086f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:11.448102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f542-8b48-4b50-a749-d6d5fc086f0b admin admin] PATH_INFO: `/v3/projects/828c35e4e5e94ca08661363c55e10677` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:11.449212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86f542-8b48-4b50-a749-d6d5fc086f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=828c35e4e5e94ca08661363c55e10677)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:11.451160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86f542-8b48-4b50-a749-d6d5fc086f0b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:11.475986 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:11.503154 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ed86f542-8b48-4b50-a749-d6d5fc086f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828c35e4e5e94ca08661363c55e10677', 'request_id': 'req-ed86f542-8b48-4b50-a749-d6d5fc086f0b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.511990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ed86f542-8b48-4b50-a749-d6d5fc086f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828c35e4e5e94ca08661363c55e10677', 'request_id': 'req-ed86f542-8b48-4b50-a749-d6d5fc086f0b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.519026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ed86f542-8b48-4b50-a749-d6d5fc086f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828c35e4e5e94ca08661363c55e10677', 'request_id': 'req-ed86f542-8b48-4b50-a749-d6d5fc086f0b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.529981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ed86f542-8b48-4b50-a749-d6d5fc086f0b admin admin] The token cache is being invalidate because project 828c35e4e5e94ca08661363c55e10677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:35:11.530273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ed86f542-8b48-4b50-a749-d6d5fc086f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.530951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ed86f542-8b48-4b50-a749-d6d5fc086f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:11.532466 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1184/2393] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:35:11 2022] DELETE /identity/v3/projects/828c35e4e5e94ca08661363c55e10677 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:21.182055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=62,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:21.526864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:24.043299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:24.044719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:24.058070 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a66543-7dcb-4fa4-a637-bb4b23ce7c66 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:24.113941 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:24.114595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:24.114876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:24.115149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] PATH_INFO: `/v3/users/c4c8844e82be44c38164501c26df46aa` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:24.116255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c8844e82be44c38164501c26df46aa)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:24.118164 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:24.163244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c8844e82be44c38164501c26df46aa'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.170273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c8844e82be44c38164501c26df46aa'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.182864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c8844e82be44c38164501c26df46aa'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.183579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c8844e82be44c38164501c26df46aa'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.184187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c8844e82be44c38164501c26df46aa'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.198184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1210/2394] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:35:24 2022] DELETE /identity/v3/users/c4c8844e82be44c38164501c26df46aa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:24.202686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc573bb-bda0-4ed8-9345-18e44de6c353 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:24.203176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc573bb-bda0-4ed8-9345-18e44de6c353 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:24.203299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc573bb-bda0-4ed8-9345-18e44de6c353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:24.222738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dbc573bb-bda0-4ed8-9345-18e44de6c353 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:24.223966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dbc573bb-bda0-4ed8-9345-18e44de6c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:24.284576 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1185/2395] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:35:24.294649 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:24.296143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:24.354969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e398b-7b09-4413-afa4-b09e7799ba76 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:24.364539 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91673c35-9b01-42e9-9920-d48b5d2c48dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:24.365145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673c35-9b01-42e9-9920-d48b5d2c48dc service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:24.365423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673c35-9b01-42e9-9920-d48b5d2c48dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:24.365695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673c35-9b01-42e9-9920-d48b5d2c48dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:24.375131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91673c35-9b01-42e9-9920-d48b5d2c48dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:24.376603 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91673c35-9b01-42e9-9920-d48b5d2c48dc service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:24.387068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1211/2396] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:35:24.654537 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc573bb-bda0-4ed8-9345-18e44de6c353 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:24.656152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dbc573bb-bda0-4ed8-9345-18e44de6c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:24.669219 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc573bb-bda0-4ed8-9345-18e44de6c353 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:24.673840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:24.674506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:24.674835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:24.675113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] PATH_INFO: `/v3/projects/b3b417b862374eabadb6e976053a369c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:24.676268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b417b862374eabadb6e976053a369c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:24.678188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:24.724875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b417b862374eabadb6e976053a369c', 'request_id': 'req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.731859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b417b862374eabadb6e976053a369c', 'request_id': 'req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.738325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b417b862374eabadb6e976053a369c', 'request_id': 'req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.748491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] The token cache is being invalidate because project b3b417b862374eabadb6e976053a369c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:35:24.748773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.749397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.750902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1186/2397] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:35:24 2022] DELETE /identity/v3/projects/b3b417b862374eabadb6e976053a369c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:24.754958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91673c35-9b01-42e9-9920-d48b5d2c48dc service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:24.764479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91673c35-9b01-42e9-9920-d48b5d2c48dc service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:24.782621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:24.823953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b4a21-a06c-4588-b7db-09baffd3edd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:24.824494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b4a21-a06c-4588-b7db-09baffd3edd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:24.824770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b4a21-a06c-4588-b7db-09baffd3edd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:24.825040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b4a21-a06c-4588-b7db-09baffd3edd2 admin admin] PATH_INFO: `/v3/users/8c1fa4bedd0143d995854a47b925b712` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:24.826153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b4a21-a06c-4588-b7db-09baffd3edd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1fa4bedd0143d995854a47b925b712)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:24.828112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b4a21-a06c-4588-b7db-09baffd3edd2 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:24.875288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a11b4a21-a06c-4588-b7db-09baffd3edd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1fa4bedd0143d995854a47b925b712'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.882701 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a11b4a21-a06c-4588-b7db-09baffd3edd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1fa4bedd0143d995854a47b925b712'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.894824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a11b4a21-a06c-4588-b7db-09baffd3edd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1fa4bedd0143d995854a47b925b712'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.895481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a11b4a21-a06c-4588-b7db-09baffd3edd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1fa4bedd0143d995854a47b925b712'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.896077 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a11b4a21-a06c-4588-b7db-09baffd3edd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1fa4bedd0143d995854a47b925b712'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:24.908854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1212/2398] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:35:24 2022] DELETE /identity/v3/users/8c1fa4bedd0143d995854a47b925b712 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:25.175910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:25.177549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:25.190681 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a8f5d-beaa-4104-8c23-d83047b6a2c4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:25.248571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8c510-9cf5-4e05-b1cd-838090c9ea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:25.249227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8c510-9cf5-4e05-b1cd-838090c9ea40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:25.249476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8c510-9cf5-4e05-b1cd-838090c9ea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:25.249749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8c510-9cf5-4e05-b1cd-838090c9ea40 admin admin] PATH_INFO: `/v3/projects/5249fc0b52ec4f1a9eb3deb84093b974` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:25.250904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8c510-9cf5-4e05-b1cd-838090c9ea40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5249fc0b52ec4f1a9eb3deb84093b974)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:25.252898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8c510-9cf5-4e05-b1cd-838090c9ea40 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:25.282919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:25.301302 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70b8c510-9cf5-4e05-b1cd-838090c9ea40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5249fc0b52ec4f1a9eb3deb84093b974', 'request_id': 'req-70b8c510-9cf5-4e05-b1cd-838090c9ea40'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:25.308867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70b8c510-9cf5-4e05-b1cd-838090c9ea40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5249fc0b52ec4f1a9eb3deb84093b974', 'request_id': 'req-70b8c510-9cf5-4e05-b1cd-838090c9ea40'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:25.315180 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70b8c510-9cf5-4e05-b1cd-838090c9ea40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5249fc0b52ec4f1a9eb3deb84093b974', 'request_id': 'req-70b8c510-9cf5-4e05-b1cd-838090c9ea40'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:25.325604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70b8c510-9cf5-4e05-b1cd-838090c9ea40 admin admin] The token cache is being invalidate because project 5249fc0b52ec4f1a9eb3deb84093b974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:35:25.325891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70b8c510-9cf5-4e05-b1cd-838090c9ea40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:25.326554 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70b8c510-9cf5-4e05-b1cd-838090c9ea40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:25.328045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1187/2399] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:35:25 2022] DELETE /identity/v3/projects/5249fc0b52ec4f1a9eb3deb84093b974 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:25.333061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c3526-0804-4be6-97e3-071b7c73c2b3 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:25.333546 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c3526-0804-4be6-97e3-071b7c73c2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:25.333645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c3526-0804-4be6-97e3-071b7c73c2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:25.354729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b80c3526-0804-4be6-97e3-071b7c73c2b3 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:25.355885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b80c3526-0804-4be6-97e3-071b7c73c2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:25.415749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1213/2400] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:35:25.423591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb46922-1f46-48e2-b087-01f7c216370d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:25.423881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb46922-1f46-48e2-b087-01f7c216370d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:25.424185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb46922-1f46-48e2-b087-01f7c216370d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:25.445809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fcb46922-1f46-48e2-b087-01f7c216370d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:25.447047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fcb46922-1f46-48e2-b087-01f7c216370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:25.454933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1188/2401] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:25.459269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c3526-0804-4be6-97e3-071b7c73c2b3 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:25.468975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c3526-0804-4be6-97e3-071b7c73c2b3 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:25.473631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e23f6-659e-43fd-9f2b-35552c794135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:25.474332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e23f6-659e-43fd-9f2b-35552c794135 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:25.474638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e23f6-659e-43fd-9f2b-35552c794135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:25.474916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e23f6-659e-43fd-9f2b-35552c794135 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:25.475556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e23f6-659e-43fd-9f2b-35552c794135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:35:25.475858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e23f6-659e-43fd-9f2b-35552c794135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:25.477452 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e23f6-659e-43fd-9f2b-35552c794135 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:25.489300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1214/2402] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:35:25.493739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb46922-1f46-48e2-b087-01f7c216370d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:25.503546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb46922-1f46-48e2-b087-01f7c216370d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:25.508400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465f738-db18-4bd2-93fe-09f01e86f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:25.508999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465f738-db18-4bd2-93fe-09f01e86f288 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:25.509280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465f738-db18-4bd2-93fe-09f01e86f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:25.509556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465f738-db18-4bd2-93fe-09f01e86f288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:25.510200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465f738-db18-4bd2-93fe-09f01e86f288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:25.512171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465f738-db18-4bd2-93fe-09f01e86f288 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:25.540887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1189/2403] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:35:25 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:35:25.545037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e23f6-659e-43fd-9f2b-35552c794135 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:25.555530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e23f6-659e-43fd-9f2b-35552c794135 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:25.581171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:25.612961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516cfd0-2ea2-4fa6-a7b6-633053171073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:25.613474 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516cfd0-2ea2-4fa6-a7b6-633053171073 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:25.613747 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516cfd0-2ea2-4fa6-a7b6-633053171073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:25.614015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516cfd0-2ea2-4fa6-a7b6-633053171073 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:25.614677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516cfd0-2ea2-4fa6-a7b6-633053171073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:25.616581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516cfd0-2ea2-4fa6-a7b6-633053171073 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:25.638423 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1215/2404] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:35:25 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:35:25.642548 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465f738-db18-4bd2-93fe-09f01e86f288 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:25.652774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465f738-db18-4bd2-93fe-09f01e86f288 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:25.657469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b66565-fed2-4a1d-99a7-ae562942c621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:25.658063 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66565-fed2-4a1d-99a7-ae562942c621 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:25.658340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66565-fed2-4a1d-99a7-ae562942c621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:25.658644 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66565-fed2-4a1d-99a7-ae562942c621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:25.659403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b66565-fed2-4a1d-99a7-ae562942c621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:25.660996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b66565-fed2-4a1d-99a7-ae562942c621 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:25.671706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1190/2405] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:25.676135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516cfd0-2ea2-4fa6-a7b6-633053171073 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:25.685839 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516cfd0-2ea2-4fa6-a7b6-633053171073 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:25.690314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0691d-85dd-4d37-b5d7-a43822d69ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:25.691445 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0691d-85dd-4d37-b5d7-a43822d69ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:25.691720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0691d-85dd-4d37-b5d7-a43822d69ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:25.691981 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0691d-85dd-4d37-b5d7-a43822d69ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:25.692602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0691d-85dd-4d37-b5d7-a43822d69ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:25.694284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0691d-85dd-4d37-b5d7-a43822d69ea6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:25.704532 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1216/2406] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:25.708705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b66565-fed2-4a1d-99a7-ae562942c621 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:25.718423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b66565-fed2-4a1d-99a7-ae562942c621 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:25.723217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c79fb-3b8d-4096-9ed5-9973b947dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:25.723853 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c79fb-3b8d-4096-9ed5-9973b947dd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:25.724128 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c79fb-3b8d-4096-9ed5-9973b947dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:25.724397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c79fb-3b8d-4096-9ed5-9973b947dd64 admin admin] PATH_INFO: `/v3/projects/a713c3ef436f41708a1567d5c2ac7da6/users/aba0ee78ad074b77aaae3ae1820661bb/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:25.739419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c79fb-3b8d-4096-9ed5-9973b947dd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a713c3ef436f41708a1567d5c2ac7da6, user_id=aba0ee78ad074b77aaae3ae1820661bb, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:25.742052 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c79fb-3b8d-4096-9ed5-9973b947dd64 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:25.755296 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1191/2407] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:35:25 2022] PUT /identity/v3/projects/a713c3ef436f41708a1567d5c2ac7da6/users/aba0ee78ad074b77aaae3ae1820661bb/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:35:25.766553 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6335eb0-8656-4c3d-ba48-d6515c410195 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:25.766847 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6335eb0-8656-4c3d-ba48-d6515c410195 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:25.767113 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6335eb0-8656-4c3d-ba48-d6515c410195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:25.795414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-a6335eb0-8656-4c3d-ba48-d6515c410195 None None] MFA Rules not processed for user `aba0ee78ad074b77aaae3ae1820661bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:25.796615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a6335eb0-8656-4c3d-ba48-d6515c410195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:25.859441 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1217/2408] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:25.864702 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c79fb-3b8d-4096-9ed5-9973b947dd64 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:25.925624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c79fb-3b8d-4096-9ed5-9973b947dd64 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:25.930298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b7340-7e9c-4803-932f-a1ac0017e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:25.930931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7340-7e9c-4803-932f-a1ac0017e0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:25.931214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7340-7e9c-4803-932f-a1ac0017e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:25.931488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7340-7e9c-4803-932f-a1ac0017e0b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:25.932159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b7340-7e9c-4803-932f-a1ac0017e0b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:25.934093 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b7340-7e9c-4803-932f-a1ac0017e0b3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:25.960812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1192/2409] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:35:25 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:35:25.964774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6335eb0-8656-4c3d-ba48-d6515c410195 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:25.976720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6335eb0-8656-4c3d-ba48-d6515c410195 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:26.032910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517cdbd-0b93-40f0-85db-8d04c69c4143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:26.033524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517cdbd-0b93-40f0-85db-8d04c69c4143 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:26.033803 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517cdbd-0b93-40f0-85db-8d04c69c4143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:26.034707 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517cdbd-0b93-40f0-85db-8d04c69c4143 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:26.035516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517cdbd-0b93-40f0-85db-8d04c69c4143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:26.037431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517cdbd-0b93-40f0-85db-8d04c69c4143 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:26.058770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1218/2410] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:35:25 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:35:26.062765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b7340-7e9c-4803-932f-a1ac0017e0b3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:26.073331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b7340-7e9c-4803-932f-a1ac0017e0b3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:26.077942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eebbe2-a6fa-463d-ba35-661dce4d8757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:26.078570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eebbe2-a6fa-463d-ba35-661dce4d8757 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:26.078846 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eebbe2-a6fa-463d-ba35-661dce4d8757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:26.079116 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eebbe2-a6fa-463d-ba35-661dce4d8757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:26.079745 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eebbe2-a6fa-463d-ba35-661dce4d8757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:26.081760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eebbe2-a6fa-463d-ba35-661dce4d8757 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:26.092118 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1193/2411] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:26.096192 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517cdbd-0b93-40f0-85db-8d04c69c4143 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:26.106707 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517cdbd-0b93-40f0-85db-8d04c69c4143 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:26.111305 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff672c0-ef83-441f-88ad-4a9ff62ab304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:26.111944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff672c0-ef83-441f-88ad-4a9ff62ab304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:26.112833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff672c0-ef83-441f-88ad-4a9ff62ab304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:26.113331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff672c0-ef83-441f-88ad-4a9ff62ab304 admin admin] PATH_INFO: `/v3/projects/d1ee2cdbb2514e3b97ca1ddc958c8ea4/users/a942fb9f45b3469b92110735e7dd80c2/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:26.127949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff672c0-ef83-441f-88ad-4a9ff62ab304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ee2cdbb2514e3b97ca1ddc958c8ea4, user_id=a942fb9f45b3469b92110735e7dd80c2, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:26.131489 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff672c0-ef83-441f-88ad-4a9ff62ab304 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:26.145590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1219/2412] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:35:26 2022] PUT /identity/v3/projects/d1ee2cdbb2514e3b97ca1ddc958c8ea4/users/a942fb9f45b3469b92110735e7dd80c2/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:35:26.149705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eebbe2-a6fa-463d-ba35-661dce4d8757 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:26.160536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eebbe2-a6fa-463d-ba35-661dce4d8757 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:26.180542 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:26.217930 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332175f-d01a-4719-8901-8aab55b8cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:26.218557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332175f-d01a-4719-8901-8aab55b8cedd admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:26.218837 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332175f-d01a-4719-8901-8aab55b8cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:26.219108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332175f-d01a-4719-8901-8aab55b8cedd admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:26.219743 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332175f-d01a-4719-8901-8aab55b8cedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:26.221348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332175f-d01a-4719-8901-8aab55b8cedd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:26.231432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1194/2413] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:26.235643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff672c0-ef83-441f-88ad-4a9ff62ab304 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:26.241295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:26.247597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff672c0-ef83-441f-88ad-4a9ff62ab304 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:26.252564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a963975-fa62-4387-bad2-32973b1a1f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:26.253479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a963975-fa62-4387-bad2-32973b1a1f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:26.253761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a963975-fa62-4387-bad2-32973b1a1f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:26.254035 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a963975-fa62-4387-bad2-32973b1a1f65 admin admin] PATH_INFO: `/v3/projects/d1ee2cdbb2514e3b97ca1ddc958c8ea4/users/a942fb9f45b3469b92110735e7dd80c2/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:26.255961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a963975-fa62-4387-bad2-32973b1a1f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ee2cdbb2514e3b97ca1ddc958c8ea4, user_id=a942fb9f45b3469b92110735e7dd80c2, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:26.258590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a963975-fa62-4387-bad2-32973b1a1f65 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:26.269334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1220/2414] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:35:26 2022] PUT /identity/v3/projects/d1ee2cdbb2514e3b97ca1ddc958c8ea4/users/a942fb9f45b3469b92110735e7dd80c2/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:26.279456 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f93e9-c36c-4a79-a231-471be253e3e3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:26.279930 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f93e9-c36c-4a79-a231-471be253e3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:26.280056 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f93e9-c36c-4a79-a231-471be253e3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:26.309178 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-410f93e9-c36c-4a79-a231-471be253e3e3 None None] MFA Rules not processed for user `a942fb9f45b3469b92110735e7dd80c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:26.310070 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-410f93e9-c36c-4a79-a231-471be253e3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:26.378635 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1195/2415] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:26.390918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a963975-fa62-4387-bad2-32973b1a1f65 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:26.392692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8a963975-fa62-4387-bad2-32973b1a1f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:26.450321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a963975-fa62-4387-bad2-32973b1a1f65 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:26.453990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955bfcb-b389-4c82-9171-cb98f8f49960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:26.454632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955bfcb-b389-4c82-9171-cb98f8f49960 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:26.454917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955bfcb-b389-4c82-9171-cb98f8f49960 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:26.455189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955bfcb-b389-4c82-9171-cb98f8f49960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:26.465644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955bfcb-b389-4c82-9171-cb98f8f49960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:26.467132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955bfcb-b389-4c82-9171-cb98f8f49960 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:26.478093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1221/2416] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:35:26.547327 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f93e9-c36c-4a79-a231-471be253e3e3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:26.609238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f93e9-c36c-4a79-a231-471be253e3e3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:26.614624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:26.615238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:26.615527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:26.615806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] PATH_INFO: `/v3/users/aba0ee78ad074b77aaae3ae1820661bb` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:26.616931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba0ee78ad074b77aaae3ae1820661bb)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:26.618902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:26.666274 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba0ee78ad074b77aaae3ae1820661bb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:26.667423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:26.676069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba0ee78ad074b77aaae3ae1820661bb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:26.687966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba0ee78ad074b77aaae3ae1820661bb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:26.688642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba0ee78ad074b77aaae3ae1820661bb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:26.689244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba0ee78ad074b77aaae3ae1820661bb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:26.702762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1196/2417] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:35:26 2022] DELETE /identity/v3/users/aba0ee78ad074b77aaae3ae1820661bb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:26.708044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436315e-330b-4575-9751-6b7daa0f2cd1 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:26.708328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436315e-330b-4575-9751-6b7daa0f2cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:26.708599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436315e-330b-4575-9751-6b7daa0f2cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:26.727083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-a436315e-330b-4575-9751-6b7daa0f2cd1 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:26.728274 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a436315e-330b-4575-9751-6b7daa0f2cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:26.786561 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1222/2418] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:26.796516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:26.797909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:26.853482 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846d24-ce9e-4cbd-90c1-289069e91c4b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:26.857123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbf98d-4747-4df9-b2d6-d5c4e94c5d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:26.857715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbf98d-4747-4df9-b2d6-d5c4e94c5d34 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:26.857990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbf98d-4747-4df9-b2d6-d5c4e94c5d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:26.858260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbf98d-4747-4df9-b2d6-d5c4e94c5d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:26.867295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbf98d-4747-4df9-b2d6-d5c4e94c5d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:26.868713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbf98d-4747-4df9-b2d6-d5c4e94c5d34 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:26.878308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1197/2419] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:35:27.139412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436315e-330b-4575-9751-6b7daa0f2cd1 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:27.140889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a436315e-330b-4575-9751-6b7daa0f2cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:27.153449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436315e-330b-4575-9751-6b7daa0f2cd1 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:27.158284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:27.159124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:27.159683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:27.159987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] PATH_INFO: `/v3/projects/a713c3ef436f41708a1567d5c2ac7da6` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:27.161111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a713c3ef436f41708a1567d5c2ac7da6)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:27.163041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:27.211323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a713c3ef436f41708a1567d5c2ac7da6', 'request_id': 'req-3e11b78d-1c55-4737-8fbf-f23dc523671e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.217555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a713c3ef436f41708a1567d5c2ac7da6', 'request_id': 'req-3e11b78d-1c55-4737-8fbf-f23dc523671e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.223233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a713c3ef436f41708a1567d5c2ac7da6', 'request_id': 'req-3e11b78d-1c55-4737-8fbf-f23dc523671e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.234802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] The token cache is being invalidate because project a713c3ef436f41708a1567d5c2ac7da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:35:27.235084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.235694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.237759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1223/2420] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:35:27 2022] DELETE /identity/v3/projects/a713c3ef436f41708a1567d5c2ac7da6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:27.242085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbf98d-4747-4df9-b2d6-d5c4e94c5d34 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:27.251479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbf98d-4747-4df9-b2d6-d5c4e94c5d34 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:27.310360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdedb2-8be2-42bd-91c7-902bc65e486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:27.311055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdedb2-8be2-42bd-91c7-902bc65e486b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:27.311358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdedb2-8be2-42bd-91c7-902bc65e486b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:27.311628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdedb2-8be2-42bd-91c7-902bc65e486b admin admin] PATH_INFO: `/v3/users/a942fb9f45b3469b92110735e7dd80c2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:27.312794 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdedb2-8be2-42bd-91c7-902bc65e486b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a942fb9f45b3469b92110735e7dd80c2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:27.314786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdedb2-8be2-42bd-91c7-902bc65e486b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:27.361835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-29fdedb2-8be2-42bd-91c7-902bc65e486b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a942fb9f45b3469b92110735e7dd80c2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.369453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-29fdedb2-8be2-42bd-91c7-902bc65e486b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a942fb9f45b3469b92110735e7dd80c2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.379939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:27.382561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-29fdedb2-8be2-42bd-91c7-902bc65e486b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a942fb9f45b3469b92110735e7dd80c2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.383313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-29fdedb2-8be2-42bd-91c7-902bc65e486b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a942fb9f45b3469b92110735e7dd80c2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.384426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-29fdedb2-8be2-42bd-91c7-902bc65e486b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a942fb9f45b3469b92110735e7dd80c2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.398342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1198/2421] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:35:27 2022] DELETE /identity/v3/users/a942fb9f45b3469b92110735e7dd80c2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:35:27.674211 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:27.674211 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:27.688160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11b78d-1c55-4737-8fbf-f23dc523671e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:27.700742 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:27.748735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d500-2050-4a1d-a830-7bc96d384ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:27.749295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d500-2050-4a1d-a830-7bc96d384ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:27.749571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d500-2050-4a1d-a830-7bc96d384ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:27.749848 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d500-2050-4a1d-a830-7bc96d384ea3 admin admin] PATH_INFO: `/v3/projects/d1ee2cdbb2514e3b97ca1ddc958c8ea4` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:27.750993 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2d500-2050-4a1d-a830-7bc96d384ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ee2cdbb2514e3b97ca1ddc958c8ea4)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:27.753061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2d500-2050-4a1d-a830-7bc96d384ea3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:27.799682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-12d2d500-2050-4a1d-a830-7bc96d384ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ee2cdbb2514e3b97ca1ddc958c8ea4', 'request_id': 'req-12d2d500-2050-4a1d-a830-7bc96d384ea3'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.805783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-12d2d500-2050-4a1d-a830-7bc96d384ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ee2cdbb2514e3b97ca1ddc958c8ea4', 'request_id': 'req-12d2d500-2050-4a1d-a830-7bc96d384ea3'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.811351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-12d2d500-2050-4a1d-a830-7bc96d384ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ee2cdbb2514e3b97ca1ddc958c8ea4', 'request_id': 'req-12d2d500-2050-4a1d-a830-7bc96d384ea3'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.823885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-12d2d500-2050-4a1d-a830-7bc96d384ea3 admin admin] The token cache is being invalidate because project d1ee2cdbb2514e3b97ca1ddc958c8ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:35:27.824177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-12d2d500-2050-4a1d-a830-7bc96d384ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.824825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-12d2d500-2050-4a1d-a830-7bc96d384ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:27.826321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1224/2422] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:35:27 2022] DELETE /identity/v3/projects/d1ee2cdbb2514e3b97ca1ddc958c8ea4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:27.831715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339953d-3e67-4309-8320-e88d2502f308 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:27.832001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339953d-3e67-4309-8320-e88d2502f308 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:27.832276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339953d-3e67-4309-8320-e88d2502f308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:27.852167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f339953d-3e67-4309-8320-e88d2502f308 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:27.853377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f339953d-3e67-4309-8320-e88d2502f308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:27.912202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1199/2423] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:27.922246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92440f6d-4a66-4851-843d-032c9ccc91e4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:27.922560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92440f6d-4a66-4851-843d-032c9ccc91e4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:27.922912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92440f6d-4a66-4851-843d-032c9ccc91e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:27.942363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-92440f6d-4a66-4851-843d-032c9ccc91e4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:27.943729 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-92440f6d-4a66-4851-843d-032c9ccc91e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:27.951689 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1225/2424] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:27.956536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339953d-3e67-4309-8320-e88d2502f308 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:27.966821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339953d-3e67-4309-8320-e88d2502f308 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:27.973390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607f46f-10f7-4bef-b40b-a50db67c96e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:27.973993 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607f46f-10f7-4bef-b40b-a50db67c96e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:27.974273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607f46f-10f7-4bef-b40b-a50db67c96e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:27.974571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607f46f-10f7-4bef-b40b-a50db67c96e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:27.975215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607f46f-10f7-4bef-b40b-a50db67c96e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:35:27.975518 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607f46f-10f7-4bef-b40b-a50db67c96e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:27.977111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607f46f-10f7-4bef-b40b-a50db67c96e2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:27.989273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1200/2425] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:35:27.993735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92440f6d-4a66-4851-843d-032c9ccc91e4 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:28.003923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92440f6d-4a66-4851-843d-032c9ccc91e4 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:28.008906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ed33a-4ca9-49f8-ad29-3199911c6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:28.009518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ed33a-4ca9-49f8-ad29-3199911c6625 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.009804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ed33a-4ca9-49f8-ad29-3199911c6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.010078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ed33a-4ca9-49f8-ad29-3199911c6625 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.010750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ed33a-4ca9-49f8-ad29-3199911c6625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:28.012665 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ed33a-4ca9-49f8-ad29-3199911c6625 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:28.041359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1226/2426] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:35:27 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:35:28.045715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607f46f-10f7-4bef-b40b-a50db67c96e2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:28.056202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607f46f-10f7-4bef-b40b-a50db67c96e2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:28.117541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70bcab-ef80-4161-9182-b2ba926fd9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:28.118160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70bcab-ef80-4161-9182-b2ba926fd9ff admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.118473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70bcab-ef80-4161-9182-b2ba926fd9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.118763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70bcab-ef80-4161-9182-b2ba926fd9ff admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.119376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70bcab-ef80-4161-9182-b2ba926fd9ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:28.121300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70bcab-ef80-4161-9182-b2ba926fd9ff admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:28.147096 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1201/2427] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:35:28 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:35:28.151091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ed33a-4ca9-49f8-ad29-3199911c6625 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:28.162654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ed33a-4ca9-49f8-ad29-3199911c6625 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:28.167522 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0c9df-f93a-448e-9117-e277538f7ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:28.168261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0c9df-f93a-448e-9117-e277538f7ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.168538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0c9df-f93a-448e-9117-e277538f7ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.168933 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0c9df-f93a-448e-9117-e277538f7ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.169574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0c9df-f93a-448e-9117-e277538f7ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:28.181794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0c9df-f93a-448e-9117-e277538f7ff8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:28.185959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1227/2428] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:28.187108 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70bcab-ef80-4161-9182-b2ba926fd9ff admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:28.198954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70bcab-ef80-4161-9182-b2ba926fd9ff admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:28.205115 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9751ac-3bb0-4c37-8f6d-394fe967f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:28.205980 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9751ac-3bb0-4c37-8f6d-394fe967f27c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.206332 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9751ac-3bb0-4c37-8f6d-394fe967f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.206749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9751ac-3bb0-4c37-8f6d-394fe967f27c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.207568 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9751ac-3bb0-4c37-8f6d-394fe967f27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:28.209188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9751ac-3bb0-4c37-8f6d-394fe967f27c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:28.226145 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1202/2429] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:28.227382 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0c9df-f93a-448e-9117-e277538f7ff8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:28.243294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0c9df-f93a-448e-9117-e277538f7ff8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:28.248538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bfcb9-bcce-4ba0-a82d-221bd9487149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:28.249454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bfcb9-bcce-4ba0-a82d-221bd9487149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.249744 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bfcb9-bcce-4ba0-a82d-221bd9487149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.250022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bfcb9-bcce-4ba0-a82d-221bd9487149 admin admin] PATH_INFO: `/v3/projects/7450de4c0afa4e878f2fda597b2cdc6f/users/f14b92a2cb954e53994880926f90c575/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.265798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bfcb9-bcce-4ba0-a82d-221bd9487149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7450de4c0afa4e878f2fda597b2cdc6f, user_id=f14b92a2cb954e53994880926f90c575, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:28.268839 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bfcb9-bcce-4ba0-a82d-221bd9487149 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:28.281802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1228/2430] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:35:28 2022] PUT /identity/v3/projects/7450de4c0afa4e878f2fda597b2cdc6f/users/f14b92a2cb954e53994880926f90c575/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:28.294637 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234dbad-087f-4e7e-9ac0-97d8308b2363 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.294920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234dbad-087f-4e7e-9ac0-97d8308b2363 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.295200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234dbad-087f-4e7e-9ac0-97d8308b2363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.323193 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2234dbad-087f-4e7e-9ac0-97d8308b2363 None None] MFA Rules not processed for user `f14b92a2cb954e53994880926f90c575`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:28.324469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2234dbad-087f-4e7e-9ac0-97d8308b2363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:28.365701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:28.394973 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1203/2431] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:28.399421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bfcb9-bcce-4ba0-a82d-221bd9487149 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:28.444613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:28.462905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bfcb9-bcce-4ba0-a82d-221bd9487149 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:28.467499 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70324ccb-999c-4ff6-90c9-3afa2682198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:28.468101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70324ccb-999c-4ff6-90c9-3afa2682198d admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.468379 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70324ccb-999c-4ff6-90c9-3afa2682198d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.468650 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70324ccb-999c-4ff6-90c9-3afa2682198d admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.469279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70324ccb-999c-4ff6-90c9-3afa2682198d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:28.471272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70324ccb-999c-4ff6-90c9-3afa2682198d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:28.498278 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1229/2432] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:35:28 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:35:28.502535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234dbad-087f-4e7e-9ac0-97d8308b2363 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:28.513757 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234dbad-087f-4e7e-9ac0-97d8308b2363 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:28.569670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3277-40df-4d2c-8262-796d9b25806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:28.570278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3277-40df-4d2c-8262-796d9b25806d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.570589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3277-40df-4d2c-8262-796d9b25806d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.570864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3277-40df-4d2c-8262-796d9b25806d admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.571502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b3277-40df-4d2c-8262-796d9b25806d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:28.573426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b3277-40df-4d2c-8262-796d9b25806d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:28.597878 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1204/2433] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:35:28 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:35:28.602078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70324ccb-999c-4ff6-90c9-3afa2682198d admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:28.612973 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70324ccb-999c-4ff6-90c9-3afa2682198d admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:28.617690 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c201b-0f71-4eda-b5a8-d8f8d3c26c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:28.618285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c201b-0f71-4eda-b5a8-d8f8d3c26c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.618621 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c201b-0f71-4eda-b5a8-d8f8d3c26c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.618896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c201b-0f71-4eda-b5a8-d8f8d3c26c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.619534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c201b-0f71-4eda-b5a8-d8f8d3c26c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:28.621148 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c201b-0f71-4eda-b5a8-d8f8d3c26c36 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:28.632505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1230/2434] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:28.636675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3277-40df-4d2c-8262-796d9b25806d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:28.646545 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3277-40df-4d2c-8262-796d9b25806d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:28.651218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a13273-4dc6-441b-af04-69fd08eb238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:28.651925 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13273-4dc6-441b-af04-69fd08eb238f admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.652212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13273-4dc6-441b-af04-69fd08eb238f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.652490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13273-4dc6-441b-af04-69fd08eb238f admin admin] PATH_INFO: `/v3/projects/4b7dfa8405a8475689ac053bd2504ade/users/5b8e95a6856b4a179ba8c5b8ea111c0f/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.667451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a13273-4dc6-441b-af04-69fd08eb238f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7dfa8405a8475689ac053bd2504ade, user_id=5b8e95a6856b4a179ba8c5b8ea111c0f, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:28.670321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a13273-4dc6-441b-af04-69fd08eb238f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:28.683242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1205/2435] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:35:28 2022] PUT /identity/v3/projects/4b7dfa8405a8475689ac053bd2504ade/users/5b8e95a6856b4a179ba8c5b8ea111c0f/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:28.687239 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c201b-0f71-4eda-b5a8-d8f8d3c26c36 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:28.698831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c201b-0f71-4eda-b5a8-d8f8d3c26c36 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:28.755015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eb34e-8fe0-446f-99d3-f56a336c0cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:28.755535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eb34e-8fe0-446f-99d3-f56a336c0cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.755811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eb34e-8fe0-446f-99d3-f56a336c0cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.756085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eb34e-8fe0-446f-99d3-f56a336c0cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.756744 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0eb34e-8fe0-446f-99d3-f56a336c0cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:28.758333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0eb34e-8fe0-446f-99d3-f56a336c0cb8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:28.768249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1231/2436] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:28.772582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a13273-4dc6-441b-af04-69fd08eb238f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:28.782947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a13273-4dc6-441b-af04-69fd08eb238f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:28.788161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5665780-c88a-4c47-bfdb-f9da49c930cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:28.788806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5665780-c88a-4c47-bfdb-f9da49c930cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.789083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5665780-c88a-4c47-bfdb-f9da49c930cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.789382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5665780-c88a-4c47-bfdb-f9da49c930cc admin admin] PATH_INFO: `/v3/projects/4b7dfa8405a8475689ac053bd2504ade/users/5b8e95a6856b4a179ba8c5b8ea111c0f/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.791528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5665780-c88a-4c47-bfdb-f9da49c930cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7dfa8405a8475689ac053bd2504ade, user_id=5b8e95a6856b4a179ba8c5b8ea111c0f, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:28.794149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5665780-c88a-4c47-bfdb-f9da49c930cc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:28.804893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1206/2437] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:35:28 2022] PUT /identity/v3/projects/4b7dfa8405a8475689ac053bd2504ade/users/5b8e95a6856b4a179ba8c5b8ea111c0f/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:28.814735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6fb14-9336-4206-a19b-faa11d2ebd47 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.815019 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6fb14-9336-4206-a19b-faa11d2ebd47 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.815331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6fb14-9336-4206-a19b-faa11d2ebd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:28.842559 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-6eb6fb14-9336-4206-a19b-faa11d2ebd47 None None] MFA Rules not processed for user `5b8e95a6856b4a179ba8c5b8ea111c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:28.843765 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6eb6fb14-9336-4206-a19b-faa11d2ebd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:28.915111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1232/2438] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:28.926821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5665780-c88a-4c47-bfdb-f9da49c930cc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:28.928871 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b5665780-c88a-4c47-bfdb-f9da49c930cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:28.987715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5665780-c88a-4c47-bfdb-f9da49c930cc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:28.991541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31d70e-5367-44ff-89ec-4f3fd322762b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:28.992150 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31d70e-5367-44ff-89ec-4f3fd322762b service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:28.992460 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31d70e-5367-44ff-89ec-4f3fd322762b service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:28.992733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31d70e-5367-44ff-89ec-4f3fd322762b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:29.001812 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31d70e-5367-44ff-89ec-4f3fd322762b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:29.003614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31d70e-5367-44ff-89ec-4f3fd322762b service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:29.012966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1207/2439] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:35:29.117144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6fb14-9336-4206-a19b-faa11d2ebd47 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:29.126546 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6fb14-9336-4206-a19b-faa11d2ebd47 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:29.130938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3e1eb-e839-467e-8b61-3554c7828aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:29.131613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3e1eb-e839-467e-8b61-3554c7828aca service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:29.131917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3e1eb-e839-467e-8b61-3554c7828aca service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:29.132258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3e1eb-e839-467e-8b61-3554c7828aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:29.167020 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:29.191596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3e1eb-e839-467e-8b61-3554c7828aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:29.193037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3e1eb-e839-467e-8b61-3554c7828aca service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:29.201770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1233/2440] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:35:31.799000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31d70e-5367-44ff-89ec-4f3fd322762b service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:31.839321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:31.861696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31d70e-5367-44ff-89ec-4f3fd322762b service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:31.866909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:31.867538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:31.867815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:31.868115 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] PATH_INFO: `/v3/users/f14b92a2cb954e53994880926f90c575` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:31.869223 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14b92a2cb954e53994880926f90c575)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:31.871187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:31.917622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14b92a2cb954e53994880926f90c575'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:31.924340 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14b92a2cb954e53994880926f90c575'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:31.936524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14b92a2cb954e53994880926f90c575'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:31.937178 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14b92a2cb954e53994880926f90c575'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:31.937785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14b92a2cb954e53994880926f90c575'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:31.950398 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1208/2441] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:35:31 2022] DELETE /identity/v3/users/f14b92a2cb954e53994880926f90c575 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:31.954963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25761a0f-e55f-40dc-a481-6b8074fc9d6d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:31.955517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25761a0f-e55f-40dc-a481-6b8074fc9d6d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:31.955517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25761a0f-e55f-40dc-a481-6b8074fc9d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:31.974755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-25761a0f-e55f-40dc-a481-6b8074fc9d6d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:31.975932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-25761a0f-e55f-40dc-a481-6b8074fc9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:32.032580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1234/2442] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:32.043381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:32.044839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:32.103995 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff4017-ed5c-4ad5-abea-b6e0cca1a393 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:32.107646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a5a3d-1528-4308-94ad-e8e3428f3114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:32.108240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a5a3d-1528-4308-94ad-e8e3428f3114 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:32.108513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a5a3d-1528-4308-94ad-e8e3428f3114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:32.108778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a5a3d-1528-4308-94ad-e8e3428f3114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:32.118617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a5a3d-1528-4308-94ad-e8e3428f3114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:32.120098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a5a3d-1528-4308-94ad-e8e3428f3114 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:32.129981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1209/2443] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:35:32.396751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25761a0f-e55f-40dc-a481-6b8074fc9d6d None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:32.398232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-25761a0f-e55f-40dc-a481-6b8074fc9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:32.413767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25761a0f-e55f-40dc-a481-6b8074fc9d6d None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:32.418864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:32.419505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:32.419785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:32.420058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] PATH_INFO: `/v3/projects/7450de4c0afa4e878f2fda597b2cdc6f` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:32.421188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7450de4c0afa4e878f2fda597b2cdc6f)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:32.423140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:32.469786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7450de4c0afa4e878f2fda597b2cdc6f', 'request_id': 'req-de743c08-647d-45b3-a2bf-03d33b96a63e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:32.477226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7450de4c0afa4e878f2fda597b2cdc6f', 'request_id': 'req-de743c08-647d-45b3-a2bf-03d33b96a63e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:32.482778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7450de4c0afa4e878f2fda597b2cdc6f', 'request_id': 'req-de743c08-647d-45b3-a2bf-03d33b96a63e'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:32.495057 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] The token cache is being invalidate because project 7450de4c0afa4e878f2fda597b2cdc6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:35:32.495339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:32.495944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:32.497431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1235/2444] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:35:32 2022] DELETE /identity/v3/projects/7450de4c0afa4e878f2fda597b2cdc6f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:35:32.501405 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a5a3d-1528-4308-94ad-e8e3428f3114 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:32.511781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a5a3d-1528-4308-94ad-e8e3428f3114 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:32.568607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f399d-da4a-4fd6-b904-0e98f85f3833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:32.569233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f399d-da4a-4fd6-b904-0e98f85f3833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:32.569509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f399d-da4a-4fd6-b904-0e98f85f3833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:32.569776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f399d-da4a-4fd6-b904-0e98f85f3833 admin admin] PATH_INFO: `/v3/users/5b8e95a6856b4a179ba8c5b8ea111c0f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:32.570904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f399d-da4a-4fd6-b904-0e98f85f3833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b8e95a6856b4a179ba8c5b8ea111c0f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:32.572825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f399d-da4a-4fd6-b904-0e98f85f3833 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:32.574326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:32.620623 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-218f399d-da4a-4fd6-b904-0e98f85f3833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b8e95a6856b4a179ba8c5b8ea111c0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:32.627399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-218f399d-da4a-4fd6-b904-0e98f85f3833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b8e95a6856b4a179ba8c5b8ea111c0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:32.639832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-218f399d-da4a-4fd6-b904-0e98f85f3833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b8e95a6856b4a179ba8c5b8ea111c0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:32.640488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-218f399d-da4a-4fd6-b904-0e98f85f3833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b8e95a6856b4a179ba8c5b8ea111c0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:32.641090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-218f399d-da4a-4fd6-b904-0e98f85f3833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b8e95a6856b4a179ba8c5b8ea111c0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:32.655262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1210/2445] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:35:32 2022] DELETE /identity/v3/users/5b8e95a6856b4a179ba8c5b8ea111c0f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:32.929436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:32.931425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:32.945404 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de743c08-647d-45b3-a2bf-03d33b96a63e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:33.009142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267619d1-50fd-41f0-9064-18e49e1c032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:33.009751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267619d1-50fd-41f0-9064-18e49e1c032d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:33.009968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267619d1-50fd-41f0-9064-18e49e1c032d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:33.010241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267619d1-50fd-41f0-9064-18e49e1c032d admin admin] PATH_INFO: `/v3/projects/4b7dfa8405a8475689ac053bd2504ade` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:33.011383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267619d1-50fd-41f0-9064-18e49e1c032d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7dfa8405a8475689ac053bd2504ade)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:33.013273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267619d1-50fd-41f0-9064-18e49e1c032d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:33.014719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:33.060276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-267619d1-50fd-41f0-9064-18e49e1c032d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7dfa8405a8475689ac053bd2504ade', 'request_id': 'req-267619d1-50fd-41f0-9064-18e49e1c032d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:33.067276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-267619d1-50fd-41f0-9064-18e49e1c032d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7dfa8405a8475689ac053bd2504ade', 'request_id': 'req-267619d1-50fd-41f0-9064-18e49e1c032d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:33.072737 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-267619d1-50fd-41f0-9064-18e49e1c032d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7dfa8405a8475689ac053bd2504ade', 'request_id': 'req-267619d1-50fd-41f0-9064-18e49e1c032d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:33.084022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-267619d1-50fd-41f0-9064-18e49e1c032d admin admin] The token cache is being invalidate because project 4b7dfa8405a8475689ac053bd2504ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:35:33.084307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-267619d1-50fd-41f0-9064-18e49e1c032d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:33.084935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-267619d1-50fd-41f0-9064-18e49e1c032d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:35:33.086533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1236/2446] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:35:32 2022] DELETE /identity/v3/projects/4b7dfa8405a8475689ac053bd2504ade => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:33.091488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585368c-7bad-413e-985f-02aa94a93926 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:33.091959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585368c-7bad-413e-985f-02aa94a93926 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:33.092083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585368c-7bad-413e-985f-02aa94a93926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:33.112295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a585368c-7bad-413e-985f-02aa94a93926 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:33.113510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a585368c-7bad-413e-985f-02aa94a93926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:33.171978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1211/2447] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:33.181328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc5b2c-bc1a-4add-9729-b3688ea89002 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:33.181612 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc5b2c-bc1a-4add-9729-b3688ea89002 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:33.181885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc5b2c-bc1a-4add-9729-b3688ea89002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:33.202072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-52dc5b2c-bc1a-4add-9729-b3688ea89002 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:33.203307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-52dc5b2c-bc1a-4add-9729-b3688ea89002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:33.211098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1237/2448] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:33.215172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585368c-7bad-413e-985f-02aa94a93926 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:33.224998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585368c-7bad-413e-985f-02aa94a93926 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:33.229543 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138168fe-f2f7-4020-96a3-2a10f20fff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:33.230137 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138168fe-f2f7-4020-96a3-2a10f20fff56 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:33.230453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138168fe-f2f7-4020-96a3-2a10f20fff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:33.230728 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138168fe-f2f7-4020-96a3-2a10f20fff56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:33.231372 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138168fe-f2f7-4020-96a3-2a10f20fff56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:35:33.231676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138168fe-f2f7-4020-96a3-2a10f20fff56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:33.233273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138168fe-f2f7-4020-96a3-2a10f20fff56 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:33.245390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1212/2449] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:35:33.249572 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc5b2c-bc1a-4add-9729-b3688ea89002 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:33.259323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc5b2c-bc1a-4add-9729-b3688ea89002 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:33.263860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f3f94-c569-44e6-8d92-407fb1d1f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:33.264450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f3f94-c569-44e6-8d92-407fb1d1f7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:33.264759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f3f94-c569-44e6-8d92-407fb1d1f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:33.265030 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f3f94-c569-44e6-8d92-407fb1d1f7c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:33.265664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f3f94-c569-44e6-8d92-407fb1d1f7c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:33.267601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f3f94-c569-44e6-8d92-407fb1d1f7c4 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:33.294761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1238/2450] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:35:33 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:35:33.298782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138168fe-f2f7-4020-96a3-2a10f20fff56 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:33.309433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138168fe-f2f7-4020-96a3-2a10f20fff56 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:33.364910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e241bf-9640-45a2-b76f-f73d0252c3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:33.365473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e241bf-9640-45a2-b76f-f73d0252c3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:33.365753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e241bf-9640-45a2-b76f-f73d0252c3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:33.366057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e241bf-9640-45a2-b76f-f73d0252c3c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:33.366713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e241bf-9640-45a2-b76f-f73d0252c3c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:33.368662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e241bf-9640-45a2-b76f-f73d0252c3c0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:33.379672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:33.392668 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1213/2451] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:35:33 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:35:33.397183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f3f94-c569-44e6-8d92-407fb1d1f7c4 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:33.407544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f3f94-c569-44e6-8d92-407fb1d1f7c4 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:33.412764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e907e9-6157-4c22-82d2-e54c6bacc323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:33.413359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e907e9-6157-4c22-82d2-e54c6bacc323 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:33.413638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e907e9-6157-4c22-82d2-e54c6bacc323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:33.413909 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e907e9-6157-4c22-82d2-e54c6bacc323 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:33.414841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e907e9-6157-4c22-82d2-e54c6bacc323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:33.416426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e907e9-6157-4c22-82d2-e54c6bacc323 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:33.427075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1239/2452] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:33.436015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e241bf-9640-45a2-b76f-f73d0252c3c0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:33.446160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e241bf-9640-45a2-b76f-f73d0252c3c0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:33.450813 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d19ced-4efd-4336-843d-a0ae64d3b768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:33.451408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d19ced-4efd-4336-843d-a0ae64d3b768 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:33.451686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d19ced-4efd-4336-843d-a0ae64d3b768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:33.451959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d19ced-4efd-4336-843d-a0ae64d3b768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:33.452596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d19ced-4efd-4336-843d-a0ae64d3b768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:33.454196 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d19ced-4efd-4336-843d-a0ae64d3b768 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:33.464712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1214/2453] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:35:33.468914 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e907e9-6157-4c22-82d2-e54c6bacc323 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:33.480236 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e907e9-6157-4c22-82d2-e54c6bacc323 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:33.484929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecaa52-7fc9-48dd-b9b8-b34445c5903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:33.485581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecaa52-7fc9-48dd-b9b8-b34445c5903b admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:33.485865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecaa52-7fc9-48dd-b9b8-b34445c5903b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:33.486143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecaa52-7fc9-48dd-b9b8-b34445c5903b admin admin] PATH_INFO: `/v3/projects/140bf5226c80406caaee0fe841d5a764/users/3c853951c30d43cda2e3bc8ab559b85e/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:33.501172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecaa52-7fc9-48dd-b9b8-b34445c5903b admin admin] RBAC: Authorizing `identity:create_grant(project_id=140bf5226c80406caaee0fe841d5a764, user_id=3c853951c30d43cda2e3bc8ab559b85e, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:33.504205 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecaa52-7fc9-48dd-b9b8-b34445c5903b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:33.516304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1240/2454] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:35:33 2022] PUT /identity/v3/projects/140bf5226c80406caaee0fe841d5a764/users/3c853951c30d43cda2e3bc8ab559b85e/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:35:33.526707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99493e5-c412-4a0d-b126-ef45f5b5d9da None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:33.526996 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99493e5-c412-4a0d-b126-ef45f5b5d9da None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:33.527269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99493e5-c412-4a0d-b126-ef45f5b5d9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:33.556641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a99493e5-c412-4a0d-b126-ef45f5b5d9da None None] MFA Rules not processed for user `3c853951c30d43cda2e3bc8ab559b85e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:33.557830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a99493e5-c412-4a0d-b126-ef45f5b5d9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:33.622864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1215/2455] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:35:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:33.634663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecaa52-7fc9-48dd-b9b8-b34445c5903b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:33.636415 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ebecaa52-7fc9-48dd-b9b8-b34445c5903b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:33.692704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecaa52-7fc9-48dd-b9b8-b34445c5903b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:33.696296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b4d3d-29e2-41cb-8ced-bbb67179fa56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f96bbb14c04691ac403271de293224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:33.696896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b4d3d-29e2-41cb-8ced-bbb67179fa56 service glance] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:33.697174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b4d3d-29e2-41cb-8ced-bbb67179fa56 service glance] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:33.697446 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b4d3d-29e2-41cb-8ced-bbb67179fa56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:33.705489 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b4d3d-29e2-41cb-8ced-bbb67179fa56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:33.707435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b4d3d-29e2-41cb-8ced-bbb67179fa56 service glance] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:33.715951 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1241/2456] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:35:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:35:43.619949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=39 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:43.712116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:49.609438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e558cab-f7ee-44f6-a933-9c73c5b6e7b5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:49.609958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e558cab-f7ee-44f6-a933-9c73c5b6e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:49.609958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e558cab-f7ee-44f6-a933-9c73c5b6e7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:49.629968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6e558cab-f7ee-44f6-a933-9c73c5b6e7b5 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:35:49.632504 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6e558cab-f7ee-44f6-a933-9c73c5b6e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:49.695401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1216/2457] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:35:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:35:49.708142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b4d3d-29e2-41cb-8ced-bbb67179fa56 service glance] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:35:49.710200 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8d4b4d3d-29e2-41cb-8ced-bbb67179fa56 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:35:49.791860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b4d3d-29e2-41cb-8ced-bbb67179fa56 service glance] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:35:49.797198 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df25e60-af6e-4d34-b7f3-72489568b7f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:35:49.797797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df25e60-af6e-4d34-b7f3-72489568b7f4 service swift] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:35:49.798072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df25e60-af6e-4d34-b7f3-72489568b7f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:35:49.798341 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df25e60-af6e-4d34-b7f3-72489568b7f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:35:49.809679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df25e60-af6e-4d34-b7f3-72489568b7f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:35:49.813710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df25e60-af6e-4d34-b7f3-72489568b7f4 service swift] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:35:49.823244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1242/2458] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:35:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:35:59.686436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=25 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:59.819871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=32 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:06.495202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e558cab-f7ee-44f6-a933-9c73c5b6e7b5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:06.571836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e558cab-f7ee-44f6-a933-9c73c5b6e7b5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:06.577642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:06.578902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:06.579480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:06.579854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] PATH_INFO: `/v3/users/3c853951c30d43cda2e3bc8ab559b85e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:06.582289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c853951c30d43cda2e3bc8ab559b85e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:06.585438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:06.642681 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c853951c30d43cda2e3bc8ab559b85e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:06.651242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c853951c30d43cda2e3bc8ab559b85e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:06.667008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c853951c30d43cda2e3bc8ab559b85e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:06.667892 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c853951c30d43cda2e3bc8ab559b85e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:06.668746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c853951c30d43cda2e3bc8ab559b85e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:06.683749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1217/2459] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:36:06 2022] DELETE /identity/v3/users/3c853951c30d43cda2e3bc8ab559b85e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:36:06.688335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82225376-8e46-40d4-a920-95f02670d23f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:06.688803 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82225376-8e46-40d4-a920-95f02670d23f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:06.688923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82225376-8e46-40d4-a920-95f02670d23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:06.709243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-82225376-8e46-40d4-a920-95f02670d23f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:06.710466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-82225376-8e46-40d4-a920-95f02670d23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:06.772005 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1243/2460] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:06.781646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:06.783121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:06.843809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9c62c-52c7-4f0a-8308-aeb4c5330679 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:06.847686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa294f78-28d0-4a45-854f-d9b7d52a4dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:06.848310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa294f78-28d0-4a45-854f-d9b7d52a4dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:06.849187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa294f78-28d0-4a45-854f-d9b7d52a4dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:06.849467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa294f78-28d0-4a45-854f-d9b7d52a4dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:06.858857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa294f78-28d0-4a45-854f-d9b7d52a4dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:06.860305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa294f78-28d0-4a45-854f-d9b7d52a4dcf service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:06.870915 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1218/2461] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:36:07.160396 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82225376-8e46-40d4-a920-95f02670d23f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:07.162221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-82225376-8e46-40d4-a920-95f02670d23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:07.175765 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82225376-8e46-40d4-a920-95f02670d23f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:07.180765 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:07.181437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:07.181717 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:07.181989 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32 admin admin] PATH_INFO: `/v3/projects/140bf5226c80406caaee0fe841d5a764` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:07.183658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=140bf5226c80406caaee0fe841d5a764)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:07.185873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:07.236550 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140bf5226c80406caaee0fe841d5a764', 'request_id': 'req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:07.243715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140bf5226c80406caaee0fe841d5a764', 'request_id': 'req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:07.249841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140bf5226c80406caaee0fe841d5a764', 'request_id': 'req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:07.263598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32 admin admin] The token cache is being invalidate because project 140bf5226c80406caaee0fe841d5a764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:36:07.263917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:07.264602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-751865e1-d34a-4d56-9b60-bbfbc5ab3b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:07.266336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1244/2462] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:36:07 2022] DELETE /identity/v3/projects/140bf5226c80406caaee0fe841d5a764 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:36:07.271525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a32fe0-d1a7-43a5-9ff0-caface7a6c94 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:07.271814 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a32fe0-d1a7-43a5-9ff0-caface7a6c94 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:07.272092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a32fe0-d1a7-43a5-9ff0-caface7a6c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:07.292411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f4a32fe0-d1a7-43a5-9ff0-caface7a6c94 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:07.293616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f4a32fe0-d1a7-43a5-9ff0-caface7a6c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:07.311645 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:07.359173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1219/2463] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:07.369053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8afc5-f763-4e24-93b6-0d245d9d5881 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:07.369342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8afc5-f763-4e24-93b6-0d245d9d5881 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:07.369619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8afc5-f763-4e24-93b6-0d245d9d5881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:07.390792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-75f8afc5-f763-4e24-93b6-0d245d9d5881 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:07.392009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-75f8afc5-f763-4e24-93b6-0d245d9d5881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:07.401946 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1245/2464] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:07.406582 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a32fe0-d1a7-43a5-9ff0-caface7a6c94 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:07.417642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a32fe0-d1a7-43a5-9ff0-caface7a6c94 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:07.422512 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0698f-d8b7-4dfe-95cc-0d96c54d8757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:07.423326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0698f-d8b7-4dfe-95cc-0d96c54d8757 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:07.423632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0698f-d8b7-4dfe-95cc-0d96c54d8757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:07.423968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0698f-d8b7-4dfe-95cc-0d96c54d8757 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:07.424679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0698f-d8b7-4dfe-95cc-0d96c54d8757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:36:07.425047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0698f-d8b7-4dfe-95cc-0d96c54d8757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:07.427315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0698f-d8b7-4dfe-95cc-0d96c54d8757 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:07.439297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1220/2465] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:36:07.443917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8afc5-f763-4e24-93b6-0d245d9d5881 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:07.453324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8afc5-f763-4e24-93b6-0d245d9d5881 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:07.457967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7bf2b-a5de-43c1-989d-560fa2dd8e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:07.458606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7bf2b-a5de-43c1-989d-560fa2dd8e1e admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:07.458881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7bf2b-a5de-43c1-989d-560fa2dd8e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:07.459152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7bf2b-a5de-43c1-989d-560fa2dd8e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:07.459789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7bf2b-a5de-43c1-989d-560fa2dd8e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:07.461742 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7bf2b-a5de-43c1-989d-560fa2dd8e1e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:07.490436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1246/2466] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:36:07 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:36:07.494910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0698f-d8b7-4dfe-95cc-0d96c54d8757 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:07.510031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0698f-d8b7-4dfe-95cc-0d96c54d8757 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:07.569495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45549cc6-6b40-4e48-aabf-d487d14ab8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:07.570106 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45549cc6-6b40-4e48-aabf-d487d14ab8ca admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:07.570414 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45549cc6-6b40-4e48-aabf-d487d14ab8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:07.570692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45549cc6-6b40-4e48-aabf-d487d14ab8ca admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:07.571334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45549cc6-6b40-4e48-aabf-d487d14ab8ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:07.573329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45549cc6-6b40-4e48-aabf-d487d14ab8ca admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:07.598929 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1221/2467] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:36:07 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:36:07.602608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7bf2b-a5de-43c1-989d-560fa2dd8e1e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:07.613923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7bf2b-a5de-43c1-989d-560fa2dd8e1e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:07.619012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4cae6-c332-48a0-a0b8-d209687faf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:07.619616 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4cae6-c332-48a0-a0b8-d209687faf3e admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:07.619894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4cae6-c332-48a0-a0b8-d209687faf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:07.620161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4cae6-c332-48a0-a0b8-d209687faf3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:07.620792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4cae6-c332-48a0-a0b8-d209687faf3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:07.622402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4cae6-c332-48a0-a0b8-d209687faf3e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:07.635464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1247/2468] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:36:07.639824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45549cc6-6b40-4e48-aabf-d487d14ab8ca admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:07.652222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45549cc6-6b40-4e48-aabf-d487d14ab8ca admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:07.657002 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2ba6a-f6ab-4489-8009-cbed8c6fabea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:07.657605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ba6a-f6ab-4489-8009-cbed8c6fabea admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:07.657887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ba6a-f6ab-4489-8009-cbed8c6fabea admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:07.658162 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ba6a-f6ab-4489-8009-cbed8c6fabea admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:07.659103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2ba6a-f6ab-4489-8009-cbed8c6fabea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:07.660707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2ba6a-f6ab-4489-8009-cbed8c6fabea admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:07.674699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1222/2469] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:36:07.679506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4cae6-c332-48a0-a0b8-d209687faf3e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:07.690557 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4cae6-c332-48a0-a0b8-d209687faf3e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:07.696350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d32a3-d63d-4d0a-bee9-1a482816046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:07.697403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d32a3-d63d-4d0a-bee9-1a482816046c admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:07.697698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d32a3-d63d-4d0a-bee9-1a482816046c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:07.698044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d32a3-d63d-4d0a-bee9-1a482816046c admin admin] PATH_INFO: `/v3/projects/9099ca7fc4504d12ad33deada8b5ac62/users/c392315310254c73913ead60965dda82/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:07.716076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d32a3-d63d-4d0a-bee9-1a482816046c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9099ca7fc4504d12ad33deada8b5ac62, user_id=c392315310254c73913ead60965dda82, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:07.718819 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d32a3-d63d-4d0a-bee9-1a482816046c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:07.738777 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1248/2470] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:36:07 2022] PUT /identity/v3/projects/9099ca7fc4504d12ad33deada8b5ac62/users/c392315310254c73913ead60965dda82/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:36:07.746020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfc28f-8719-4272-afe0-36baf1813b40 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:07.746401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfc28f-8719-4272-afe0-36baf1813b40 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:07.746765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfc28f-8719-4272-afe0-36baf1813b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:07.776643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d3dfc28f-8719-4272-afe0-36baf1813b40 None None] MFA Rules not processed for user `c392315310254c73913ead60965dda82`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:07.778019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d3dfc28f-8719-4272-afe0-36baf1813b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:07.849516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1223/2471] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:07.860806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d32a3-d63d-4d0a-bee9-1a482816046c admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:07.862594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-127d32a3-d63d-4d0a-bee9-1a482816046c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:07.887895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:07.932413 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d32a3-d63d-4d0a-bee9-1a482816046c admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:07.936136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb4425-6b3c-4f10-9eed-14d20c98a72f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:07.936767 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb4425-6b3c-4f10-9eed-14d20c98a72f service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:07.937046 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb4425-6b3c-4f10-9eed-14d20c98a72f service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:07.937257 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb4425-6b3c-4f10-9eed-14d20c98a72f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:07.945989 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb4425-6b3c-4f10-9eed-14d20c98a72f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:07.947556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb4425-6b3c-4f10-9eed-14d20c98a72f service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:07.956328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1249/2472] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:36:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:36:07.982475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfc28f-8719-4272-afe0-36baf1813b40 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:08.002912 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:08.049983 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfc28f-8719-4272-afe0-36baf1813b40 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:08.054820 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:08.055452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:08.055733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:08.056007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] PATH_INFO: `/v3/users/c392315310254c73913ead60965dda82` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:08.057943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=c392315310254c73913ead60965dda82)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:08.059109 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:08.112975 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c392315310254c73913ead60965dda82'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:08.120690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c392315310254c73913ead60965dda82'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:08.138796 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c392315310254c73913ead60965dda82'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:08.139605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c392315310254c73913ead60965dda82'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:08.140254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c392315310254c73913ead60965dda82'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:08.154229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1224/2473] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:36:07 2022] DELETE /identity/v3/users/c392315310254c73913ead60965dda82 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:36:08.158770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917e4c-b9c9-4e23-889b-f8c72f631f37 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:08.159059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917e4c-b9c9-4e23-889b-f8c72f631f37 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:08.159336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917e4c-b9c9-4e23-889b-f8c72f631f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:08.179041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-0d917e4c-b9c9-4e23-889b-f8c72f631f37 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:08.180265 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0d917e4c-b9c9-4e23-889b-f8c72f631f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:08.243507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1250/2474] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:08.253515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:08.255550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:08.312901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c830965-c5d9-4922-b0d6-ef1b186be8af admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:08.316664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458b862-916b-41c9-9157-344daabde34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:08.317882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458b862-916b-41c9-9157-344daabde34b service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:08.318166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458b862-916b-41c9-9157-344daabde34b service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:08.318536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458b862-916b-41c9-9157-344daabde34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:08.327655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458b862-916b-41c9-9157-344daabde34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:08.329085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458b862-916b-41c9-9157-344daabde34b service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:08.339402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1225/2475] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:36:08.624266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d917e4c-b9c9-4e23-889b-f8c72f631f37 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:08.625766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0d917e4c-b9c9-4e23-889b-f8c72f631f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:08.637906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d917e4c-b9c9-4e23-889b-f8c72f631f37 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:08.642504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:08.643134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:08.643412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:08.643683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3 admin admin] PATH_INFO: `/v3/projects/9099ca7fc4504d12ad33deada8b5ac62` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:08.644795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9099ca7fc4504d12ad33deada8b5ac62)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:08.646909 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:08.696789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9099ca7fc4504d12ad33deada8b5ac62', 'request_id': 'req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:08.703604 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9099ca7fc4504d12ad33deada8b5ac62', 'request_id': 'req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:08.710429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9099ca7fc4504d12ad33deada8b5ac62', 'request_id': 'req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:08.722580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3 admin admin] The token cache is being invalidate because project 9099ca7fc4504d12ad33deada8b5ac62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:36:08.722865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:08.724251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cb5ce6b3-75b9-435d-ade1-e68d53a03df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:08.725778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1251/2476] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:36:08 2022] DELETE /identity/v3/projects/9099ca7fc4504d12ad33deada8b5ac62 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:36:08.730642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd53d80-43c0-4de7-8c51-92fda35675cf None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:08.731098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd53d80-43c0-4de7-8c51-92fda35675cf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:08.731191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd53d80-43c0-4de7-8c51-92fda35675cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:08.752199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8dd53d80-43c0-4de7-8c51-92fda35675cf None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:08.753396 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8dd53d80-43c0-4de7-8c51-92fda35675cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:08.785632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:08.815313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1226/2477] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:08.823117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdcb65-a3a2-495d-b480-cc9c2c8e7907 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:08.823454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdcb65-a3a2-495d-b480-cc9c2c8e7907 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:08.823779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdcb65-a3a2-495d-b480-cc9c2c8e7907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:08.846333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-d9fdcb65-a3a2-495d-b480-cc9c2c8e7907 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:08.847576 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d9fdcb65-a3a2-495d-b480-cc9c2c8e7907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:08.857073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1252/2478] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:08.861260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd53d80-43c0-4de7-8c51-92fda35675cf None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:08.872885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd53d80-43c0-4de7-8c51-92fda35675cf None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:08.877524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96758e-700b-43c8-8076-b67e9dcb3c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:08.878144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96758e-700b-43c8-8076-b67e9dcb3c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:08.878448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96758e-700b-43c8-8076-b67e9dcb3c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:08.878721 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96758e-700b-43c8-8076-b67e9dcb3c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:08.879382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96758e-700b-43c8-8076-b67e9dcb3c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:36:08.879824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96758e-700b-43c8-8076-b67e9dcb3c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:08.881426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96758e-700b-43c8-8076-b67e9dcb3c08 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:08.893444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1227/2479] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:36:08.901282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdcb65-a3a2-495d-b480-cc9c2c8e7907 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:08.910720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdcb65-a3a2-495d-b480-cc9c2c8e7907 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:08.916534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ee65b-6343-49f6-8ded-8270d5e0ac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:08.917237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ee65b-6343-49f6-8ded-8270d5e0ac34 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:08.917484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ee65b-6343-49f6-8ded-8270d5e0ac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:08.917806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ee65b-6343-49f6-8ded-8270d5e0ac34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:08.918412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ee65b-6343-49f6-8ded-8270d5e0ac34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:08.920744 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ee65b-6343-49f6-8ded-8270d5e0ac34 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:08.951858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1253/2480] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:36:08 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:36:08.953130 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96758e-700b-43c8-8076-b67e9dcb3c08 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:08.964114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96758e-700b-43c8-8076-b67e9dcb3c08 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:09.022725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a7f8f-400a-4854-a4f7-015771e6fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:09.023331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a7f8f-400a-4854-a4f7-015771e6fc29 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:09.023605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a7f8f-400a-4854-a4f7-015771e6fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:09.023872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a7f8f-400a-4854-a4f7-015771e6fc29 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:09.024501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a7f8f-400a-4854-a4f7-015771e6fc29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:09.026438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a7f8f-400a-4854-a4f7-015771e6fc29 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:09.049578 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1228/2481] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:36:08 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:36:09.053748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ee65b-6343-49f6-8ded-8270d5e0ac34 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:09.064212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ee65b-6343-49f6-8ded-8270d5e0ac34 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:09.070434 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763530d2-7d70-456b-9d6f-5ee55c48e413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:09.071036 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763530d2-7d70-456b-9d6f-5ee55c48e413 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:09.071140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763530d2-7d70-456b-9d6f-5ee55c48e413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:09.071489 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763530d2-7d70-456b-9d6f-5ee55c48e413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:09.072590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763530d2-7d70-456b-9d6f-5ee55c48e413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:09.074278 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763530d2-7d70-456b-9d6f-5ee55c48e413 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:09.085377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1254/2482] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:36:09.089153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a7f8f-400a-4854-a4f7-015771e6fc29 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:09.106856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a7f8f-400a-4854-a4f7-015771e6fc29 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:09.111604 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21365e37-394d-4aa5-a8b6-70272e12adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:09.112215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21365e37-394d-4aa5-a8b6-70272e12adc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:09.112493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21365e37-394d-4aa5-a8b6-70272e12adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:09.112763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21365e37-394d-4aa5-a8b6-70272e12adc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:09.113408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21365e37-394d-4aa5-a8b6-70272e12adc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:09.115160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21365e37-394d-4aa5-a8b6-70272e12adc9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:09.126119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1229/2483] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:36:09.130639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763530d2-7d70-456b-9d6f-5ee55c48e413 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:09.141370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763530d2-7d70-456b-9d6f-5ee55c48e413 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:09.147466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423af7e-7074-48b4-922a-93b96142d77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:09.148206 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423af7e-7074-48b4-922a-93b96142d77c admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:09.148551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423af7e-7074-48b4-922a-93b96142d77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:09.148890 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423af7e-7074-48b4-922a-93b96142d77c admin admin] PATH_INFO: `/v3/projects/22599951530f44f6a48bd1c3a31356ca/users/ddb3944a8de04ee7857c7ec0afbe655a/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:09.152135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:09.167028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423af7e-7074-48b4-922a-93b96142d77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22599951530f44f6a48bd1c3a31356ca, user_id=ddb3944a8de04ee7857c7ec0afbe655a, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:09.169738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423af7e-7074-48b4-922a-93b96142d77c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:09.183210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1255/2484] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:36:09 2022] PUT /identity/v3/projects/22599951530f44f6a48bd1c3a31356ca/users/ddb3944a8de04ee7857c7ec0afbe655a/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:36:09.252487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b157a-a5fe-4f73-8357-38441cdf7722 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:09.252882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b157a-a5fe-4f73-8357-38441cdf7722 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:09.253161 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b157a-a5fe-4f73-8357-38441cdf7722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:09.282416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8a2b157a-a5fe-4f73-8357-38441cdf7722 None None] MFA Rules not processed for user `ddb3944a8de04ee7857c7ec0afbe655a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:09.283620 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8a2b157a-a5fe-4f73-8357-38441cdf7722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:09.349201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1230/2485] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:09.360274 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423af7e-7074-48b4-922a-93b96142d77c admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:09.362001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d423af7e-7074-48b4-922a-93b96142d77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:09.425369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423af7e-7074-48b4-922a-93b96142d77c admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:09.429464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5d4fb-475c-4855-a5a0-d055bf19fb0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:09.430076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d4fb-475c-4855-a5a0-d055bf19fb0d service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:09.430351 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d4fb-475c-4855-a5a0-d055bf19fb0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:09.430656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d4fb-475c-4855-a5a0-d055bf19fb0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:09.439256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5d4fb-475c-4855-a5a0-d055bf19fb0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:09.440818 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5d4fb-475c-4855-a5a0-d055bf19fb0d service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:09.450646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1256/2486] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:36:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:36:09.725027 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0fd38-11b9-4cf5-a050-8d9296625ed7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:09.725453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0fd38-11b9-4cf5-a050-8d9296625ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:09.725642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0fd38-11b9-4cf5-a050-8d9296625ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:09.747426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ece0fd38-11b9-4cf5-a050-8d9296625ed7 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:09.748692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ece0fd38-11b9-4cf5-a050-8d9296625ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:09.788939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:09.819658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1231/2487] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:36:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:09.831969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5d4fb-475c-4855-a5a0-d055bf19fb0d service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:09.833931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-86d5d4fb-475c-4855-a5a0-d055bf19fb0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:09.905516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5d4fb-475c-4855-a5a0-d055bf19fb0d service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:09.910460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e9075-9efe-42fc-ab2a-49d4e9fb1aee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:09.911310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e9075-9efe-42fc-ab2a-49d4e9fb1aee service swift] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:09.911518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e9075-9efe-42fc-ab2a-49d4e9fb1aee service swift] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:09.911789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e9075-9efe-42fc-ab2a-49d4e9fb1aee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:09.920316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e9075-9efe-42fc-ab2a-49d4e9fb1aee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:09.922023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e9075-9efe-42fc-ab2a-49d4e9fb1aee service swift] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:09.930660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1257/2488] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:36:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:36:12.994361 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0fd38-11b9-4cf5-a050-8d9296625ed7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:12.996011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ece0fd38-11b9-4cf5-a050-8d9296625ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:13.155096 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0fd38-11b9-4cf5-a050-8d9296625ed7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:13.161379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016169e9-1ae1-4541-a602-a8ce82470164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:13.162070 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016169e9-1ae1-4541-a602-a8ce82470164 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:13.162354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016169e9-1ae1-4541-a602-a8ce82470164 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:13.162657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016169e9-1ae1-4541-a602-a8ce82470164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:13.164758 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-016169e9-1ae1-4541-a602-a8ce82470164 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:13.225089 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016169e9-1ae1-4541-a602-a8ce82470164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:13.226757 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016169e9-1ae1-4541-a602-a8ce82470164 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:13.235811 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1232/2489] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:36:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:36:19.867256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e9075-9efe-42fc-ab2a-49d4e9fb1aee service swift] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:19.954582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:19.993762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e9075-9efe-42fc-ab2a-49d4e9fb1aee service swift] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:19.998773 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:19.999679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:20.000156 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:20.000658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] PATH_INFO: `/v3/users/ddb3944a8de04ee7857c7ec0afbe655a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:20.002028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb3944a8de04ee7857c7ec0afbe655a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:20.004023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:20.054795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb3944a8de04ee7857c7ec0afbe655a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:20.062003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb3944a8de04ee7857c7ec0afbe655a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:20.077353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb3944a8de04ee7857c7ec0afbe655a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:20.078407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb3944a8de04ee7857c7ec0afbe655a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:20.079033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb3944a8de04ee7857c7ec0afbe655a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:20.093444 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1258/2490] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:36:19 2022] DELETE /identity/v3/users/ddb3944a8de04ee7857c7ec0afbe655a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:36:20.098157 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de46b37-351d-4c35-bef7-85fad1abfd5a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:20.098712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de46b37-351d-4c35-bef7-85fad1abfd5a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:20.098816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de46b37-351d-4c35-bef7-85fad1abfd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:20.105615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:20.145229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3de46b37-351d-4c35-bef7-85fad1abfd5a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:20.147360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3de46b37-351d-4c35-bef7-85fad1abfd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:20.208920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1233/2491] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:20.219243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:20.220656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:20.283025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c9956-a9af-41c8-b749-712f48bd7fb1 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:20.287418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482ecb9-6220-4686-a718-a30573bff3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:20.288145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482ecb9-6220-4686-a718-a30573bff3be service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:20.288431 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482ecb9-6220-4686-a718-a30573bff3be service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:20.288709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482ecb9-6220-4686-a718-a30573bff3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:20.298720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482ecb9-6220-4686-a718-a30573bff3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:20.300170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482ecb9-6220-4686-a718-a30573bff3be service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:20.310751 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1259/2492] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:36:20.602370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de46b37-351d-4c35-bef7-85fad1abfd5a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:20.604941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3de46b37-351d-4c35-bef7-85fad1abfd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:20.623608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de46b37-351d-4c35-bef7-85fad1abfd5a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:20.641080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:20.641742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:20.642020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:20.642289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] PATH_INFO: `/v3/projects/22599951530f44f6a48bd1c3a31356ca` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:20.643450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22599951530f44f6a48bd1c3a31356ca)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:20.645388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:20.700423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22599951530f44f6a48bd1c3a31356ca', 'request_id': 'req-4d0140d9-6c88-486a-8a33-04a408d9849d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:20.710170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22599951530f44f6a48bd1c3a31356ca', 'request_id': 'req-4d0140d9-6c88-486a-8a33-04a408d9849d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:20.717035 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22599951530f44f6a48bd1c3a31356ca', 'request_id': 'req-4d0140d9-6c88-486a-8a33-04a408d9849d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:20.729358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] The token cache is being invalidate because project 22599951530f44f6a48bd1c3a31356ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:36:20.729739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:20.730494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:20.732043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1234/2493] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:36:20 2022] DELETE /identity/v3/projects/22599951530f44f6a48bd1c3a31356ca => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:36:30.306085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=64,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:30.725992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:35.380831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be8c2d-83a5-4b20-8a43-ca4dbab9e3ea None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:35.382290 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be8c2d-83a5-4b20-8a43-ca4dbab9e3ea None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:35.382677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be8c2d-83a5-4b20-8a43-ca4dbab9e3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:35.413170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-39be8c2d-83a5-4b20-8a43-ca4dbab9e3ea None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:35.414678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-39be8c2d-83a5-4b20-8a43-ca4dbab9e3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:35.480028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1260/2494] 10.222.0.33 () {58 vars in 967 bytes} [Mon Sep 12 23:36:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:35.488044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:35.489609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:35.570823 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0140d9-6c88-486a-8a33-04a408d9849d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:35.576271 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec50db7-7594-4b7a-8fa8-5f9e49d7ccfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:35.576987 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec50db7-7594-4b7a-8fa8-5f9e49d7ccfa service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:35.577360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec50db7-7594-4b7a-8fa8-5f9e49d7ccfa service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:35.577728 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec50db7-7594-4b7a-8fa8-5f9e49d7ccfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:35.587045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec50db7-7594-4b7a-8fa8-5f9e49d7ccfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:35.588770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec50db7-7594-4b7a-8fa8-5f9e49d7ccfa service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:35.599634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1235/2495] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:36:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:36:40.424698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ea17b-b37c-401a-b589-d9f4d74386fe None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:40.425223 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ea17b-b37c-401a-b589-d9f4d74386fe None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:40.425223 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ea17b-b37c-401a-b589-d9f4d74386fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:40.444928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-3a2ea17b-b37c-401a-b589-d9f4d74386fe None None] MFA Rules not processed for user `83f5ffa7705f46c2b76fd2c8e91a701d`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:40.446115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3a2ea17b-b37c-401a-b589-d9f4d74386fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:40.499341 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1261/2496] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:45.594593 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=32 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:50.492796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=54 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:55.168279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec50db7-7594-4b7a-8fa8-5f9e49d7ccfa service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:55.169766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ec50db7-7594-4b7a-8fa8-5f9e49d7ccfa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:55.259584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec50db7-7594-4b7a-8fa8-5f9e49d7ccfa service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:55.263577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbd28e-9a2d-44ab-a22e-b2de9a51023e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:55.264191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbd28e-9a2d-44ab-a22e-b2de9a51023e service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:55.264470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbd28e-9a2d-44ab-a22e-b2de9a51023e service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:55.265122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbd28e-9a2d-44ab-a22e-b2de9a51023e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:55.266578 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9adbd28e-9a2d-44ab-a22e-b2de9a51023e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:55.336777 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbd28e-9a2d-44ab-a22e-b2de9a51023e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:55.338202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbd28e-9a2d-44ab-a22e-b2de9a51023e service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:55.348557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1236/2497] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:36:58.450341 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ea17b-b37c-401a-b589-d9f4d74386fe None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:58.452480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3a2ea17b-b37c-401a-b589-d9f4d74386fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:58.470251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ea17b-b37c-401a-b589-d9f4d74386fe None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:58.475433 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81247d3-6d3f-49cc-82ea-f55bba2cc435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:58.476087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81247d3-6d3f-49cc-82ea-f55bba2cc435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:58.476369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81247d3-6d3f-49cc-82ea-f55bba2cc435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:58.476643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81247d3-6d3f-49cc-82ea-f55bba2cc435 admin admin] PATH_INFO: `/v3/users/8b7e7f9af2cd4ac0bebb2a65f08a4398` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:58.477783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81247d3-6d3f-49cc-82ea-f55bba2cc435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7e7f9af2cd4ac0bebb2a65f08a4398)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:58.479772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81247d3-6d3f-49cc-82ea-f55bba2cc435 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:58.529661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d81247d3-6d3f-49cc-82ea-f55bba2cc435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7e7f9af2cd4ac0bebb2a65f08a4398'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:58.536469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d81247d3-6d3f-49cc-82ea-f55bba2cc435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7e7f9af2cd4ac0bebb2a65f08a4398'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:58.548674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d81247d3-6d3f-49cc-82ea-f55bba2cc435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7e7f9af2cd4ac0bebb2a65f08a4398'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:58.549339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d81247d3-6d3f-49cc-82ea-f55bba2cc435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7e7f9af2cd4ac0bebb2a65f08a4398'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:58.549937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d81247d3-6d3f-49cc-82ea-f55bba2cc435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7e7f9af2cd4ac0bebb2a65f08a4398'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:58.563519 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1262/2498] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:36:58 2022] DELETE /identity/v3/users/8b7e7f9af2cd4ac0bebb2a65f08a4398 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:36:58.738153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbd28e-9a2d-44ab-a22e-b2de9a51023e service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:58.749074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbd28e-9a2d-44ab-a22e-b2de9a51023e service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:58.807002 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:58.807638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:58.807921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:58.808199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e admin admin] PATH_INFO: `/v3/projects/db54b7380ccd465a9df7904f2c439c75` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:58.809327 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db54b7380ccd465a9df7904f2c439c75)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:58.811293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:58.845476 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:58.858698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db54b7380ccd465a9df7904f2c439c75', 'request_id': 'req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:58.866775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db54b7380ccd465a9df7904f2c439c75', 'request_id': 'req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:58.873286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db54b7380ccd465a9df7904f2c439c75', 'request_id': 'req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:58.883874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e admin admin] The token cache is being invalidate because project db54b7380ccd465a9df7904f2c439c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:36:58.884194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:58.884974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c5d702a2-bf7b-488d-a4cc-f4be9df7b12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:58.886585 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1237/2499] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:36:58 2022] DELETE /identity/v3/projects/db54b7380ccd465a9df7904f2c439c75 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:36:58.891943 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04411716-9b25-4a92-bc4a-472cf89a932f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:58.892346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04411716-9b25-4a92-bc4a-472cf89a932f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:58.892725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04411716-9b25-4a92-bc4a-472cf89a932f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:58.941923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-04411716-9b25-4a92-bc4a-472cf89a932f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:58.943269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-04411716-9b25-4a92-bc4a-472cf89a932f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:59.003761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1263/2500] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:59.012122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83191-82e9-420c-93c1-4ae37932fedc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:59.012403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83191-82e9-420c-93c1-4ae37932fedc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:59.012678 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83191-82e9-420c-93c1-4ae37932fedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:59.032146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c6f83191-82e9-420c-93c1-4ae37932fedc None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:59.033341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c6f83191-82e9-420c-93c1-4ae37932fedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:59.042563 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1238/2501] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:59.046907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04411716-9b25-4a92-bc4a-472cf89a932f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:59.057733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04411716-9b25-4a92-bc4a-472cf89a932f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:59.062315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853fc04-11fc-43cc-9a06-fb18feb289f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:59.062924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853fc04-11fc-43cc-9a06-fb18feb289f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:59.063202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853fc04-11fc-43cc-9a06-fb18feb289f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:59.063470 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853fc04-11fc-43cc-9a06-fb18feb289f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:59.064114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853fc04-11fc-43cc-9a06-fb18feb289f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:36:59.064413 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853fc04-11fc-43cc-9a06-fb18feb289f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:59.066022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853fc04-11fc-43cc-9a06-fb18feb289f0 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:59.078096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1264/2502] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:36:59.082490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f83191-82e9-420c-93c1-4ae37932fedc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:59.092451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f83191-82e9-420c-93c1-4ae37932fedc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:59.097316 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278104c-473f-4584-8040-a04b5aac9414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:59.097874 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278104c-473f-4584-8040-a04b5aac9414 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:59.098156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278104c-473f-4584-8040-a04b5aac9414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:59.098488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278104c-473f-4584-8040-a04b5aac9414 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:59.099130 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278104c-473f-4584-8040-a04b5aac9414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:59.101792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278104c-473f-4584-8040-a04b5aac9414 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:59.128575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1239/2503] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:36:59 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:36:59.132681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853fc04-11fc-43cc-9a06-fb18feb289f0 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:59.144170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853fc04-11fc-43cc-9a06-fb18feb289f0 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:59.178172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:59.203957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3799e-9c60-43e8-9510-a76e8ab881ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:59.204562 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3799e-9c60-43e8-9510-a76e8ab881ae admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:59.204842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3799e-9c60-43e8-9510-a76e8ab881ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:59.205114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3799e-9c60-43e8-9510-a76e8ab881ae admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:59.205741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3799e-9c60-43e8-9510-a76e8ab881ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:59.207688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3799e-9c60-43e8-9510-a76e8ab881ae admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:59.228628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1265/2504] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:36:59 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:36:59.232955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278104c-473f-4584-8040-a04b5aac9414 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:59.243279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278104c-473f-4584-8040-a04b5aac9414 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:59.247887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e2d39-16a8-4f8c-ba21-38fe7d960ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:59.248471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e2d39-16a8-4f8c-ba21-38fe7d960ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:59.248750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e2d39-16a8-4f8c-ba21-38fe7d960ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:59.249023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e2d39-16a8-4f8c-ba21-38fe7d960ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:59.249658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e2d39-16a8-4f8c-ba21-38fe7d960ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:59.251294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e2d39-16a8-4f8c-ba21-38fe7d960ab3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:59.261226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1240/2505] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:36:59.264982 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3799e-9c60-43e8-9510-a76e8ab881ae admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:59.275695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3799e-9c60-43e8-9510-a76e8ab881ae admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:59.280353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdfa67-d2d6-4737-86b5-76a80ab26f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:59.280946 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdfa67-d2d6-4737-86b5-76a80ab26f9a admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:59.281227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdfa67-d2d6-4737-86b5-76a80ab26f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:59.281499 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdfa67-d2d6-4737-86b5-76a80ab26f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:59.282133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdfa67-d2d6-4737-86b5-76a80ab26f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:59.283799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdfa67-d2d6-4737-86b5-76a80ab26f9a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:59.294795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1266/2506] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:36:59.298865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e2d39-16a8-4f8c-ba21-38fe7d960ab3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:59.308888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e2d39-16a8-4f8c-ba21-38fe7d960ab3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:59.313545 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c66a7-d168-4e22-bead-340554f5fc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:59.314189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c66a7-d168-4e22-bead-340554f5fc0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:59.314615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c66a7-d168-4e22-bead-340554f5fc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:59.314895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c66a7-d168-4e22-bead-340554f5fc0f admin admin] PATH_INFO: `/v3/projects/22e490ef4d134eb3af4d283db0d9aebb/users/e7fa9c5234304a6192f38fe4def0fcc4/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:59.329189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c66a7-d168-4e22-bead-340554f5fc0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e490ef4d134eb3af4d283db0d9aebb, user_id=e7fa9c5234304a6192f38fe4def0fcc4, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:59.331885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c66a7-d168-4e22-bead-340554f5fc0f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:59.344926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1241/2507] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:36:59 2022] PUT /identity/v3/projects/22e490ef4d134eb3af4d283db0d9aebb/users/e7fa9c5234304a6192f38fe4def0fcc4/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:36:59.356886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9f51-0cf2-4f93-a74a-4ae3fcae4585 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:59.357110 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9f51-0cf2-4f93-a74a-4ae3fcae4585 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:59.357387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9f51-0cf2-4f93-a74a-4ae3fcae4585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:59.386205 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-8cde9f51-0cf2-4f93-a74a-4ae3fcae4585 None None] MFA Rules not processed for user `e7fa9c5234304a6192f38fe4def0fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:59.387490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8cde9f51-0cf2-4f93-a74a-4ae3fcae4585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:59.453612 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1267/2508] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:36:59.465536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c66a7-d168-4e22-bead-340554f5fc0f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:59.467248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-125c66a7-d168-4e22-bead-340554f5fc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:59.541016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c66a7-d168-4e22-bead-340554f5fc0f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:59.546529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cfc63-2dd7-4c52-846f-881064f7c34b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:59.547125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cfc63-2dd7-4c52-846f-881064f7c34b service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:59.547404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cfc63-2dd7-4c52-846f-881064f7c34b service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:59.547677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cfc63-2dd7-4c52-846f-881064f7c34b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:59.555335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cfc63-2dd7-4c52-846f-881064f7c34b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:59.556918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cfc63-2dd7-4c52-846f-881064f7c34b service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:59.565581 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1242/2509] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:36:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:36:59.775630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9f51-0cf2-4f93-a74a-4ae3fcae4585 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:36:59.838046 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9f51-0cf2-4f93-a74a-4ae3fcae4585 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:36:59.842596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:36:59.843223 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:59.843505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:59.843780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] PATH_INFO: `/v3/users/e7fa9c5234304a6192f38fe4def0fcc4` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:59.844904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7fa9c5234304a6192f38fe4def0fcc4)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:36:59.846855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:36:59.893333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:59.895009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7fa9c5234304a6192f38fe4def0fcc4'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:59.904274 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7fa9c5234304a6192f38fe4def0fcc4'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:59.916334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7fa9c5234304a6192f38fe4def0fcc4'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:59.917009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7fa9c5234304a6192f38fe4def0fcc4'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:59.917611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7fa9c5234304a6192f38fe4def0fcc4'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:36:59.930672 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1268/2510] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:36:59 2022] DELETE /identity/v3/users/e7fa9c5234304a6192f38fe4def0fcc4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:36:59.935237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d6ef8-86a5-4389-b963-bb533ed0645d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:36:59.935713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d6ef8-86a5-4389-b963-bb533ed0645d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:36:59.935833 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d6ef8-86a5-4389-b963-bb533ed0645d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:36:59.954941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-353d6ef8-86a5-4389-b963-bb533ed0645d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:36:59.956126 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-353d6ef8-86a5-4389-b963-bb533ed0645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:36:59.993566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:00.019020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1243/2511] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:00.028918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:00.030349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:00.087525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cafe4e-6ee0-4226-be74-b36073a88555 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:00.091105 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07786ce2-9ecd-4290-b64d-db5142e904df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:00.091711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07786ce2-9ecd-4290-b64d-db5142e904df service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:00.091990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07786ce2-9ecd-4290-b64d-db5142e904df service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:00.092287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07786ce2-9ecd-4290-b64d-db5142e904df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:00.101205 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07786ce2-9ecd-4290-b64d-db5142e904df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:00.102662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07786ce2-9ecd-4290-b64d-db5142e904df service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:00.112389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1269/2512] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:00.383258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d6ef8-86a5-4389-b963-bb533ed0645d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:00.384975 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-353d6ef8-86a5-4389-b963-bb533ed0645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:00.398068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d6ef8-86a5-4389-b963-bb533ed0645d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:00.402851 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202f248-11e3-41f8-97be-f6cbc1fdcca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:00.403569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202f248-11e3-41f8-97be-f6cbc1fdcca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:00.403918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202f248-11e3-41f8-97be-f6cbc1fdcca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:00.404261 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202f248-11e3-41f8-97be-f6cbc1fdcca4 admin admin] PATH_INFO: `/v3/projects/22e490ef4d134eb3af4d283db0d9aebb` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:00.405471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202f248-11e3-41f8-97be-f6cbc1fdcca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e490ef4d134eb3af4d283db0d9aebb)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:00.408127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202f248-11e3-41f8-97be-f6cbc1fdcca4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:00.459202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6202f248-11e3-41f8-97be-f6cbc1fdcca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e490ef4d134eb3af4d283db0d9aebb', 'request_id': 'req-6202f248-11e3-41f8-97be-f6cbc1fdcca4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:00.466235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6202f248-11e3-41f8-97be-f6cbc1fdcca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e490ef4d134eb3af4d283db0d9aebb', 'request_id': 'req-6202f248-11e3-41f8-97be-f6cbc1fdcca4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:00.472673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6202f248-11e3-41f8-97be-f6cbc1fdcca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e490ef4d134eb3af4d283db0d9aebb', 'request_id': 'req-6202f248-11e3-41f8-97be-f6cbc1fdcca4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:00.483844 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6202f248-11e3-41f8-97be-f6cbc1fdcca4 admin admin] The token cache is being invalidate because project 22e490ef4d134eb3af4d283db0d9aebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:37:00.484132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6202f248-11e3-41f8-97be-f6cbc1fdcca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:00.484773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6202f248-11e3-41f8-97be-f6cbc1fdcca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:00.486627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1244/2513] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:37:00 2022] DELETE /identity/v3/projects/22e490ef4d134eb3af4d283db0d9aebb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:00.491905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8fc86-9ae1-4766-b40e-cf7abd79e211 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:00.492374 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8fc86-9ae1-4766-b40e-cf7abd79e211 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:00.492484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8fc86-9ae1-4766-b40e-cf7abd79e211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:00.512512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-79f8fc86-9ae1-4766-b40e-cf7abd79e211 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:00.513694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-79f8fc86-9ae1-4766-b40e-cf7abd79e211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:00.576780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1270/2514] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:00.585088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318275-60e3-478a-86b4-c5a749023c20 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:00.585375 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318275-60e3-478a-86b4-c5a749023c20 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:00.585647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318275-60e3-478a-86b4-c5a749023c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:00.605568 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-72318275-60e3-478a-86b4-c5a749023c20 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:00.606801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-72318275-60e3-478a-86b4-c5a749023c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:00.614655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1245/2515] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:00.618908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8fc86-9ae1-4766-b40e-cf7abd79e211 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:00.628342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8fc86-9ae1-4766-b40e-cf7abd79e211 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:00.632915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318de08f-1a07-4394-81f0-bf87ca8ae3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:00.633506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318de08f-1a07-4394-81f0-bf87ca8ae3df admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:00.633783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318de08f-1a07-4394-81f0-bf87ca8ae3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:00.634052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318de08f-1a07-4394-81f0-bf87ca8ae3df admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:00.634725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318de08f-1a07-4394-81f0-bf87ca8ae3df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:37:00.635051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318de08f-1a07-4394-81f0-bf87ca8ae3df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:00.636623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318de08f-1a07-4394-81f0-bf87ca8ae3df admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:00.648659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1271/2516] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:00.652754 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72318275-60e3-478a-86b4-c5a749023c20 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:00.662522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72318275-60e3-478a-86b4-c5a749023c20 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:00.667448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949c850-a0fb-45f0-9d13-329bda02a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:00.668043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949c850-a0fb-45f0-9d13-329bda02a6ca admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:00.668326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949c850-a0fb-45f0-9d13-329bda02a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:00.668595 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949c850-a0fb-45f0-9d13-329bda02a6ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:00.669224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949c850-a0fb-45f0-9d13-329bda02a6ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:00.671175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949c850-a0fb-45f0-9d13-329bda02a6ca admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:00.698611 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1246/2517] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:37:00 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:00.702969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318de08f-1a07-4394-81f0-bf87ca8ae3df admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:00.713463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318de08f-1a07-4394-81f0-bf87ca8ae3df admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:00.761063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:00.772655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1768e58-f0cb-4b0c-8eb1-c96c88681ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:00.773256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1768e58-f0cb-4b0c-8eb1-c96c88681ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:00.773541 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1768e58-f0cb-4b0c-8eb1-c96c88681ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:00.773809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1768e58-f0cb-4b0c-8eb1-c96c88681ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:00.774465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1768e58-f0cb-4b0c-8eb1-c96c88681ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:00.776445 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1768e58-f0cb-4b0c-8eb1-c96c88681ea6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:00.797607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1272/2518] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:37:00 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:00.801752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949c850-a0fb-45f0-9d13-329bda02a6ca admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:00.812026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949c850-a0fb-45f0-9d13-329bda02a6ca admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:00.816565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55527932-afd4-418e-a88a-5929ae45ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:00.817163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55527932-afd4-418e-a88a-5929ae45ed17 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:00.817459 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55527932-afd4-418e-a88a-5929ae45ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:00.817716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55527932-afd4-418e-a88a-5929ae45ed17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:00.818403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55527932-afd4-418e-a88a-5929ae45ed17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:00.820013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55527932-afd4-418e-a88a-5929ae45ed17 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:00.829739 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1247/2519] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:00.834321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1768e58-f0cb-4b0c-8eb1-c96c88681ea6 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:00.844384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1768e58-f0cb-4b0c-8eb1-c96c88681ea6 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:00.848981 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d900d92-bbb3-4f44-8f63-0d681f2609b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:00.850284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d900d92-bbb3-4f44-8f63-0d681f2609b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:00.850542 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d900d92-bbb3-4f44-8f63-0d681f2609b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:00.850817 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d900d92-bbb3-4f44-8f63-0d681f2609b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:00.851456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d900d92-bbb3-4f44-8f63-0d681f2609b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:00.853045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d900d92-bbb3-4f44-8f63-0d681f2609b4 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:00.863505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1273/2520] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:00.867877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55527932-afd4-418e-a88a-5929ae45ed17 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:00.877905 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55527932-afd4-418e-a88a-5929ae45ed17 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:00.882985 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740beb7-0500-4a5e-bad7-e9bd442f5833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:00.883660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740beb7-0500-4a5e-bad7-e9bd442f5833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:00.883941 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740beb7-0500-4a5e-bad7-e9bd442f5833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:00.884217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740beb7-0500-4a5e-bad7-e9bd442f5833 admin admin] PATH_INFO: `/v3/projects/88ed08930b7444d98f17ee674cec3190/users/cbbeed5e6f9a4910ab938a482f51d408/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:00.898981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740beb7-0500-4a5e-bad7-e9bd442f5833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ed08930b7444d98f17ee674cec3190, user_id=cbbeed5e6f9a4910ab938a482f51d408, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:00.901658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740beb7-0500-4a5e-bad7-e9bd442f5833 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:00.917282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1248/2521] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:37:00 2022] PUT /identity/v3/projects/88ed08930b7444d98f17ee674cec3190/users/cbbeed5e6f9a4910ab938a482f51d408/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:00.928276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22a15d-9507-4361-ac0a-4484ae7d442b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:00.928610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22a15d-9507-4361-ac0a-4484ae7d442b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:00.928886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22a15d-9507-4361-ac0a-4484ae7d442b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:00.958388 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cf22a15d-9507-4361-ac0a-4484ae7d442b None None] MFA Rules not processed for user `cbbeed5e6f9a4910ab938a482f51d408`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:00.960364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cf22a15d-9507-4361-ac0a-4484ae7d442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:01.023745 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1274/2522] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:01.028234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740beb7-0500-4a5e-bad7-e9bd442f5833 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:01.089704 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740beb7-0500-4a5e-bad7-e9bd442f5833 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:01.094327 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4389e-7360-422f-80a9-99c93550c23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:01.094963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4389e-7360-422f-80a9-99c93550c23a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:01.095233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4389e-7360-422f-80a9-99c93550c23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:01.095505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4389e-7360-422f-80a9-99c93550c23a admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:01.096137 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4389e-7360-422f-80a9-99c93550c23a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:01.098055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4389e-7360-422f-80a9-99c93550c23a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:01.103443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:01.127348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1249/2523] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:37:01 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:01.131962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22a15d-9507-4361-ac0a-4484ae7d442b None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:01.143547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22a15d-9507-4361-ac0a-4484ae7d442b None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:01.201387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa67ba7-9719-49a2-8398-bbe09825b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:01.201998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa67ba7-9719-49a2-8398-bbe09825b15c admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:01.202276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa67ba7-9719-49a2-8398-bbe09825b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:01.202589 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa67ba7-9719-49a2-8398-bbe09825b15c admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:01.203212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa67ba7-9719-49a2-8398-bbe09825b15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:01.205130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa67ba7-9719-49a2-8398-bbe09825b15c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:01.227225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1275/2524] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:37:01 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:01.231207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4389e-7360-422f-80a9-99c93550c23a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:01.241568 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4389e-7360-422f-80a9-99c93550c23a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:01.246202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82d94e-af81-4c82-b628-ab89922d1e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:01.246906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82d94e-af81-4c82-b628-ab89922d1e65 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:01.247188 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82d94e-af81-4c82-b628-ab89922d1e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:01.247464 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82d94e-af81-4c82-b628-ab89922d1e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:01.248102 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82d94e-af81-4c82-b628-ab89922d1e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:01.249715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82d94e-af81-4c82-b628-ab89922d1e65 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:01.260111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1250/2525] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:01.264252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa67ba7-9719-49a2-8398-bbe09825b15c admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:01.275221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa67ba7-9719-49a2-8398-bbe09825b15c admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:01.279762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623f3ea-85c5-44fb-84da-36993776e191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:01.280408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623f3ea-85c5-44fb-84da-36993776e191 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:01.280685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623f3ea-85c5-44fb-84da-36993776e191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:01.280957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623f3ea-85c5-44fb-84da-36993776e191 admin admin] PATH_INFO: `/v3/projects/902ba0ff60364130b4e8de6355e6899a/users/4438e056eb8848bd9b2f3f41659b105a/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:01.296225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623f3ea-85c5-44fb-84da-36993776e191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902ba0ff60364130b4e8de6355e6899a, user_id=4438e056eb8848bd9b2f3f41659b105a, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:01.298947 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623f3ea-85c5-44fb-84da-36993776e191 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:01.312593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1276/2526] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:37:01 2022] PUT /identity/v3/projects/902ba0ff60364130b4e8de6355e6899a/users/4438e056eb8848bd9b2f3f41659b105a/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:01.316492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82d94e-af81-4c82-b628-ab89922d1e65 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:01.327038 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82d94e-af81-4c82-b628-ab89922d1e65 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:01.383962 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedce9e2-36ac-4228-b92c-b4acea58eec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:01.384627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedce9e2-36ac-4228-b92c-b4acea58eec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:01.385004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedce9e2-36ac-4228-b92c-b4acea58eec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:01.385311 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedce9e2-36ac-4228-b92c-b4acea58eec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:01.385957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedce9e2-36ac-4228-b92c-b4acea58eec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:01.387605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedce9e2-36ac-4228-b92c-b4acea58eec7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:01.397815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1251/2527] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:01.402188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623f3ea-85c5-44fb-84da-36993776e191 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:01.412482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623f3ea-85c5-44fb-84da-36993776e191 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:01.418091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e047d6-d635-4a9a-b157-c629f7e46e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:01.418779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e047d6-d635-4a9a-b157-c629f7e46e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:01.419087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e047d6-d635-4a9a-b157-c629f7e46e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:01.419362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e047d6-d635-4a9a-b157-c629f7e46e56 admin admin] PATH_INFO: `/v3/projects/902ba0ff60364130b4e8de6355e6899a/users/4438e056eb8848bd9b2f3f41659b105a/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:01.421279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e047d6-d635-4a9a-b157-c629f7e46e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902ba0ff60364130b4e8de6355e6899a, user_id=4438e056eb8848bd9b2f3f41659b105a, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:01.423952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e047d6-d635-4a9a-b157-c629f7e46e56 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:01.435601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1277/2528] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:37:01 2022] PUT /identity/v3/projects/902ba0ff60364130b4e8de6355e6899a/users/4438e056eb8848bd9b2f3f41659b105a/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:01.447989 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2f273-93a2-4820-b5da-845f12f36816 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:01.448280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2f273-93a2-4820-b5da-845f12f36816 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:01.448555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2f273-93a2-4820-b5da-845f12f36816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:01.476368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d3d2f273-93a2-4820-b5da-845f12f36816 None None] MFA Rules not processed for user `4438e056eb8848bd9b2f3f41659b105a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:01.477852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d3d2f273-93a2-4820-b5da-845f12f36816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:01.545548 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1252/2529] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:01.557183 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e047d6-d635-4a9a-b157-c629f7e46e56 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:01.559143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a0e047d6-d635-4a9a-b157-c629f7e46e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:01.578787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:01.641899 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e047d6-d635-4a9a-b157-c629f7e46e56 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:01.645692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99649098-0795-4f57-be86-441bffb74578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:01.646363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99649098-0795-4f57-be86-441bffb74578 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:01.646728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99649098-0795-4f57-be86-441bffb74578 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:01.647001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99649098-0795-4f57-be86-441bffb74578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:01.655970 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99649098-0795-4f57-be86-441bffb74578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:01.657381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99649098-0795-4f57-be86-441bffb74578 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:01.667293 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1278/2530] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:01.699419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2f273-93a2-4820-b5da-845f12f36816 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:01.759044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:01.763517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2f273-93a2-4820-b5da-845f12f36816 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:01.769132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:01.769773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:01.770053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:01.770327 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] PATH_INFO: `/v3/users/cbbeed5e6f9a4910ab938a482f51d408` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:01.771520 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbeed5e6f9a4910ab938a482f51d408)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:01.773655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:01.821577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbeed5e6f9a4910ab938a482f51d408'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:01.828251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbeed5e6f9a4910ab938a482f51d408'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:01.840140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbeed5e6f9a4910ab938a482f51d408'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:01.840833 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbeed5e6f9a4910ab938a482f51d408'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:01.841434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbeed5e6f9a4910ab938a482f51d408'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:01.858329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1253/2531] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:37:01 2022] DELETE /identity/v3/users/cbbeed5e6f9a4910ab938a482f51d408 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:01.862984 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312a934-5a51-4903-9191-8e1d036c84e9 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:01.863288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312a934-5a51-4903-9191-8e1d036c84e9 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:01.863556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312a934-5a51-4903-9191-8e1d036c84e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:01.883053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e312a934-5a51-4903-9191-8e1d036c84e9 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:01.884231 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e312a934-5a51-4903-9191-8e1d036c84e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:01.942216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1279/2532] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:01.951829 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:01.953231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:02.009772 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885f143-ff4f-407b-82b3-b3cc5bb65984 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:02.013320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdc125-2d06-45b8-bb0f-e44a30f87b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:02.013911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdc125-2d06-45b8-bb0f-e44a30f87b2e service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:02.014187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdc125-2d06-45b8-bb0f-e44a30f87b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:02.014482 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdc125-2d06-45b8-bb0f-e44a30f87b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:02.023308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdc125-2d06-45b8-bb0f-e44a30f87b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:02.024726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdc125-2d06-45b8-bb0f-e44a30f87b2e service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:02.033919 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1254/2533] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:02.312445 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312a934-5a51-4903-9191-8e1d036c84e9 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:02.313886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e312a934-5a51-4903-9191-8e1d036c84e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:02.325915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312a934-5a51-4903-9191-8e1d036c84e9 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:02.330814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:02.331509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:02.331725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:02.331999 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] PATH_INFO: `/v3/projects/88ed08930b7444d98f17ee674cec3190` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:02.334008 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ed08930b7444d98f17ee674cec3190)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:02.335828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:02.384283 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ed08930b7444d98f17ee674cec3190', 'request_id': 'req-8a12e25c-5a68-477d-92a5-51dda66e27eb'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.390644 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ed08930b7444d98f17ee674cec3190', 'request_id': 'req-8a12e25c-5a68-477d-92a5-51dda66e27eb'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.397144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ed08930b7444d98f17ee674cec3190', 'request_id': 'req-8a12e25c-5a68-477d-92a5-51dda66e27eb'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.410217 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] The token cache is being invalidate because project 88ed08930b7444d98f17ee674cec3190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:37:02.410540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.411149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.413227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1280/2534] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:37:02 2022] DELETE /identity/v3/projects/88ed08930b7444d98f17ee674cec3190 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:02.417488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdc125-2d06-45b8-bb0f-e44a30f87b2e service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:02.426949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdc125-2d06-45b8-bb0f-e44a30f87b2e service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:02.482984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d62a56-d14d-4377-aefd-de60287d9545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:02.483612 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d62a56-d14d-4377-aefd-de60287d9545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:02.483887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d62a56-d14d-4377-aefd-de60287d9545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:02.484158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d62a56-d14d-4377-aefd-de60287d9545 admin admin] PATH_INFO: `/v3/users/4438e056eb8848bd9b2f3f41659b105a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:02.485267 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d62a56-d14d-4377-aefd-de60287d9545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4438e056eb8848bd9b2f3f41659b105a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:02.487234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d62a56-d14d-4377-aefd-de60287d9545 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:02.509982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:02.535477 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d8d62a56-d14d-4377-aefd-de60287d9545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4438e056eb8848bd9b2f3f41659b105a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.542581 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d8d62a56-d14d-4377-aefd-de60287d9545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4438e056eb8848bd9b2f3f41659b105a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.554219 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d8d62a56-d14d-4377-aefd-de60287d9545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4438e056eb8848bd9b2f3f41659b105a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.554906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d8d62a56-d14d-4377-aefd-de60287d9545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4438e056eb8848bd9b2f3f41659b105a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.555507 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d8d62a56-d14d-4377-aefd-de60287d9545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4438e056eb8848bd9b2f3f41659b105a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.568665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1255/2535] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:37:02 2022] DELETE /identity/v3/users/4438e056eb8848bd9b2f3f41659b105a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:02.834440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:02.836002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:02.850347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12e25c-5a68-477d-92a5-51dda66e27eb admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:02.868124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:02.916822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db742-0911-4304-981b-dd81e548f203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:02.917465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db742-0911-4304-981b-dd81e548f203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:02.917745 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db742-0911-4304-981b-dd81e548f203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:02.918021 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db742-0911-4304-981b-dd81e548f203 admin admin] PATH_INFO: `/v3/projects/902ba0ff60364130b4e8de6355e6899a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:02.919193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1db742-0911-4304-981b-dd81e548f203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=902ba0ff60364130b4e8de6355e6899a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:02.921156 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1db742-0911-4304-981b-dd81e548f203 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:02.968690 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1b1db742-0911-4304-981b-dd81e548f203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902ba0ff60364130b4e8de6355e6899a', 'request_id': 'req-1b1db742-0911-4304-981b-dd81e548f203'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.975658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1b1db742-0911-4304-981b-dd81e548f203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902ba0ff60364130b4e8de6355e6899a', 'request_id': 'req-1b1db742-0911-4304-981b-dd81e548f203'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.981159 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1b1db742-0911-4304-981b-dd81e548f203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902ba0ff60364130b4e8de6355e6899a', 'request_id': 'req-1b1db742-0911-4304-981b-dd81e548f203'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.993872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1b1db742-0911-4304-981b-dd81e548f203 admin admin] The token cache is being invalidate because project 902ba0ff60364130b4e8de6355e6899a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:37:02.994159 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1b1db742-0911-4304-981b-dd81e548f203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.994797 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1b1db742-0911-4304-981b-dd81e548f203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:02.996533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1281/2536] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:37:02 2022] DELETE /identity/v3/projects/902ba0ff60364130b4e8de6355e6899a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:03.002392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cd883-0fd1-491b-9b95-268406f5f0fd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.002699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cd883-0fd1-491b-9b95-268406f5f0fd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.002971 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cd883-0fd1-491b-9b95-268406f5f0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.023063 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-466cd883-0fd1-491b-9b95-268406f5f0fd None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:03.024248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-466cd883-0fd1-491b-9b95-268406f5f0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:03.083051 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1256/2537] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:03.091153 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2579-4cc3-4136-8377-e65d0aa01db2 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.091408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2579-4cc3-4136-8377-e65d0aa01db2 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.091685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2579-4cc3-4136-8377-e65d0aa01db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.111122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f35b2579-4cc3-4136-8377-e65d0aa01db2 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:03.112316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f35b2579-4cc3-4136-8377-e65d0aa01db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:03.120974 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1282/2538] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:03.125094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cd883-0fd1-491b-9b95-268406f5f0fd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:03.135493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cd883-0fd1-491b-9b95-268406f5f0fd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:03.141063 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b706b6e-979d-4960-8e2a-139f2ad1abca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:03.141658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b706b6e-979d-4960-8e2a-139f2ad1abca admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.141978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b706b6e-979d-4960-8e2a-139f2ad1abca admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.142241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b706b6e-979d-4960-8e2a-139f2ad1abca admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.143044 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b706b6e-979d-4960-8e2a-139f2ad1abca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:37:03.143348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b706b6e-979d-4960-8e2a-139f2ad1abca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:03.144948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b706b6e-979d-4960-8e2a-139f2ad1abca admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:03.156516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1257/2539] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:03.160901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b2579-4cc3-4136-8377-e65d0aa01db2 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:03.170317 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b2579-4cc3-4136-8377-e65d0aa01db2 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:03.175011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9354f0-97fa-43e5-84dc-24018b785a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:03.175605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9354f0-97fa-43e5-84dc-24018b785a6b admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.175885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9354f0-97fa-43e5-84dc-24018b785a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.176159 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9354f0-97fa-43e5-84dc-24018b785a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.176792 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9354f0-97fa-43e5-84dc-24018b785a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:03.179383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9354f0-97fa-43e5-84dc-24018b785a6b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:03.206929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1283/2540] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:37:03 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:03.211387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b706b6e-979d-4960-8e2a-139f2ad1abca admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:03.221137 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b706b6e-979d-4960-8e2a-139f2ad1abca admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:03.276465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddd82f-df0d-40a4-a059-4fdc47697298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:03.277117 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddd82f-df0d-40a4-a059-4fdc47697298 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.277525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddd82f-df0d-40a4-a059-4fdc47697298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.277805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddd82f-df0d-40a4-a059-4fdc47697298 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.278450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddd82f-df0d-40a4-a059-4fdc47697298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:03.280409 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddd82f-df0d-40a4-a059-4fdc47697298 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:03.301918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1258/2541] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:37:03 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:03.306734 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9354f0-97fa-43e5-84dc-24018b785a6b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:03.316689 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9354f0-97fa-43e5-84dc-24018b785a6b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:03.321296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184681e-f8dd-4631-aaff-29d7be14aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:03.321892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184681e-f8dd-4631-aaff-29d7be14aa4e admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.322170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184681e-f8dd-4631-aaff-29d7be14aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.322473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184681e-f8dd-4631-aaff-29d7be14aa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.323107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184681e-f8dd-4631-aaff-29d7be14aa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:03.324688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184681e-f8dd-4631-aaff-29d7be14aa4e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:03.334440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1284/2542] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:03.338142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddd82f-df0d-40a4-a059-4fdc47697298 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:03.348144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddd82f-df0d-40a4-a059-4fdc47697298 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:03.353400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8f0dd-8112-4213-b597-02c4770545f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:03.353995 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f0dd-8112-4213-b597-02c4770545f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.354279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f0dd-8112-4213-b597-02c4770545f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.354590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f0dd-8112-4213-b597-02c4770545f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.355230 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8f0dd-8112-4213-b597-02c4770545f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:03.356827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8f0dd-8112-4213-b597-02c4770545f5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:03.368390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1259/2543] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:03.372800 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184681e-f8dd-4631-aaff-29d7be14aa4e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:03.382999 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184681e-f8dd-4631-aaff-29d7be14aa4e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:03.387755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274188d-8eff-4a7b-9e44-72b7b50ea838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:03.388411 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274188d-8eff-4a7b-9e44-72b7b50ea838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.388690 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274188d-8eff-4a7b-9e44-72b7b50ea838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.388962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274188d-8eff-4a7b-9e44-72b7b50ea838 admin admin] PATH_INFO: `/v3/projects/17deb9580671470fa6b19ea28972fdad/users/a82a304a6eb24b0db6235b5608c07f1d/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.403662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274188d-8eff-4a7b-9e44-72b7b50ea838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17deb9580671470fa6b19ea28972fdad, user_id=a82a304a6eb24b0db6235b5608c07f1d, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:03.406309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274188d-8eff-4a7b-9e44-72b7b50ea838 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:03.420083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1285/2544] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:37:03 2022] PUT /identity/v3/projects/17deb9580671470fa6b19ea28972fdad/users/a82a304a6eb24b0db6235b5608c07f1d/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:37:03.430955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb8293-a5a3-4e97-8237-964bedf91de5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.431272 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb8293-a5a3-4e97-8237-964bedf91de5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.431575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb8293-a5a3-4e97-8237-964bedf91de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.439789 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:03.463047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0cfb8293-a5a3-4e97-8237-964bedf91de5 None None] MFA Rules not processed for user `a82a304a6eb24b0db6235b5608c07f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:03.464262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0cfb8293-a5a3-4e97-8237-964bedf91de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:03.528180 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1260/2545] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:03.532468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274188d-8eff-4a7b-9e44-72b7b50ea838 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:03.580069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:03.596967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274188d-8eff-4a7b-9e44-72b7b50ea838 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:03.602545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa974782-47f0-4ef2-8405-0bca65ae27f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:03.603083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa974782-47f0-4ef2-8405-0bca65ae27f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.603359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa974782-47f0-4ef2-8405-0bca65ae27f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.603628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa974782-47f0-4ef2-8405-0bca65ae27f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.604266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa974782-47f0-4ef2-8405-0bca65ae27f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:03.606459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa974782-47f0-4ef2-8405-0bca65ae27f2 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:03.632686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1286/2546] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:37:03 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:03.636756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb8293-a5a3-4e97-8237-964bedf91de5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:03.647877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb8293-a5a3-4e97-8237-964bedf91de5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:03.704348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd20f42-0976-404a-be3d-f4bd8e213b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:03.704958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd20f42-0976-404a-be3d-f4bd8e213b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.705242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd20f42-0976-404a-be3d-f4bd8e213b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.705519 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd20f42-0976-404a-be3d-f4bd8e213b67 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.706147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd20f42-0976-404a-be3d-f4bd8e213b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:03.708133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd20f42-0976-404a-be3d-f4bd8e213b67 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:03.730621 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1261/2547] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:37:03 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:03.734787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa974782-47f0-4ef2-8405-0bca65ae27f2 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:03.745573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa974782-47f0-4ef2-8405-0bca65ae27f2 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:03.750369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c9bb2-ffdd-401b-92ae-63d5cba7d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:03.751070 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c9bb2-ffdd-401b-92ae-63d5cba7d75b admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.751378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c9bb2-ffdd-401b-92ae-63d5cba7d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.751651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c9bb2-ffdd-401b-92ae-63d5cba7d75b admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.752288 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c9bb2-ffdd-401b-92ae-63d5cba7d75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:03.753887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c9bb2-ffdd-401b-92ae-63d5cba7d75b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:03.764508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1287/2548] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:03.768546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd20f42-0976-404a-be3d-f4bd8e213b67 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:03.779235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd20f42-0976-404a-be3d-f4bd8e213b67 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:03.783840 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2f60c-b029-4727-88ec-c779a719df3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:03.784439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2f60c-b029-4727-88ec-c779a719df3f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.784719 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2f60c-b029-4727-88ec-c779a719df3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.784994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2f60c-b029-4727-88ec-c779a719df3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.785638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2f60c-b029-4727-88ec-c779a719df3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:03.788030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2f60c-b029-4727-88ec-c779a719df3f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:03.798160 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1262/2549] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:03.802308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c9bb2-ffdd-401b-92ae-63d5cba7d75b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:03.812482 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c9bb2-ffdd-401b-92ae-63d5cba7d75b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:03.816967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb12bfb-d63d-4f2e-9399-042a618337ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:03.817598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb12bfb-d63d-4f2e-9399-042a618337ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.817935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb12bfb-d63d-4f2e-9399-042a618337ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.818443 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb12bfb-d63d-4f2e-9399-042a618337ba admin admin] PATH_INFO: `/v3/projects/ac4c7baef4f248079ff1c3fc6197a20d/users/4dba2f61e4a34916b4ab879906a42234/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.832498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb12bfb-d63d-4f2e-9399-042a618337ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4c7baef4f248079ff1c3fc6197a20d, user_id=4dba2f61e4a34916b4ab879906a42234, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:03.836002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb12bfb-d63d-4f2e-9399-042a618337ba admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:03.848691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1288/2550] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:37:03 2022] PUT /identity/v3/projects/ac4c7baef4f248079ff1c3fc6197a20d/users/4dba2f61e4a34916b4ab879906a42234/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:03.859530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e9248-bd8f-4fd5-ab7c-14df264814d8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:03.859764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e9248-bd8f-4fd5-ab7c-14df264814d8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:03.860069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e9248-bd8f-4fd5-ab7c-14df264814d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:03.889480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-eb6e9248-bd8f-4fd5-ab7c-14df264814d8 None None] MFA Rules not processed for user `4dba2f61e4a34916b4ab879906a42234`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:03.890775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-eb6e9248-bd8f-4fd5-ab7c-14df264814d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:03.955440 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1263/2551] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:03.960733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb12bfb-d63d-4f2e-9399-042a618337ba admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:04.021833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb12bfb-d63d-4f2e-9399-042a618337ba admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:04.026540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce0847-7dce-4979-af0f-a4ed9b025c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:04.027139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce0847-7dce-4979-af0f-a4ed9b025c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:04.027448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce0847-7dce-4979-af0f-a4ed9b025c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:04.027720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce0847-7dce-4979-af0f-a4ed9b025c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:04.028346 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce0847-7dce-4979-af0f-a4ed9b025c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:04.030259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce0847-7dce-4979-af0f-a4ed9b025c1a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:04.056377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1289/2552] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:37:03 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:04.060416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e9248-bd8f-4fd5-ab7c-14df264814d8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:04.066013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:04.073224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e9248-bd8f-4fd5-ab7c-14df264814d8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:04.128434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f1775-d5bf-43e6-a822-c65428cad1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:04.129055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f1775-d5bf-43e6-a822-c65428cad1fe admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:04.129228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f1775-d5bf-43e6-a822-c65428cad1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:04.129502 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f1775-d5bf-43e6-a822-c65428cad1fe admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:04.130134 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f1775-d5bf-43e6-a822-c65428cad1fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:04.132713 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f1775-d5bf-43e6-a822-c65428cad1fe admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:04.154677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1264/2553] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:37:04 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:04.158807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce0847-7dce-4979-af0f-a4ed9b025c1a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:04.169864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce0847-7dce-4979-af0f-a4ed9b025c1a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:04.174493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1132bf-9976-45e5-9dfe-d9c47914a7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:04.175107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1132bf-9976-45e5-9dfe-d9c47914a7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:04.175387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1132bf-9976-45e5-9dfe-d9c47914a7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:04.175658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1132bf-9976-45e5-9dfe-d9c47914a7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:04.176287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1132bf-9976-45e5-9dfe-d9c47914a7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:04.178207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1132bf-9976-45e5-9dfe-d9c47914a7e6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:04.188594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1290/2554] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:04.193480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f1775-d5bf-43e6-a822-c65428cad1fe admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:04.203248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f1775-d5bf-43e6-a822-c65428cad1fe admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:04.207847 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3690bf-8917-4cec-b001-e5dbf766dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:04.209031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3690bf-8917-4cec-b001-e5dbf766dd16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:04.209315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3690bf-8917-4cec-b001-e5dbf766dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:04.209666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3690bf-8917-4cec-b001-e5dbf766dd16 admin admin] PATH_INFO: `/v3/projects/df7d300f60ce498b8f6ed2d33cb27604/users/8f1c6b9a1702459f8e0f169a5edf5a7b/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:04.223913 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3690bf-8917-4cec-b001-e5dbf766dd16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7d300f60ce498b8f6ed2d33cb27604, user_id=8f1c6b9a1702459f8e0f169a5edf5a7b, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:04.226806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3690bf-8917-4cec-b001-e5dbf766dd16 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:04.239123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1265/2555] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:37:04 2022] PUT /identity/v3/projects/df7d300f60ce498b8f6ed2d33cb27604/users/8f1c6b9a1702459f8e0f169a5edf5a7b/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:04.243102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1132bf-9976-45e5-9dfe-d9c47914a7e6 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:04.252935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1132bf-9976-45e5-9dfe-d9c47914a7e6 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:04.309120 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e9645-85a3-431d-8ab8-39e1bde22b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:04.309716 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e9645-85a3-431d-8ab8-39e1bde22b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:04.309989 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e9645-85a3-431d-8ab8-39e1bde22b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:04.310254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e9645-85a3-431d-8ab8-39e1bde22b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:04.310916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e9645-85a3-431d-8ab8-39e1bde22b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:04.312486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e9645-85a3-431d-8ab8-39e1bde22b9a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:04.323357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1291/2556] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:04.327548 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3690bf-8917-4cec-b001-e5dbf766dd16 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:04.337762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3690bf-8917-4cec-b001-e5dbf766dd16 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:04.342320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c555b5-a5e9-4b4d-9221-2370efd0df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:04.343022 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c555b5-a5e9-4b4d-9221-2370efd0df62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:04.343300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c555b5-a5e9-4b4d-9221-2370efd0df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:04.343572 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c555b5-a5e9-4b4d-9221-2370efd0df62 admin admin] PATH_INFO: `/v3/projects/df7d300f60ce498b8f6ed2d33cb27604/users/8f1c6b9a1702459f8e0f169a5edf5a7b/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:04.345465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c555b5-a5e9-4b4d-9221-2370efd0df62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7d300f60ce498b8f6ed2d33cb27604, user_id=8f1c6b9a1702459f8e0f169a5edf5a7b, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:04.348129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c555b5-a5e9-4b4d-9221-2370efd0df62 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:04.358487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1266/2557] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:37:04 2022] PUT /identity/v3/projects/df7d300f60ce498b8f6ed2d33cb27604/users/8f1c6b9a1702459f8e0f169a5edf5a7b/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:37:04.369215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c7ac-4157-4ec2-978d-08a5415aaf17 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:04.369501 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c7ac-4157-4ec2-978d-08a5415aaf17 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:04.369775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c7ac-4157-4ec2-978d-08a5415aaf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:04.385335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:04.401035 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-0cd4c7ac-4157-4ec2-978d-08a5415aaf17 None None] MFA Rules not processed for user `8f1c6b9a1702459f8e0f169a5edf5a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:04.402254 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0cd4c7ac-4157-4ec2-978d-08a5415aaf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:04.469358 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1292/2558] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:37:04.481259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c555b5-a5e9-4b4d-9221-2370efd0df62 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:04.482982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f7c555b5-a5e9-4b4d-9221-2370efd0df62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:04.539835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c555b5-a5e9-4b4d-9221-2370efd0df62 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:04.543483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868d326-b98f-4b82-984e-69a09b744580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:04.544082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868d326-b98f-4b82-984e-69a09b744580 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:04.544359 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868d326-b98f-4b82-984e-69a09b744580 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:04.544633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868d326-b98f-4b82-984e-69a09b744580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:04.600260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868d326-b98f-4b82-984e-69a09b744580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:04.601704 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868d326-b98f-4b82-984e-69a09b744580 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:04.610530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1267/2559] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:06.113612 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c7ac-4157-4ec2-978d-08a5415aaf17 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:06.115736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0cd4c7ac-4157-4ec2-978d-08a5415aaf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:06.127718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c7ac-4157-4ec2-978d-08a5415aaf17 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:06.132235 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842bcdb-bc9c-4bd4-aace-20c2f4515263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:06.132880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842bcdb-bc9c-4bd4-aace-20c2f4515263 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:06.133160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842bcdb-bc9c-4bd4-aace-20c2f4515263 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:06.133430 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842bcdb-bc9c-4bd4-aace-20c2f4515263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:06.189710 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842bcdb-bc9c-4bd4-aace-20c2f4515263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:06.191103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842bcdb-bc9c-4bd4-aace-20c2f4515263 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:06.200680 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1293/2560] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:06.726335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868d326-b98f-4b82-984e-69a09b744580 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:06.734774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868d326-b98f-4b82-984e-69a09b744580 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:06.738298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651a7dc-743f-4598-ac65-6dbf0329892f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:06.738917 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651a7dc-743f-4598-ac65-6dbf0329892f service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:06.739194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651a7dc-743f-4598-ac65-6dbf0329892f service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:06.739525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651a7dc-743f-4598-ac65-6dbf0329892f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:06.746195 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:06.748856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651a7dc-743f-4598-ac65-6dbf0329892f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:06.750632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651a7dc-743f-4598-ac65-6dbf0329892f service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:06.761058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1268/2561] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:08.680816 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842bcdb-bc9c-4bd4-aace-20c2f4515263 service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:08.682177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d842bcdb-bc9c-4bd4-aace-20c2f4515263 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:08.739298 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842bcdb-bc9c-4bd4-aace-20c2f4515263 service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:08.743819 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb32f3c-9b43-4068-889e-a1ec681644bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:08.744428 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb32f3c-9b43-4068-889e-a1ec681644bd service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:08.744705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb32f3c-9b43-4068-889e-a1ec681644bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:08.744990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb32f3c-9b43-4068-889e-a1ec681644bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:08.747118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9fb32f3c-9b43-4068-889e-a1ec681644bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:08.794067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=100 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:08.808794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb32f3c-9b43-4068-889e-a1ec681644bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:08.810223 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb32f3c-9b43-4068-889e-a1ec681644bd service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:08.819429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1294/2562] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:10.656442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651a7dc-743f-4598-ac65-6dbf0329892f service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:10.721656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651a7dc-743f-4598-ac65-6dbf0329892f service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:10.726754 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:10.727396 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:10.727669 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:10.727937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] PATH_INFO: `/v3/users/a82a304a6eb24b0db6235b5608c07f1d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:10.729023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82a304a6eb24b0db6235b5608c07f1d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:10.730991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:10.776358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82a304a6eb24b0db6235b5608c07f1d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:10.783590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82a304a6eb24b0db6235b5608c07f1d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:10.797375 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82a304a6eb24b0db6235b5608c07f1d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:10.798048 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82a304a6eb24b0db6235b5608c07f1d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:10.798679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82a304a6eb24b0db6235b5608c07f1d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:10.812255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1269/2563] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:37:10 2022] DELETE /identity/v3/users/a82a304a6eb24b0db6235b5608c07f1d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:10.816843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3913c-a70a-40f2-bdd9-9f8a3e93f636 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:10.817296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3913c-a70a-40f2-bdd9-9f8a3e93f636 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:10.817458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3913c-a70a-40f2-bdd9-9f8a3e93f636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:10.837077 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-08b3913c-a70a-40f2-bdd9-9f8a3e93f636 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:10.838206 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-08b3913c-a70a-40f2-bdd9-9f8a3e93f636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:10.897325 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1295/2564] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:10.906993 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:10.908383 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:10.967021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265602f-ac43-4c5c-b4d7-15def4f1e408 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:10.970642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa15fb-8b83-40eb-a588-38f4ce923cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:10.971245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa15fb-8b83-40eb-a588-38f4ce923cbb service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:10.971521 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa15fb-8b83-40eb-a588-38f4ce923cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:10.971792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa15fb-8b83-40eb-a588-38f4ce923cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:10.980984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa15fb-8b83-40eb-a588-38f4ce923cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:10.982439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa15fb-8b83-40eb-a588-38f4ce923cbb service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:10.991882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1270/2565] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:11.268875 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3913c-a70a-40f2-bdd9-9f8a3e93f636 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:11.270332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-08b3913c-a70a-40f2-bdd9-9f8a3e93f636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:11.294699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3913c-a70a-40f2-bdd9-9f8a3e93f636 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:11.300113 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:11.300841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:11.301188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:11.301547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] PATH_INFO: `/v3/projects/17deb9580671470fa6b19ea28972fdad` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:11.306626 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=17deb9580671470fa6b19ea28972fdad)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:11.308647 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:11.357308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17deb9580671470fa6b19ea28972fdad', 'request_id': 'req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.363756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17deb9580671470fa6b19ea28972fdad', 'request_id': 'req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.369533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17deb9580671470fa6b19ea28972fdad', 'request_id': 'req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.384651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] The token cache is being invalidate because project 17deb9580671470fa6b19ea28972fdad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:37:11.384945 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.385599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.387555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1296/2566] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:37:11 2022] DELETE /identity/v3/projects/17deb9580671470fa6b19ea28972fdad => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:11.391457 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa15fb-8b83-40eb-a588-38f4ce923cbb service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:11.401839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa15fb-8b83-40eb-a588-38f4ce923cbb service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:11.415505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:11.472609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:11.473301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:11.473577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:11.473854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] PATH_INFO: `/v3/users/4dba2f61e4a34916b4ab879906a42234` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:11.475163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dba2f61e4a34916b4ab879906a42234)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:11.477122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:11.525331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dba2f61e4a34916b4ab879906a42234'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.532197 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dba2f61e4a34916b4ab879906a42234'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.544810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dba2f61e4a34916b4ab879906a42234'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.545470 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dba2f61e4a34916b4ab879906a42234'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.546072 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dba2f61e4a34916b4ab879906a42234'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.559002 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1271/2567] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:37:11 2022] DELETE /identity/v3/users/4dba2f61e4a34916b4ab879906a42234 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:11.836477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:11.837912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:11.852785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b48f7f-1ecb-463f-a77f-ec79eebe9b2d admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:11.912591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:11.913130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:11.913409 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:11.913679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] PATH_INFO: `/v3/projects/ac4c7baef4f248079ff1c3fc6197a20d` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:11.915076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4c7baef4f248079ff1c3fc6197a20d)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:11.916981 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:11.928900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:11.970007 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4c7baef4f248079ff1c3fc6197a20d', 'request_id': 'req-d0282334-9991-4454-8a8c-95f197080691'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.976854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4c7baef4f248079ff1c3fc6197a20d', 'request_id': 'req-d0282334-9991-4454-8a8c-95f197080691'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.984471 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4c7baef4f248079ff1c3fc6197a20d', 'request_id': 'req-d0282334-9991-4454-8a8c-95f197080691'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:11.999028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] The token cache is being invalidate because project ac4c7baef4f248079ff1c3fc6197a20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:37:11.999318 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:12.000012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:12.001922 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1297/2568] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:37:11 2022] DELETE /identity/v3/projects/ac4c7baef4f248079ff1c3fc6197a20d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:12.005692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:12.007133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:12.019602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e9db-a11e-41a7-af7e-9b2758d687c4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:12.078280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e5614-7163-494a-89c9-2924fe2bbc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:12.078942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e5614-7163-494a-89c9-2924fe2bbc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:12.079224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e5614-7163-494a-89c9-2924fe2bbc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:12.079495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e5614-7163-494a-89c9-2924fe2bbc2d admin admin] PATH_INFO: `/v3/users/8f1c6b9a1702459f8e0f169a5edf5a7b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:12.080617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e5614-7163-494a-89c9-2924fe2bbc2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1c6b9a1702459f8e0f169a5edf5a7b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:12.082596 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e5614-7163-494a-89c9-2924fe2bbc2d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:12.125036 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:12.133408 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4a5e5614-7163-494a-89c9-2924fe2bbc2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1c6b9a1702459f8e0f169a5edf5a7b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:12.141146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4a5e5614-7163-494a-89c9-2924fe2bbc2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1c6b9a1702459f8e0f169a5edf5a7b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:12.155220 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4a5e5614-7163-494a-89c9-2924fe2bbc2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1c6b9a1702459f8e0f169a5edf5a7b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:12.155949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4a5e5614-7163-494a-89c9-2924fe2bbc2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1c6b9a1702459f8e0f169a5edf5a7b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:12.156691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4a5e5614-7163-494a-89c9-2924fe2bbc2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1c6b9a1702459f8e0f169a5edf5a7b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:12.171098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1272/2569] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:37:12 2022] DELETE /identity/v3/users/8f1c6b9a1702459f8e0f169a5edf5a7b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:37:12.475199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:12.476704 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:12.491196 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0282334-9991-4454-8a8c-95f197080691 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:12.553609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:12.554245 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:12.554591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:12.554871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0 admin admin] PATH_INFO: `/v3/projects/df7d300f60ce498b8f6ed2d33cb27604` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:12.556041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7d300f60ce498b8f6ed2d33cb27604)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:12.557957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:12.606711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7d300f60ce498b8f6ed2d33cb27604', 'request_id': 'req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:12.613978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7d300f60ce498b8f6ed2d33cb27604', 'request_id': 'req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:12.620510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7d300f60ce498b8f6ed2d33cb27604', 'request_id': 'req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:12.634263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0 admin admin] The token cache is being invalidate because project df7d300f60ce498b8f6ed2d33cb27604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:37:12.634613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:12.635324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-d9ce994e-1f7a-49f1-9964-2e52a00f85b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:12.636851 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1298/2570] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:37:12 2022] DELETE /identity/v3/projects/df7d300f60ce498b8f6ed2d33cb27604 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:12.641629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5521b-d695-4b99-b54d-0c2c0946e5f4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:12.641993 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5521b-d695-4b99-b54d-0c2c0946e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:12.642303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5521b-d695-4b99-b54d-0c2c0946e5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:12.664443 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-18c5521b-d695-4b99-b54d-0c2c0946e5f4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:12.665673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-18c5521b-d695-4b99-b54d-0c2c0946e5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:12.735485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1273/2571] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:12.744731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6169f-3b92-44c8-aff7-8ad27c74d10b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:12.745012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6169f-3b92-44c8-aff7-8ad27c74d10b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:12.745282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6169f-3b92-44c8-aff7-8ad27c74d10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:12.771266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c5e6169f-3b92-44c8-aff7-8ad27c74d10b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:12.772735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c5e6169f-3b92-44c8-aff7-8ad27c74d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:12.781393 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1299/2572] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:12.786216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5521b-d695-4b99-b54d-0c2c0946e5f4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:12.797565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5521b-d695-4b99-b54d-0c2c0946e5f4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:12.804642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f6540-de4e-4763-8733-2512a446ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:12.805452 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6540-de4e-4763-8733-2512a446ccd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:12.805877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6540-de4e-4763-8733-2512a446ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:12.806242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6540-de4e-4763-8733-2512a446ccd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:12.806839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f6540-de4e-4763-8733-2512a446ccd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:37:12.807139 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f6540-de4e-4763-8733-2512a446ccd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:12.809969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f6540-de4e-4763-8733-2512a446ccd8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:12.828376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1274/2573] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:12.833657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6169f-3b92-44c8-aff7-8ad27c74d10b None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:12.846003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6169f-3b92-44c8-aff7-8ad27c74d10b None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:12.853047 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a444f-c55e-4cb1-9168-c1fa6d460bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:12.853659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a444f-c55e-4cb1-9168-c1fa6d460bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:12.853877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f6540-de4e-4763-8733-2512a446ccd8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:12.853989 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a444f-c55e-4cb1-9168-c1fa6d460bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:12.854224 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a444f-c55e-4cb1-9168-c1fa6d460bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:12.854892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a444f-c55e-4cb1-9168-c1fa6d460bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:12.856423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-193f6540-de4e-4763-8733-2512a446ccd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:12.857134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a444f-c55e-4cb1-9168-c1fa6d460bd7 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:12.880034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:12.888150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1300/2574] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:37:12 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:12.892300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a444f-c55e-4cb1-9168-c1fa6d460bd7 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:12.962303 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a444f-c55e-4cb1-9168-c1fa6d460bd7 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:12.965171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f6540-de4e-4763-8733-2512a446ccd8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:12.967142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed13216-2d1f-4d9c-9388-a2ec907f05a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:12.967750 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed13216-2d1f-4d9c-9388-a2ec907f05a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:12.968027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed13216-2d1f-4d9c-9388-a2ec907f05a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:12.968299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed13216-2d1f-4d9c-9388-a2ec907f05a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:12.968920 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed13216-2d1f-4d9c-9388-a2ec907f05a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:12.970885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed13216-2d1f-4d9c-9388-a2ec907f05a9 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:12.990998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:12.997659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1301/2575] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:37:12 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:37:13.001634 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed13216-2d1f-4d9c-9388-a2ec907f05a9 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:13.012465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed13216-2d1f-4d9c-9388-a2ec907f05a9 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:13.017275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411bd9-da5b-4d60-9007-6e1b66fd74ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:13.017865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411bd9-da5b-4d60-9007-6e1b66fd74ec admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:13.018143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411bd9-da5b-4d60-9007-6e1b66fd74ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:13.018440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411bd9-da5b-4d60-9007-6e1b66fd74ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:13.019107 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68411bd9-da5b-4d60-9007-6e1b66fd74ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:13.021273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68411bd9-da5b-4d60-9007-6e1b66fd74ec admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:13.031544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1302/2576] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:37:13.032885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651a30-431c-4263-9ae3-9e904a41546a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '559a4af215324597b203e6866cb51fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:13.033500 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651a30-431c-4263-9ae3-9e904a41546a service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:13.033781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651a30-431c-4263-9ae3-9e904a41546a service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:13.034055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651a30-431c-4263-9ae3-9e904a41546a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:13.035349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411bd9-da5b-4d60-9007-6e1b66fd74ec admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:13.035944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ef651a30-431c-4263-9ae3-9e904a41546a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:13.045638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411bd9-da5b-4d60-9007-6e1b66fd74ec admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:13.048515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef651a30-431c-4263-9ae3-9e904a41546a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:13.050142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef651a30-431c-4263-9ae3-9e904a41546a service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:13.050267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69384a-21df-4676-bacf-11b077b29d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:13.050813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69384a-21df-4676-bacf-11b077b29d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:13.051094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69384a-21df-4676-bacf-11b077b29d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:13.051367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69384a-21df-4676-bacf-11b077b29d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:13.052060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69384a-21df-4676-bacf-11b077b29d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:13.053838 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69384a-21df-4676-bacf-11b077b29d1b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:13.060498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1275/2577] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:37:13.065118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1303/2578] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:37:13.069518 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651a30-431c-4263-9ae3-9e904a41546a service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:13.080020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651a30-431c-4263-9ae3-9e904a41546a service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:13.085894 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fa610-ffa2-4e5f-8f85-4be96c81720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:13.086603 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fa610-ffa2-4e5f-8f85-4be96c81720b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:13.086881 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fa610-ffa2-4e5f-8f85-4be96c81720b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:13.087155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fa610-ffa2-4e5f-8f85-4be96c81720b admin admin] PATH_INFO: `/v3/projects/f499e0610b0443c892b7127267aaa35c/users/c777b579c06f4b24848f59d4582d3aed/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:13.103487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fa610-ffa2-4e5f-8f85-4be96c81720b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f499e0610b0443c892b7127267aaa35c, user_id=c777b579c06f4b24848f59d4582d3aed, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:13.106200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fa610-ffa2-4e5f-8f85-4be96c81720b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:13.121788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1276/2579] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:37:13 2022] PUT /identity/v3/projects/f499e0610b0443c892b7127267aaa35c/users/c777b579c06f4b24848f59d4582d3aed/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:13.126919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badf5b0-dcc9-42e1-b54a-ed6d6ced5798 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:13.127228 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badf5b0-dcc9-42e1-b54a-ed6d6ced5798 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:13.127497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badf5b0-dcc9-42e1-b54a-ed6d6ced5798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:13.149377 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-8badf5b0-dcc9-42e1-b54a-ed6d6ced5798 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:13.150642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8badf5b0-dcc9-42e1-b54a-ed6d6ced5798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:13.334966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1304/2580] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:13.344428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fa610-ffa2-4e5f-8f85-4be96c81720b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:13.346155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c71fa610-ffa2-4e5f-8f85-4be96c81720b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:13.406830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fa610-ffa2-4e5f-8f85-4be96c81720b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:13.410367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130b94d-4747-491f-a925-cd313c0920ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:13.411005 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130b94d-4747-491f-a925-cd313c0920ac service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:13.411417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130b94d-4747-491f-a925-cd313c0920ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:13.411697 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130b94d-4747-491f-a925-cd313c0920ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:13.421388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130b94d-4747-491f-a925-cd313c0920ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:13.422872 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130b94d-4747-491f-a925-cd313c0920ac service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:13.433096 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1277/2581] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:14.070055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6bc4a-2d6b-4072-82f8-a730efacb94c None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:14.070613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6bc4a-2d6b-4072-82f8-a730efacb94c None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:14.070712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6bc4a-2d6b-4072-82f8-a730efacb94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:14.101623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-56d6bc4a-2d6b-4072-82f8-a730efacb94c None None] MFA Rules not processed for user `c777b579c06f4b24848f59d4582d3aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:14.102892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-56d6bc4a-2d6b-4072-82f8-a730efacb94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:14.168518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:14.175259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1305/2582] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:14.187004 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130b94d-4747-491f-a925-cd313c0920ac service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:14.189146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0130b94d-4747-491f-a925-cd313c0920ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:14.247689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130b94d-4747-491f-a925-cd313c0920ac service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:14.251333 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d363f3-e4b9-44ad-9a0d-51222fc73b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:14.251942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d363f3-e4b9-44ad-9a0d-51222fc73b09 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:14.252219 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d363f3-e4b9-44ad-9a0d-51222fc73b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:14.252487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d363f3-e4b9-44ad-9a0d-51222fc73b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:14.261767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d363f3-e4b9-44ad-9a0d-51222fc73b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:14.263245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d363f3-e4b9-44ad-9a0d-51222fc73b09 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:14.272371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1278/2583] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:14.764126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6bc4a-2d6b-4072-82f8-a730efacb94c None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:14.765508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-56d6bc4a-2d6b-4072-82f8-a730efacb94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:14.777780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6bc4a-2d6b-4072-82f8-a730efacb94c None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:14.781231 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ab570-605e-4b5e-b6bb-2a9243b66e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:14.781820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ab570-605e-4b5e-b6bb-2a9243b66e63 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:14.782091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ab570-605e-4b5e-b6bb-2a9243b66e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:14.782908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ab570-605e-4b5e-b6bb-2a9243b66e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:14.784204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3b5ab570-605e-4b5e-b6bb-2a9243b66e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:14.796075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ab570-605e-4b5e-b6bb-2a9243b66e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:14.797486 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ab570-605e-4b5e-b6bb-2a9243b66e63 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:14.807397 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1306/2584] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:15.648297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322988fb-de41-4e8c-89cd-04ddf912473c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:15.648841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322988fb-de41-4e8c-89cd-04ddf912473c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:15.648945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322988fb-de41-4e8c-89cd-04ddf912473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:15.681041 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-322988fb-de41-4e8c-89cd-04ddf912473c None None] MFA Rules not processed for user `c777b579c06f4b24848f59d4582d3aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:15.682279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-322988fb-de41-4e8c-89cd-04ddf912473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:15.690423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1279/2585] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:22.863618 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ab570-605e-4b5e-b6bb-2a9243b66e63 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:22.865244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3b5ab570-605e-4b5e-b6bb-2a9243b66e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:22.877653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ab570-605e-4b5e-b6bb-2a9243b66e63 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:22.883091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:22.883876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:22.884159 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:22.884556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] PATH_INFO: `/v3/users/f49fa74ba8b649eb871da0b154840751` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:22.885681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49fa74ba8b649eb871da0b154840751)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:22.887620 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:22.944124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49fa74ba8b649eb871da0b154840751'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:22.951104 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49fa74ba8b649eb871da0b154840751'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:22.964083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49fa74ba8b649eb871da0b154840751'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:22.964811 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49fa74ba8b649eb871da0b154840751'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:22.965585 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49fa74ba8b649eb871da0b154840751'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:22.983694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1307/2586] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:37:22 2022] DELETE /identity/v3/users/f49fa74ba8b649eb871da0b154840751 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:23.154475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322988fb-de41-4e8c-89cd-04ddf912473c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:23.167623 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322988fb-de41-4e8c-89cd-04ddf912473c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:23.199271 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:23.228138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:23.228764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:23.229040 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:23.229390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] PATH_INFO: `/v3/projects/392a921f7bbf45a19e84b60938250a4c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:23.230587 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] RBAC: Authorizing `identity:delete_project(project_id=392a921f7bbf45a19e84b60938250a4c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:23.232517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:23.279091 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '392a921f7bbf45a19e84b60938250a4c', 'request_id': 'req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.286335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '392a921f7bbf45a19e84b60938250a4c', 'request_id': 'req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.292906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '392a921f7bbf45a19e84b60938250a4c', 'request_id': 'req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.304294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] The token cache is being invalidate because project 392a921f7bbf45a19e84b60938250a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:37:23.304664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.305288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.306792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1280/2587] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:37:23 2022] DELETE /identity/v3/projects/392a921f7bbf45a19e84b60938250a4c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:23.310867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:23.312230 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:23.326014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596a65e-6b01-4318-a555-596ccbe16505 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:23.391191 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860571fe-efd1-4703-a30f-44783464a09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:23.391824 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860571fe-efd1-4703-a30f-44783464a09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:23.392100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860571fe-efd1-4703-a30f-44783464a09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:23.392399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860571fe-efd1-4703-a30f-44783464a09d admin admin] PATH_INFO: `/v3/users/a20d7700bd124f1e849987786d756fea` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:23.393508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860571fe-efd1-4703-a30f-44783464a09d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20d7700bd124f1e849987786d756fea)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:23.395836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860571fe-efd1-4703-a30f-44783464a09d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:23.441566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-860571fe-efd1-4703-a30f-44783464a09d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20d7700bd124f1e849987786d756fea'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.448779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-860571fe-efd1-4703-a30f-44783464a09d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20d7700bd124f1e849987786d756fea'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.450611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:23.462123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-860571fe-efd1-4703-a30f-44783464a09d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20d7700bd124f1e849987786d756fea'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.462839 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-860571fe-efd1-4703-a30f-44783464a09d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20d7700bd124f1e849987786d756fea'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.463448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-860571fe-efd1-4703-a30f-44783464a09d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20d7700bd124f1e849987786d756fea'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.476553 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1308/2588] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:37:23 2022] DELETE /identity/v3/users/a20d7700bd124f1e849987786d756fea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:23.646483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:23.647964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:23.661994 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8a1eb-e981-48ce-8b35-8ef34b39e48b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:23.720656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:23.721294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:23.721577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:23.721854 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] PATH_INFO: `/v3/projects/7238992108d14f18b392cee049a3e092` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:23.722991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7238992108d14f18b392cee049a3e092)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:23.724991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:23.771028 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7238992108d14f18b392cee049a3e092', 'request_id': 'req-f08344e1-ab3c-419e-85f9-b118f60c63eb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.779589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7238992108d14f18b392cee049a3e092', 'request_id': 'req-f08344e1-ab3c-419e-85f9-b118f60c63eb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.786667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7238992108d14f18b392cee049a3e092', 'request_id': 'req-f08344e1-ab3c-419e-85f9-b118f60c63eb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.788675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:23.800334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] The token cache is being invalidate because project 7238992108d14f18b392cee049a3e092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:37:23.800808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.802522 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:23.804234 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1281/2589] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:37:23 2022] DELETE /identity/v3/projects/7238992108d14f18b392cee049a3e092 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:32.947857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee296cd1-3569-4828-8d84-68799b807570 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:32.948345 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee296cd1-3569-4828-8d84-68799b807570 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:32.948449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee296cd1-3569-4828-8d84-68799b807570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:32.967941 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-ee296cd1-3569-4828-8d84-68799b807570 None None] MFA Rules not processed for user `c777b579c06f4b24848f59d4582d3aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:32.969170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ee296cd1-3569-4828-8d84-68799b807570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:33.024333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1309/2590] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:33.805291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:41.314366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:41.315856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:41.372985 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08344e1-ab3c-419e-85f9-b118f60c63eb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:41.376599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaced4-51bc-4e50-b6ee-ec4f324b2b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:41.377206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaced4-51bc-4e50-b6ee-ec4f324b2b37 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:41.377511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaced4-51bc-4e50-b6ee-ec4f324b2b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:41.377782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaced4-51bc-4e50-b6ee-ec4f324b2b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:41.380402 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5bbaced4-51bc-4e50-b6ee-ec4f324b2b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:41.449300 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaced4-51bc-4e50-b6ee-ec4f324b2b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:41.450822 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaced4-51bc-4e50-b6ee-ec4f324b2b37 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:41.466271 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1282/2591] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:43.016993 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=32,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:44.861544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee296cd1-3569-4828-8d84-68799b807570 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:44.863138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-ee296cd1-3569-4828-8d84-68799b807570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:44.877674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee296cd1-3569-4828-8d84-68799b807570 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:44.882776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eca91f-5396-4830-8cf7-2219e42c7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:44.883503 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eca91f-5396-4830-8cf7-2219e42c7132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:44.883784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eca91f-5396-4830-8cf7-2219e42c7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:44.884054 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eca91f-5396-4830-8cf7-2219e42c7132 admin admin] PATH_INFO: `/v3/users/a0ada49dfcb54b2b8e551e9d89f831a5` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:44.885161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eca91f-5396-4830-8cf7-2219e42c7132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ada49dfcb54b2b8e551e9d89f831a5)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:44.887131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eca91f-5396-4830-8cf7-2219e42c7132 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:44.939858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f6eca91f-5396-4830-8cf7-2219e42c7132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ada49dfcb54b2b8e551e9d89f831a5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:44.948995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f6eca91f-5396-4830-8cf7-2219e42c7132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ada49dfcb54b2b8e551e9d89f831a5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:44.962144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f6eca91f-5396-4830-8cf7-2219e42c7132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ada49dfcb54b2b8e551e9d89f831a5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:44.962940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f6eca91f-5396-4830-8cf7-2219e42c7132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ada49dfcb54b2b8e551e9d89f831a5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:44.963560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-f6eca91f-5396-4830-8cf7-2219e42c7132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ada49dfcb54b2b8e551e9d89f831a5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:44.981527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1310/2592] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:37:44 2022] DELETE /identity/v3/users/a0ada49dfcb54b2b8e551e9d89f831a5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:45.155368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaced4-51bc-4e50-b6ee-ec4f324b2b37 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:45.167011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaced4-51bc-4e50-b6ee-ec4f324b2b37 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:45.223316 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabce0e-9baf-48ec-bb48-a46e7a642551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:45.224113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabce0e-9baf-48ec-bb48-a46e7a642551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.224393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabce0e-9baf-48ec-bb48-a46e7a642551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.224677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabce0e-9baf-48ec-bb48-a46e7a642551 admin admin] PATH_INFO: `/v3/projects/0a7bb92613294fcfb5deeb741baad1f0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.225792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabce0e-9baf-48ec-bb48-a46e7a642551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a7bb92613294fcfb5deeb741baad1f0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:45.227777 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabce0e-9baf-48ec-bb48-a46e7a642551 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:45.274266 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ecabce0e-9baf-48ec-bb48-a46e7a642551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7bb92613294fcfb5deeb741baad1f0', 'request_id': 'req-ecabce0e-9baf-48ec-bb48-a46e7a642551'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:45.276749 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:45.281510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ecabce0e-9baf-48ec-bb48-a46e7a642551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7bb92613294fcfb5deeb741baad1f0', 'request_id': 'req-ecabce0e-9baf-48ec-bb48-a46e7a642551'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:45.289843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ecabce0e-9baf-48ec-bb48-a46e7a642551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7bb92613294fcfb5deeb741baad1f0', 'request_id': 'req-ecabce0e-9baf-48ec-bb48-a46e7a642551'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:45.300141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ecabce0e-9baf-48ec-bb48-a46e7a642551 admin admin] The token cache is being invalidate because project 0a7bb92613294fcfb5deeb741baad1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:37:45.300419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ecabce0e-9baf-48ec-bb48-a46e7a642551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:45.301706 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ecabce0e-9baf-48ec-bb48-a46e7a642551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:45.303305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1283/2593] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:37:45 2022] DELETE /identity/v3/projects/0a7bb92613294fcfb5deeb741baad1f0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:45.308312 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c8831-79d6-4f77-a28a-9fda046be915 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.308600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c8831-79d6-4f77-a28a-9fda046be915 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.308870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c8831-79d6-4f77-a28a-9fda046be915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.329551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-953c8831-79d6-4f77-a28a-9fda046be915 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:45.330944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-953c8831-79d6-4f77-a28a-9fda046be915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:45.392304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1311/2594] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:45.400757 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725aac1-ff17-491f-8ae4-953338f9ab9f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.401045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725aac1-ff17-491f-8ae4-953338f9ab9f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.401320 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725aac1-ff17-491f-8ae4-953338f9ab9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.421640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5725aac1-ff17-491f-8ae4-953338f9ab9f None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:45.423159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5725aac1-ff17-491f-8ae4-953338f9ab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:45.431799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1284/2595] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:45.436012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c8831-79d6-4f77-a28a-9fda046be915 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:45.445991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c8831-79d6-4f77-a28a-9fda046be915 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:45.450469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41330d-a6e4-43f2-a8df-8f3d24db8139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:45.451145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41330d-a6e4-43f2-a8df-8f3d24db8139 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.451330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41330d-a6e4-43f2-a8df-8f3d24db8139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.451629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41330d-a6e4-43f2-a8df-8f3d24db8139 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.452265 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41330d-a6e4-43f2-a8df-8f3d24db8139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:37:45.452562 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41330d-a6e4-43f2-a8df-8f3d24db8139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:45.454135 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41330d-a6e4-43f2-a8df-8f3d24db8139 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:45.465711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1312/2596] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:45.469911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725aac1-ff17-491f-8ae4-953338f9ab9f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:45.479632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725aac1-ff17-491f-8ae4-953338f9ab9f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:45.484240 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3c6d5-8ce9-4ced-a3e9-12df474f687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:45.484831 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3c6d5-8ce9-4ced-a3e9-12df474f687c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.485109 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3c6d5-8ce9-4ced-a3e9-12df474f687c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.485382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3c6d5-8ce9-4ced-a3e9-12df474f687c admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.486034 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3c6d5-8ce9-4ced-a3e9-12df474f687c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:45.488016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3c6d5-8ce9-4ced-a3e9-12df474f687c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:45.515544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1285/2597] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:37:45 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:45.520413 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41330d-a6e4-43f2-a8df-8f3d24db8139 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:45.530602 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41330d-a6e4-43f2-a8df-8f3d24db8139 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:45.588452 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce50b05-8cf5-4aab-b0ba-6ab3cce056d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:45.588977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce50b05-8cf5-4aab-b0ba-6ab3cce056d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.589282 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce50b05-8cf5-4aab-b0ba-6ab3cce056d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.589550 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce50b05-8cf5-4aab-b0ba-6ab3cce056d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.590162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce50b05-8cf5-4aab-b0ba-6ab3cce056d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:45.592119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce50b05-8cf5-4aab-b0ba-6ab3cce056d8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:45.600863 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:45.617192 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1313/2598] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:37:45 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:45.621436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3c6d5-8ce9-4ced-a3e9-12df474f687c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:45.632690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3c6d5-8ce9-4ced-a3e9-12df474f687c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:45.637557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7c115-3cf4-44a5-97ac-f774aa55925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:45.638166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7c115-3cf4-44a5-97ac-f774aa55925c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.638475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7c115-3cf4-44a5-97ac-f774aa55925c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.638750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7c115-3cf4-44a5-97ac-f774aa55925c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.639389 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7c115-3cf4-44a5-97ac-f774aa55925c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:45.641017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7c115-3cf4-44a5-97ac-f774aa55925c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:45.651148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1286/2599] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:45.655029 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce50b05-8cf5-4aab-b0ba-6ab3cce056d8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:45.665267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce50b05-8cf5-4aab-b0ba-6ab3cce056d8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:45.669967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520db44c-b8ce-44bd-9e64-a642f768c868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:45.670607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520db44c-b8ce-44bd-9e64-a642f768c868 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.670882 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520db44c-b8ce-44bd-9e64-a642f768c868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.671151 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520db44c-b8ce-44bd-9e64-a642f768c868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.671784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520db44c-b8ce-44bd-9e64-a642f768c868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:45.673401 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520db44c-b8ce-44bd-9e64-a642f768c868 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:45.683714 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1314/2600] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:45.687597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7c115-3cf4-44a5-97ac-f774aa55925c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:45.698100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7c115-3cf4-44a5-97ac-f774aa55925c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:45.702750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9783c5-c0ce-4e58-ad30-36b81aa95668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:45.703395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9783c5-c0ce-4e58-ad30-36b81aa95668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.703675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9783c5-c0ce-4e58-ad30-36b81aa95668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.703949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9783c5-c0ce-4e58-ad30-36b81aa95668 admin admin] PATH_INFO: `/v3/projects/d4691fbf827e423baa01f6401156ef95/users/d752f033e6b6422f875ecec7b3db38ee/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.718356 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9783c5-c0ce-4e58-ad30-36b81aa95668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4691fbf827e423baa01f6401156ef95, user_id=d752f033e6b6422f875ecec7b3db38ee, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:45.721015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9783c5-c0ce-4e58-ad30-36b81aa95668 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:45.733557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1287/2601] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:37:45 2022] PUT /identity/v3/projects/d4691fbf827e423baa01f6401156ef95/users/d752f033e6b6422f875ecec7b3db38ee/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:37:45.744299 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a2cfa-8d9a-4056-bf09-4e78d6a955a3 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.744577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a2cfa-8d9a-4056-bf09-4e78d6a955a3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.744849 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a2cfa-8d9a-4056-bf09-4e78d6a955a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.772589 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-fe9a2cfa-8d9a-4056-bf09-4e78d6a955a3 None None] MFA Rules not processed for user `d752f033e6b6422f875ecec7b3db38ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:45.773825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-fe9a2cfa-8d9a-4056-bf09-4e78d6a955a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:45.838035 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1315/2602] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:45.849348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9783c5-c0ce-4e58-ad30-36b81aa95668 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:45.851073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ce9783c5-c0ce-4e58-ad30-36b81aa95668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:45.931285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9783c5-c0ce-4e58-ad30-36b81aa95668 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:45.936764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc3eb5-7434-4287-bc1a-c0768ab22789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:45.937364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc3eb5-7434-4287-bc1a-c0768ab22789 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.937639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc3eb5-7434-4287-bc1a-c0768ab22789 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.937908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc3eb5-7434-4287-bc1a-c0768ab22789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.946262 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc3eb5-7434-4287-bc1a-c0768ab22789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:45.947921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc3eb5-7434-4287-bc1a-c0768ab22789 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:45.956894 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1288/2603] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:48.710763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a2cfa-8d9a-4056-bf09-4e78d6a955a3 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:48.779850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a2cfa-8d9a-4056-bf09-4e78d6a955a3 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:48.784257 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:48.784878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:48.785202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:48.785551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] PATH_INFO: `/v3/users/d752f033e6b6422f875ecec7b3db38ee` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:48.787078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d752f033e6b6422f875ecec7b3db38ee)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:48.789258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:48.835755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd752f033e6b6422f875ecec7b3db38ee'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:48.842924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd752f033e6b6422f875ecec7b3db38ee'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:48.853121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:48.855442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd752f033e6b6422f875ecec7b3db38ee'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:48.856419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd752f033e6b6422f875ecec7b3db38ee'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:48.857359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd752f033e6b6422f875ecec7b3db38ee'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:48.872481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1316/2604] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:37:48 2022] DELETE /identity/v3/users/d752f033e6b6422f875ecec7b3db38ee => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:48.876946 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20362f-1928-4958-ae56-7c7cf671628a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:48.877435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20362f-1928-4958-ae56-7c7cf671628a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:48.877538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20362f-1928-4958-ae56-7c7cf671628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:48.897622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4a20362f-1928-4958-ae56-7c7cf671628a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:48.898859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4a20362f-1928-4958-ae56-7c7cf671628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:48.961302 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1289/2605] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:48.971822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:48.974255 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:49.063576 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7c747-15df-463e-ad64-1e53fe1a15f8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:49.067517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3affe38-bfe3-4706-8072-080c4c2d7073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:49.068237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3affe38-bfe3-4706-8072-080c4c2d7073 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:49.068518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3affe38-bfe3-4706-8072-080c4c2d7073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:49.068790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3affe38-bfe3-4706-8072-080c4c2d7073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:49.085381 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3affe38-bfe3-4706-8072-080c4c2d7073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:49.086866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3affe38-bfe3-4706-8072-080c4c2d7073 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:49.097560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1317/2606] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:49.409585 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20362f-1928-4958-ae56-7c7cf671628a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:49.411225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4a20362f-1928-4958-ae56-7c7cf671628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:49.423173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:49.432647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20362f-1928-4958-ae56-7c7cf671628a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:49.438774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f663d-7dd0-4d34-94d8-65298c90dc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:49.439417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f663d-7dd0-4d34-94d8-65298c90dc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:49.439714 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f663d-7dd0-4d34-94d8-65298c90dc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:49.439934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f663d-7dd0-4d34-94d8-65298c90dc98 admin admin] PATH_INFO: `/v3/projects/d4691fbf827e423baa01f6401156ef95` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:49.441098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f663d-7dd0-4d34-94d8-65298c90dc98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4691fbf827e423baa01f6401156ef95)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:49.444029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f663d-7dd0-4d34-94d8-65298c90dc98 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:49.490338 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b13f663d-7dd0-4d34-94d8-65298c90dc98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4691fbf827e423baa01f6401156ef95', 'request_id': 'req-b13f663d-7dd0-4d34-94d8-65298c90dc98'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:49.497438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b13f663d-7dd0-4d34-94d8-65298c90dc98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4691fbf827e423baa01f6401156ef95', 'request_id': 'req-b13f663d-7dd0-4d34-94d8-65298c90dc98'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:49.504591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b13f663d-7dd0-4d34-94d8-65298c90dc98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4691fbf827e423baa01f6401156ef95', 'request_id': 'req-b13f663d-7dd0-4d34-94d8-65298c90dc98'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:49.514895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b13f663d-7dd0-4d34-94d8-65298c90dc98 admin admin] The token cache is being invalidate because project d4691fbf827e423baa01f6401156ef95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:37:49.515201 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b13f663d-7dd0-4d34-94d8-65298c90dc98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:49.515826 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b13f663d-7dd0-4d34-94d8-65298c90dc98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:37:49.517396 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1290/2607] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:37:49 2022] DELETE /identity/v3/projects/d4691fbf827e423baa01f6401156ef95 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:49.522982 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361778bf-1d16-4c37-a345-e24d6ef68990 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:49.523289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361778bf-1d16-4c37-a345-e24d6ef68990 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:49.523563 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361778bf-1d16-4c37-a345-e24d6ef68990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:49.544269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-361778bf-1d16-4c37-a345-e24d6ef68990 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:49.545493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-361778bf-1d16-4c37-a345-e24d6ef68990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:49.606814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1318/2608] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:49.615815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c41265-8b28-42c4-b2c7-85cf2bb35799 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:49.616118 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c41265-8b28-42c4-b2c7-85cf2bb35799 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:49.616395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c41265-8b28-42c4-b2c7-85cf2bb35799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:49.637167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-00c41265-8b28-42c4-b2c7-85cf2bb35799 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:49.638416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-00c41265-8b28-42c4-b2c7-85cf2bb35799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:49.646838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1291/2609] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:49.651073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361778bf-1d16-4c37-a345-e24d6ef68990 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:49.661360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361778bf-1d16-4c37-a345-e24d6ef68990 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:49.666342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45a672-b2d1-43ce-b37a-4ad85a72f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:49.666978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45a672-b2d1-43ce-b37a-4ad85a72f466 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:49.667249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45a672-b2d1-43ce-b37a-4ad85a72f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:49.667537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45a672-b2d1-43ce-b37a-4ad85a72f466 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:49.668179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45a672-b2d1-43ce-b37a-4ad85a72f466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:37:49.668533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45a672-b2d1-43ce-b37a-4ad85a72f466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:49.670171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45a672-b2d1-43ce-b37a-4ad85a72f466 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:49.685580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1319/2610] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:49.686843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c41265-8b28-42c4-b2c7-85cf2bb35799 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:49.697212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c41265-8b28-42c4-b2c7-85cf2bb35799 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:49.701955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b98f76-9ab9-4c24-aea2-351ec799b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:49.702591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b98f76-9ab9-4c24-aea2-351ec799b059 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:49.702873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b98f76-9ab9-4c24-aea2-351ec799b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:49.703143 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b98f76-9ab9-4c24-aea2-351ec799b059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:49.703773 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b98f76-9ab9-4c24-aea2-351ec799b059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:49.705662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b98f76-9ab9-4c24-aea2-351ec799b059 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:49.734976 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1292/2611] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:37:49 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:49.739829 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45a672-b2d1-43ce-b37a-4ad85a72f466 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:49.749990 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45a672-b2d1-43ce-b37a-4ad85a72f466 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:49.805893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ecf0d-0e45-4e95-bc99-18be4bc18d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:49.806543 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ecf0d-0e45-4e95-bc99-18be4bc18d8d admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:49.806823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ecf0d-0e45-4e95-bc99-18be4bc18d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:49.807094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ecf0d-0e45-4e95-bc99-18be4bc18d8d admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:49.807720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ecf0d-0e45-4e95-bc99-18be4bc18d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:49.809614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ecf0d-0e45-4e95-bc99-18be4bc18d8d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:49.831599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1320/2612] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:37:49 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:49.835947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b98f76-9ab9-4c24-aea2-351ec799b059 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:49.846248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b98f76-9ab9-4c24-aea2-351ec799b059 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:49.851085 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922efd2-f2be-4ded-bb7f-5d84fc8a309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:49.851712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922efd2-f2be-4ded-bb7f-5d84fc8a309f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:49.851991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922efd2-f2be-4ded-bb7f-5d84fc8a309f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:49.852260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922efd2-f2be-4ded-bb7f-5d84fc8a309f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:49.852901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922efd2-f2be-4ded-bb7f-5d84fc8a309f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:49.854571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922efd2-f2be-4ded-bb7f-5d84fc8a309f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:49.865047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1293/2613] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:49.868895 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ecf0d-0e45-4e95-bc99-18be4bc18d8d admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:49.878666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ecf0d-0e45-4e95-bc99-18be4bc18d8d admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:49.884017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dfdfd-6dc4-451a-b5ca-0d0387947ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:49.884601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dfdfd-6dc4-451a-b5ca-0d0387947ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:49.884873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dfdfd-6dc4-451a-b5ca-0d0387947ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:49.885138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dfdfd-6dc4-451a-b5ca-0d0387947ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:49.885762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dfdfd-6dc4-451a-b5ca-0d0387947ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:49.887392 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dfdfd-6dc4-451a-b5ca-0d0387947ad0 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:49.888605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:49.899471 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1321/2614] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:49.903510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922efd2-f2be-4ded-bb7f-5d84fc8a309f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:49.913833 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922efd2-f2be-4ded-bb7f-5d84fc8a309f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:49.918451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afabc17-123a-42fa-a54f-0d0cf08258b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:49.919096 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afabc17-123a-42fa-a54f-0d0cf08258b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:49.919381 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afabc17-123a-42fa-a54f-0d0cf08258b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:49.919658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afabc17-123a-42fa-a54f-0d0cf08258b3 admin admin] PATH_INFO: `/v3/projects/667dde006dda4e54839f602a09cfc367/users/cf090df10ec24222b79f467acac78772/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:49.934534 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afabc17-123a-42fa-a54f-0d0cf08258b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=667dde006dda4e54839f602a09cfc367, user_id=cf090df10ec24222b79f467acac78772, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:49.937183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afabc17-123a-42fa-a54f-0d0cf08258b3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:49.950513 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1294/2615] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:37:49 2022] PUT /identity/v3/projects/667dde006dda4e54839f602a09cfc367/users/cf090df10ec24222b79f467acac78772/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:49.961409 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bde4a-580a-4d81-9c74-f0de7e01f6f7 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:49.961693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bde4a-580a-4d81-9c74-f0de7e01f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:49.961962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bde4a-580a-4d81-9c74-f0de7e01f6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:49.989378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-5b8bde4a-580a-4d81-9c74-f0de7e01f6f7 None None] MFA Rules not processed for user `cf090df10ec24222b79f467acac78772`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:49.990597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5b8bde4a-580a-4d81-9c74-f0de7e01f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:50.053693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1322/2616] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:50.058509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afabc17-123a-42fa-a54f-0d0cf08258b3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:50.119740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afabc17-123a-42fa-a54f-0d0cf08258b3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:50.124425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01466bb-d5bb-43fd-92f2-c5dcb6b7a18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:50.125025 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01466bb-d5bb-43fd-92f2-c5dcb6b7a18a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:50.125303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01466bb-d5bb-43fd-92f2-c5dcb6b7a18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:50.125609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01466bb-d5bb-43fd-92f2-c5dcb6b7a18a admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:50.126228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01466bb-d5bb-43fd-92f2-c5dcb6b7a18a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:50.128152 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01466bb-d5bb-43fd-92f2-c5dcb6b7a18a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:50.153850 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1295/2617] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:37:50 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:50.158114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bde4a-580a-4d81-9c74-f0de7e01f6f7 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:50.169629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bde4a-580a-4d81-9c74-f0de7e01f6f7 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:50.225382 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cc3c6-34f0-4efc-9407-2f221d670f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:50.225983 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cc3c6-34f0-4efc-9407-2f221d670f4e admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:50.226521 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cc3c6-34f0-4efc-9407-2f221d670f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:50.226701 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cc3c6-34f0-4efc-9407-2f221d670f4e admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:50.227187 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cc3c6-34f0-4efc-9407-2f221d670f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:50.229130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cc3c6-34f0-4efc-9407-2f221d670f4e admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:50.250082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1323/2618] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:37:50 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:50.254047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01466bb-d5bb-43fd-92f2-c5dcb6b7a18a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:50.264226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01466bb-d5bb-43fd-92f2-c5dcb6b7a18a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:50.268768 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d7c9f-09df-487d-aaf8-5623ed05256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:50.269365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d7c9f-09df-487d-aaf8-5623ed05256c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:50.269687 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d7c9f-09df-487d-aaf8-5623ed05256c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:50.269963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d7c9f-09df-487d-aaf8-5623ed05256c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:50.270646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d7c9f-09df-487d-aaf8-5623ed05256c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:50.272289 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d7c9f-09df-487d-aaf8-5623ed05256c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:50.273507 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:50.284671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1296/2619] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:50.289537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cc3c6-34f0-4efc-9407-2f221d670f4e admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:50.299375 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cc3c6-34f0-4efc-9407-2f221d670f4e admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:50.304594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d18e8-3a44-4bd5-99e1-ac38e64c04e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:50.305162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d18e8-3a44-4bd5-99e1-ac38e64c04e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:50.305440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d18e8-3a44-4bd5-99e1-ac38e64c04e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:50.305711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d18e8-3a44-4bd5-99e1-ac38e64c04e3 admin admin] PATH_INFO: `/v3/projects/b56d03bfaefc49b2817f083b34a26130/users/8aa204fe329a4ae9bb05162ed57e6e2e/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:50.320504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d18e8-3a44-4bd5-99e1-ac38e64c04e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56d03bfaefc49b2817f083b34a26130, user_id=8aa204fe329a4ae9bb05162ed57e6e2e, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:50.323308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d18e8-3a44-4bd5-99e1-ac38e64c04e3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:50.335734 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1324/2620] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:37:50 2022] PUT /identity/v3/projects/b56d03bfaefc49b2817f083b34a26130/users/8aa204fe329a4ae9bb05162ed57e6e2e/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:50.339661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d7c9f-09df-487d-aaf8-5623ed05256c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:50.349875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d7c9f-09df-487d-aaf8-5623ed05256c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:50.405907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1f9d2-3f57-4d0a-a2d6-37ba1eb531c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:50.406552 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1f9d2-3f57-4d0a-a2d6-37ba1eb531c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:50.406829 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1f9d2-3f57-4d0a-a2d6-37ba1eb531c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:50.407103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1f9d2-3f57-4d0a-a2d6-37ba1eb531c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:50.407746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1f9d2-3f57-4d0a-a2d6-37ba1eb531c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:50.409373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1f9d2-3f57-4d0a-a2d6-37ba1eb531c1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:50.421079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1297/2621] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:37:50.427054 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d18e8-3a44-4bd5-99e1-ac38e64c04e3 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:50.437757 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d18e8-3a44-4bd5-99e1-ac38e64c04e3 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:50.443435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9fc4b-2630-4de4-9607-c28ed01654d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:50.444226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9fc4b-2630-4de4-9607-c28ed01654d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:50.444624 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9fc4b-2630-4de4-9607-c28ed01654d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:50.445202 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9fc4b-2630-4de4-9607-c28ed01654d8 admin admin] PATH_INFO: `/v3/projects/b56d03bfaefc49b2817f083b34a26130/users/8aa204fe329a4ae9bb05162ed57e6e2e/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:50.447457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9fc4b-2630-4de4-9607-c28ed01654d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56d03bfaefc49b2817f083b34a26130, user_id=8aa204fe329a4ae9bb05162ed57e6e2e, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:50.450193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9fc4b-2630-4de4-9607-c28ed01654d8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:50.465768 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1325/2622] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:37:50 2022] PUT /identity/v3/projects/b56d03bfaefc49b2817f083b34a26130/users/8aa204fe329a4ae9bb05162ed57e6e2e/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:50.476895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295aab7-0383-45d6-a0a1-d33a6896c5a2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:50.477183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295aab7-0383-45d6-a0a1-d33a6896c5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:50.477459 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295aab7-0383-45d6-a0a1-d33a6896c5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:50.505082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7295aab7-0383-45d6-a0a1-d33a6896c5a2 None None] MFA Rules not processed for user `8aa204fe329a4ae9bb05162ed57e6e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:50.506287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7295aab7-0383-45d6-a0a1-d33a6896c5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:50.577955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1298/2623] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:37:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:37:50.591483 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9fc4b-2630-4de4-9607-c28ed01654d8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:50.593314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e0a9fc4b-2630-4de4-9607-c28ed01654d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:50.642133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:50.662231 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9fc4b-2630-4de4-9607-c28ed01654d8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:50.666313 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93403f08-30bd-4cf3-91d0-4ab956b9b221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:50.667056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93403f08-30bd-4cf3-91d0-4ab956b9b221 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:50.667216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93403f08-30bd-4cf3-91d0-4ab956b9b221 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:50.667746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93403f08-30bd-4cf3-91d0-4ab956b9b221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:50.679185 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93403f08-30bd-4cf3-91d0-4ab956b9b221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:50.680714 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93403f08-30bd-4cf3-91d0-4ab956b9b221 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:50.693696 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1326/2624] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:50.779983 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295aab7-0383-45d6-a0a1-d33a6896c5a2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:50.790462 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295aab7-0383-45d6-a0a1-d33a6896c5a2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:50.794045 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ba29e-fe47-4b0a-95b0-c5bb919aa189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:50.794684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba29e-fe47-4b0a-95b0-c5bb919aa189 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:50.794966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba29e-fe47-4b0a-95b0-c5bb919aa189 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:50.803019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba29e-fe47-4b0a-95b0-c5bb919aa189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:50.861545 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ba29e-fe47-4b0a-95b0-c5bb919aa189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:50.863043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ba29e-fe47-4b0a-95b0-c5bb919aa189 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:50.872652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1299/2625] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:37:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:37:52.049392 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cfb48-24b1-499f-9845-ea3a51faf293 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:52.049884 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cfb48-24b1-499f-9845-ea3a51faf293 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:52.049988 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cfb48-24b1-499f-9845-ea3a51faf293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:52.069929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-081cfb48-24b1-499f-9845-ea3a51faf293 None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:52.071188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-081cfb48-24b1-499f-9845-ea3a51faf293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:52.128391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1327/2626] 10.222.0.33 () {58 vars in 1009 bytes} [Mon Sep 12 23:37:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:37:52.180396 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ba29e-fe47-4b0a-95b0-c5bb919aa189 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:52.182083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7f6ba29e-fe47-4b0a-95b0-c5bb919aa189 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:52.200776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:52.261041 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ba29e-fe47-4b0a-95b0-c5bb919aa189 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:52.266641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabf833-8e18-4a0b-b677-9ff05d615a8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:52.267392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabf833-8e18-4a0b-b677-9ff05d615a8e service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:52.267583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabf833-8e18-4a0b-b677-9ff05d615a8e service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:52.267787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabf833-8e18-4a0b-b677-9ff05d615a8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:52.276660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabf833-8e18-4a0b-b677-9ff05d615a8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:52.278275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabf833-8e18-4a0b-b677-9ff05d615a8e service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:52.287003 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1300/2627] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:37:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:38:02.121804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=34 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:02.283150 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=25 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:08.787445 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b1c4d-7255-4ebf-9f38-6ee728f76f2a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:08.787908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b1c4d-7255-4ebf-9f38-6ee728f76f2a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:08.788066 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b1c4d-7255-4ebf-9f38-6ee728f76f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:08.807639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-6e0b1c4d-7255-4ebf-9f38-6ee728f76f2a None None] MFA Rules not processed for user `f66201e006624a69811e7c613702125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:08.808831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6e0b1c4d-7255-4ebf-9f38-6ee728f76f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:08.815867 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1328/2628] 10.222.0.33 () {58 vars in 967 bytes} [Mon Sep 12 23:38:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:08.827968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabf833-8e18-4a0b-b677-9ff05d615a8e service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:08.839747 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabf833-8e18-4a0b-b677-9ff05d615a8e service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:08.844727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200df6a3-2fd8-4071-93a9-44029eea884c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53214ffdc5d04c14b3b3ac868862480b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:08.845321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200df6a3-2fd8-4071-93a9-44029eea884c service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:08.845602 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200df6a3-2fd8-4071-93a9-44029eea884c service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:08.845877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200df6a3-2fd8-4071-93a9-44029eea884c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:08.854400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200df6a3-2fd8-4071-93a9-44029eea884c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:08.856013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200df6a3-2fd8-4071-93a9-44029eea884c service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:08.864561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1301/2629] 10.222.0.33 () {60 vars in 1384 bytes} [Mon Sep 12 23:38:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:38:10.791980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b1c4d-7255-4ebf-9f38-6ee728f76f2a None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:10.793421 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6e0b1c4d-7255-4ebf-9f38-6ee728f76f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:10.872076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b1c4d-7255-4ebf-9f38-6ee728f76f2a None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:10.877208 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c24f7-336e-4a01-bf9c-550a6f0428b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:10.877932 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c24f7-336e-4a01-bf9c-550a6f0428b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:10.879074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c24f7-336e-4a01-bf9c-550a6f0428b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:10.879487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c24f7-336e-4a01-bf9c-550a6f0428b0 admin admin] PATH_INFO: `/v3/users/c777b579c06f4b24848f59d4582d3aed` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:10.881082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c24f7-336e-4a01-bf9c-550a6f0428b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c777b579c06f4b24848f59d4582d3aed)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:10.883099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c24f7-336e-4a01-bf9c-550a6f0428b0 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:10.939365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2c3c24f7-336e-4a01-bf9c-550a6f0428b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c777b579c06f4b24848f59d4582d3aed'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:10.946914 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2c3c24f7-336e-4a01-bf9c-550a6f0428b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c777b579c06f4b24848f59d4582d3aed'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:10.960080 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2c3c24f7-336e-4a01-bf9c-550a6f0428b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c777b579c06f4b24848f59d4582d3aed'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:10.960785 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2c3c24f7-336e-4a01-bf9c-550a6f0428b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c777b579c06f4b24848f59d4582d3aed'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:10.961481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2c3c24f7-336e-4a01-bf9c-550a6f0428b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c777b579c06f4b24848f59d4582d3aed'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:10.973712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1329/2630] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:10 2022] DELETE /identity/v3/users/c777b579c06f4b24848f59d4582d3aed => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:11.142499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200df6a3-2fd8-4071-93a9-44029eea884c service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.155907 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200df6a3-2fd8-4071-93a9-44029eea884c service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.219835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79feb9c1-9c45-43d2-9436-ead3ee2a1771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.220473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb9c1-9c45-43d2-9436-ead3ee2a1771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.220753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb9c1-9c45-43d2-9436-ead3ee2a1771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.221029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb9c1-9c45-43d2-9436-ead3ee2a1771 admin admin] PATH_INFO: `/v3/projects/f499e0610b0443c892b7127267aaa35c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.222221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feb9c1-9c45-43d2-9436-ead3ee2a1771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f499e0610b0443c892b7127267aaa35c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.224163 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feb9c1-9c45-43d2-9436-ead3ee2a1771 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.278598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-79feb9c1-9c45-43d2-9436-ead3ee2a1771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f499e0610b0443c892b7127267aaa35c', 'request_id': 'req-79feb9c1-9c45-43d2-9436-ead3ee2a1771'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:11.286952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-79feb9c1-9c45-43d2-9436-ead3ee2a1771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f499e0610b0443c892b7127267aaa35c', 'request_id': 'req-79feb9c1-9c45-43d2-9436-ead3ee2a1771'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:11.294790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-79feb9c1-9c45-43d2-9436-ead3ee2a1771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f499e0610b0443c892b7127267aaa35c', 'request_id': 'req-79feb9c1-9c45-43d2-9436-ead3ee2a1771'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:11.306978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-79feb9c1-9c45-43d2-9436-ead3ee2a1771 admin admin] The token cache is being invalidate because project f499e0610b0443c892b7127267aaa35c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:11.307268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-79feb9c1-9c45-43d2-9436-ead3ee2a1771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:11.307926 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-79feb9c1-9c45-43d2-9436-ead3ee2a1771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:11.309649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1302/2631] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:11 2022] DELETE /identity/v3/projects/f499e0610b0443c892b7127267aaa35c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:11.314559 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583faa6-2122-41ca-ba80-001fcffa7402 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.314956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583faa6-2122-41ca-ba80-001fcffa7402 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.315131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583faa6-2122-41ca-ba80-001fcffa7402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.337566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-3583faa6-2122-41ca-ba80-001fcffa7402 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:11.338809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3583faa6-2122-41ca-ba80-001fcffa7402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:11.405840 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1330/2632] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:11.415390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff37f7e-50a8-44c5-878f-e9d33a346b53 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.415670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff37f7e-50a8-44c5-878f-e9d33a346b53 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.416083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff37f7e-50a8-44c5-878f-e9d33a346b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.437457 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4ff37f7e-50a8-44c5-878f-e9d33a346b53 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:11.438696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4ff37f7e-50a8-44c5-878f-e9d33a346b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:11.447314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1303/2633] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:11.451980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583faa6-2122-41ca-ba80-001fcffa7402 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.462256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583faa6-2122-41ca-ba80-001fcffa7402 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.466905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3187f-db67-4ad5-90fc-b163cebf236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.467508 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3187f-db67-4ad5-90fc-b163cebf236a admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.467786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3187f-db67-4ad5-90fc-b163cebf236a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.468058 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3187f-db67-4ad5-90fc-b163cebf236a admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.468730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3187f-db67-4ad5-90fc-b163cebf236a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:11.469032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3187f-db67-4ad5-90fc-b163cebf236a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.470630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3187f-db67-4ad5-90fc-b163cebf236a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.480260 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:11.483833 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1331/2634] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:11.488351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff37f7e-50a8-44c5-878f-e9d33a346b53 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.498076 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff37f7e-50a8-44c5-878f-e9d33a346b53 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.503062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbd1ce-5277-4485-a91c-314f764efc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.504751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbd1ce-5277-4485-a91c-314f764efc69 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.504964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbd1ce-5277-4485-a91c-314f764efc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.505244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbd1ce-5277-4485-a91c-314f764efc69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.506575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbd1ce-5277-4485-a91c-314f764efc69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.507818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbd1ce-5277-4485-a91c-314f764efc69 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.536992 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1304/2635] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:11 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:11.542118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3187f-db67-4ad5-90fc-b163cebf236a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.553041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3187f-db67-4ad5-90fc-b163cebf236a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.610207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe0b7e-bd75-4170-96f6-ccd39053fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.610778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe0b7e-bd75-4170-96f6-ccd39053fe89 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.611061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe0b7e-bd75-4170-96f6-ccd39053fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.611335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe0b7e-bd75-4170-96f6-ccd39053fe89 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.611966 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe0b7e-bd75-4170-96f6-ccd39053fe89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.613944 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe0b7e-bd75-4170-96f6-ccd39053fe89 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.636874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1332/2636] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:11 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:11.641187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbd1ce-5277-4485-a91c-314f764efc69 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.652000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbd1ce-5277-4485-a91c-314f764efc69 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.656799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0f987-4c6d-46f2-8fc7-d6bc7051930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.657395 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0f987-4c6d-46f2-8fc7-d6bc7051930c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.657673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0f987-4c6d-46f2-8fc7-d6bc7051930c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.657943 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0f987-4c6d-46f2-8fc7-d6bc7051930c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.658609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0f987-4c6d-46f2-8fc7-d6bc7051930c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.660486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0f987-4c6d-46f2-8fc7-d6bc7051930c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.670849 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1305/2637] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:11.674852 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe0b7e-bd75-4170-96f6-ccd39053fe89 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.684786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe0b7e-bd75-4170-96f6-ccd39053fe89 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.689353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da451c-2473-48e7-804f-aa0237ec5c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.689940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da451c-2473-48e7-804f-aa0237ec5c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.690217 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da451c-2473-48e7-804f-aa0237ec5c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.690528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da451c-2473-48e7-804f-aa0237ec5c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.692147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da451c-2473-48e7-804f-aa0237ec5c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.693722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da451c-2473-48e7-804f-aa0237ec5c56 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.704930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1333/2638] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:11.709679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0f987-4c6d-46f2-8fc7-d6bc7051930c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.719520 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0f987-4c6d-46f2-8fc7-d6bc7051930c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.724095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b42550-95f0-4bf3-9241-c20377548578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.724733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b42550-95f0-4bf3-9241-c20377548578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.725009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b42550-95f0-4bf3-9241-c20377548578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.725286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b42550-95f0-4bf3-9241-c20377548578 admin admin] PATH_INFO: `/v3/projects/f186600d96d2442fad41c9f7172e3e47/users/42a1ed716ae14d9780652fc18b4bade9/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.739566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b42550-95f0-4bf3-9241-c20377548578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f186600d96d2442fad41c9f7172e3e47, user_id=42a1ed716ae14d9780652fc18b4bade9, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.742192 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b42550-95f0-4bf3-9241-c20377548578 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.756176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1306/2639] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:11 2022] PUT /identity/v3/projects/f186600d96d2442fad41c9f7172e3e47/users/42a1ed716ae14d9780652fc18b4bade9/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:11.761117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29eb21-e8b4-4f7e-a788-3dae97a35a77 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.761401 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29eb21-e8b4-4f7e-a788-3dae97a35a77 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.761667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29eb21-e8b4-4f7e-a788-3dae97a35a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.780778 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-9b29eb21-e8b4-4f7e-a788-3dae97a35a77 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:11.781989 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9b29eb21-e8b4-4f7e-a788-3dae97a35a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:11.840108 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1334/2640] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:11.850047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b42550-95f0-4bf3-9241-c20377548578 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.851779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-52b42550-95f0-4bf3-9241-c20377548578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:11.866527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:11.910615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b42550-95f0-4bf3-9241-c20377548578 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.914654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747aa975-2173-437f-8f89-b1430c5776cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.915268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aa975-2173-437f-8f89-b1430c5776cf service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.915550 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aa975-2173-437f-8f89-b1430c5776cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.915826 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aa975-2173-437f-8f89-b1430c5776cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.925661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747aa975-2173-437f-8f89-b1430c5776cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.927208 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747aa975-2173-437f-8f89-b1430c5776cf service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.936559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1307/2641] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:12.660893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440247-a195-4e9a-9eaa-190e7094c030 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:12.661182 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440247-a195-4e9a-9eaa-190e7094c030 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:12.661455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440247-a195-4e9a-9eaa-190e7094c030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:12.692608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-96440247-a195-4e9a-9eaa-190e7094c030 None None] MFA Rules not processed for user `42a1ed716ae14d9780652fc18b4bade9`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:12.693771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-96440247-a195-4e9a-9eaa-190e7094c030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:12.760059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1335/2642] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:12.771965 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747aa975-2173-437f-8f89-b1430c5776cf service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:12.773468 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-747aa975-2173-437f-8f89-b1430c5776cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:12.833013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747aa975-2173-437f-8f89-b1430c5776cf service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:12.836832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d9ecd-4948-45af-9915-663c94a0dae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:12.837453 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d9ecd-4948-45af-9915-663c94a0dae6 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:12.837740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d9ecd-4948-45af-9915-663c94a0dae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:12.838015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d9ecd-4948-45af-9915-663c94a0dae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:12.847000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d9ecd-4948-45af-9915-663c94a0dae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:12.848467 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d9ecd-4948-45af-9915-663c94a0dae6 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:12.857479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1308/2643] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:14.231272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e4da9-b0f9-4a68-b699-f959f59f5703 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:14.231857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e4da9-b0f9-4a68-b699-f959f59f5703 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:14.231857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e4da9-b0f9-4a68-b699-f959f59f5703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:14.251855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b48e4da9-b0f9-4a68-b699-f959f59f5703 None None] MFA Rules not processed for user `42a1ed716ae14d9780652fc18b4bade9`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:14.253162 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b48e4da9-b0f9-4a68-b699-f959f59f5703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:14.261708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1336/2644] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:20.063088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d9ecd-4948-45af-9915-663c94a0dae6 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:20.065704 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-193d9ecd-4948-45af-9915-663c94a0dae6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:20.080312 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d9ecd-4948-45af-9915-663c94a0dae6 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:20.085639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91224995-308e-43d7-aa1a-8a0cb57e5699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:20.086660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91224995-308e-43d7-aa1a-8a0cb57e5699 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:20.086944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91224995-308e-43d7-aa1a-8a0cb57e5699 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:20.087224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91224995-308e-43d7-aa1a-8a0cb57e5699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:20.089673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-91224995-308e-43d7-aa1a-8a0cb57e5699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:20.173244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91224995-308e-43d7-aa1a-8a0cb57e5699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:20.174741 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91224995-308e-43d7-aa1a-8a0cb57e5699 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:20.187900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1309/2645] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:21.111131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e4da9-b0f9-4a68-b699-f959f59f5703 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:21.117888 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:21.125762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e4da9-b0f9-4a68-b699-f959f59f5703 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:21.131118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e61e50-bb54-4320-aae4-7c961c5d908e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:21.131682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e61e50-bb54-4320-aae4-7c961c5d908e service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:21.132104 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e61e50-bb54-4320-aae4-7c961c5d908e service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:21.132435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e61e50-bb54-4320-aae4-7c961c5d908e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:21.134783 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-12e61e50-bb54-4320-aae4-7c961c5d908e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:21.149563 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e61e50-bb54-4320-aae4-7c961c5d908e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:21.151043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e61e50-bb54-4320-aae4-7c961c5d908e service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:21.167166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1337/2646] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:22.152906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91224995-308e-43d7-aa1a-8a0cb57e5699 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:22.154614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-91224995-308e-43d7-aa1a-8a0cb57e5699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:22.170263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91224995-308e-43d7-aa1a-8a0cb57e5699 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:22.175351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:22.176077 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:22.176360 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:22.176693 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] PATH_INFO: `/v3/users/cf090df10ec24222b79f467acac78772` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:22.178007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf090df10ec24222b79f467acac78772)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:22.180091 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:22.223939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:22.231498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf090df10ec24222b79f467acac78772'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.239625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf090df10ec24222b79f467acac78772'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.255337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf090df10ec24222b79f467acac78772'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.256023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf090df10ec24222b79f467acac78772'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.256605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf090df10ec24222b79f467acac78772'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.271359 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1310/2647] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:22 2022] DELETE /identity/v3/users/cf090df10ec24222b79f467acac78772 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:22.275804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aaad0-ace4-455c-8610-2cfd9cbc1221 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:22.276270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aaad0-ace4-455c-8610-2cfd9cbc1221 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:22.276524 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aaad0-ace4-455c-8610-2cfd9cbc1221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:22.296931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-672aaad0-ace4-455c-8610-2cfd9cbc1221 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:22.298128 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-672aaad0-ace4-455c-8610-2cfd9cbc1221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:22.356323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1338/2648] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:22.366701 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:22.368097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:22.434134 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0e9ea-9560-471e-ac90-559f18f4420d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:22.437853 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e6163-8be7-453e-9885-c27ed07604c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:22.438509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6163-8be7-453e-9885-c27ed07604c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:22.438797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6163-8be7-453e-9885-c27ed07604c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:22.439069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6163-8be7-453e-9885-c27ed07604c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:22.449675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e6163-8be7-453e-9885-c27ed07604c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:22.451228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e6163-8be7-453e-9885-c27ed07604c4 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:22.461529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1311/2649] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:22.725889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aaad0-ace4-455c-8610-2cfd9cbc1221 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:22.727314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-672aaad0-ace4-455c-8610-2cfd9cbc1221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:22.739440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aaad0-ace4-455c-8610-2cfd9cbc1221 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:22.744283 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:22.744924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:22.745885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:22.746510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] PATH_INFO: `/v3/projects/667dde006dda4e54839f602a09cfc367` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:22.748257 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=667dde006dda4e54839f602a09cfc367)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:22.750201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:22.796509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667dde006dda4e54839f602a09cfc367', 'request_id': 'req-5b427ead-0bc6-4c66-8698-06e7a0007feb'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.802765 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667dde006dda4e54839f602a09cfc367', 'request_id': 'req-5b427ead-0bc6-4c66-8698-06e7a0007feb'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.808641 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667dde006dda4e54839f602a09cfc367', 'request_id': 'req-5b427ead-0bc6-4c66-8698-06e7a0007feb'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.821731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] The token cache is being invalidate because project 667dde006dda4e54839f602a09cfc367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:22.822013 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.822656 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.824122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1339/2650] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:22 2022] DELETE /identity/v3/projects/667dde006dda4e54839f602a09cfc367 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:22.828090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e6163-8be7-453e-9885-c27ed07604c4 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:22.838594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e6163-8be7-453e-9885-c27ed07604c4 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:22.893940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333190d-1eed-444e-85f9-7edbd5d874ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:22.895442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333190d-1eed-444e-85f9-7edbd5d874ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:22.895748 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333190d-1eed-444e-85f9-7edbd5d874ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:22.896020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333190d-1eed-444e-85f9-7edbd5d874ad admin admin] PATH_INFO: `/v3/users/8aa204fe329a4ae9bb05162ed57e6e2e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:22.897127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333190d-1eed-444e-85f9-7edbd5d874ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aa204fe329a4ae9bb05162ed57e6e2e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:22.899086 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333190d-1eed-444e-85f9-7edbd5d874ad admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:22.945199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8333190d-1eed-444e-85f9-7edbd5d874ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aa204fe329a4ae9bb05162ed57e6e2e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.952090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8333190d-1eed-444e-85f9-7edbd5d874ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aa204fe329a4ae9bb05162ed57e6e2e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.956489 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:22.966324 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8333190d-1eed-444e-85f9-7edbd5d874ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aa204fe329a4ae9bb05162ed57e6e2e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.967012 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8333190d-1eed-444e-85f9-7edbd5d874ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aa204fe329a4ae9bb05162ed57e6e2e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.967606 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8333190d-1eed-444e-85f9-7edbd5d874ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aa204fe329a4ae9bb05162ed57e6e2e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:22.980344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1312/2651] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:22 2022] DELETE /identity/v3/users/8aa204fe329a4ae9bb05162ed57e6e2e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:23.263712 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:23.265434 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:23.279460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b427ead-0bc6-4c66-8698-06e7a0007feb admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:23.345977 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1f149-772c-4c2c-9478-97f40d75d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:23.346722 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1f149-772c-4c2c-9478-97f40d75d3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.347074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1f149-772c-4c2c-9478-97f40d75d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.347464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1f149-772c-4c2c-9478-97f40d75d3de admin admin] PATH_INFO: `/v3/projects/b56d03bfaefc49b2817f083b34a26130` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.348688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1f149-772c-4c2c-9478-97f40d75d3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56d03bfaefc49b2817f083b34a26130)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:23.350720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1f149-772c-4c2c-9478-97f40d75d3de admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:23.367490 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:23.404846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e6b1f149-772c-4c2c-9478-97f40d75d3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56d03bfaefc49b2817f083b34a26130', 'request_id': 'req-e6b1f149-772c-4c2c-9478-97f40d75d3de'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:23.411230 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e6b1f149-772c-4c2c-9478-97f40d75d3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56d03bfaefc49b2817f083b34a26130', 'request_id': 'req-e6b1f149-772c-4c2c-9478-97f40d75d3de'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:23.417174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e6b1f149-772c-4c2c-9478-97f40d75d3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56d03bfaefc49b2817f083b34a26130', 'request_id': 'req-e6b1f149-772c-4c2c-9478-97f40d75d3de'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:23.431219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e6b1f149-772c-4c2c-9478-97f40d75d3de admin admin] The token cache is being invalidate because project b56d03bfaefc49b2817f083b34a26130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:23.431513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e6b1f149-772c-4c2c-9478-97f40d75d3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:23.432163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e6b1f149-772c-4c2c-9478-97f40d75d3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:23.433936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1340/2652] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:23 2022] DELETE /identity/v3/projects/b56d03bfaefc49b2817f083b34a26130 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:23.438674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117b489-d8b7-443e-8e93-41a4f94ba3b5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.439164 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117b489-d8b7-443e-8e93-41a4f94ba3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.439269 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117b489-d8b7-443e-8e93-41a4f94ba3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.460216 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5117b489-d8b7-443e-8e93-41a4f94ba3b5 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:23.461416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5117b489-d8b7-443e-8e93-41a4f94ba3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:23.523248 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1313/2653] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:23.531321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1f90-d20b-4663-9f46-98fcb0f09015 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.531609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1f90-d20b-4663-9f46-98fcb0f09015 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.531885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1f90-d20b-4663-9f46-98fcb0f09015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.552611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f42a1f90-d20b-4663-9f46-98fcb0f09015 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:23.553957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f42a1f90-d20b-4663-9f46-98fcb0f09015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:23.562166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1341/2654] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:23.566682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117b489-d8b7-443e-8e93-41a4f94ba3b5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:23.576896 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117b489-d8b7-443e-8e93-41a4f94ba3b5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:23.581705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877de63-4d98-4ed8-a3ee-a22b44951b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:23.582665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877de63-4d98-4ed8-a3ee-a22b44951b35 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.582946 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877de63-4d98-4ed8-a3ee-a22b44951b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.583242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877de63-4d98-4ed8-a3ee-a22b44951b35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.584224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877de63-4d98-4ed8-a3ee-a22b44951b35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:23.584224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877de63-4d98-4ed8-a3ee-a22b44951b35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:23.585868 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877de63-4d98-4ed8-a3ee-a22b44951b35 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:23.599286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1314/2655] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:23.603607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1f90-d20b-4663-9f46-98fcb0f09015 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:23.613344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1f90-d20b-4663-9f46-98fcb0f09015 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:23.618919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfa355-d134-4e6f-b830-f081bda0598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:23.619551 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfa355-d134-4e6f-b830-f081bda0598b admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.619829 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfa355-d134-4e6f-b830-f081bda0598b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.620103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfa355-d134-4e6f-b830-f081bda0598b admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.620749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfa355-d134-4e6f-b830-f081bda0598b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:23.622745 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfa355-d134-4e6f-b830-f081bda0598b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:23.666056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1342/2656] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:23 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:23.670406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877de63-4d98-4ed8-a3ee-a22b44951b35 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:23.682072 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877de63-4d98-4ed8-a3ee-a22b44951b35 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:23.745787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d7749-87ab-4a57-8913-5166f52309d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:23.746434 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d7749-87ab-4a57-8913-5166f52309d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.746720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d7749-87ab-4a57-8913-5166f52309d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.746997 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d7749-87ab-4a57-8913-5166f52309d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.747650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d7749-87ab-4a57-8913-5166f52309d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:23.749599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d7749-87ab-4a57-8913-5166f52309d4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:23.771617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1315/2657] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:23 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:23.775945 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfa355-d134-4e6f-b830-f081bda0598b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:23.786958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfa355-d134-4e6f-b830-f081bda0598b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:23.791838 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce76cf8-2c23-4764-8c18-6cda942b98a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:23.792447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce76cf8-2c23-4764-8c18-6cda942b98a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.792875 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce76cf8-2c23-4764-8c18-6cda942b98a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.793155 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce76cf8-2c23-4764-8c18-6cda942b98a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.793795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce76cf8-2c23-4764-8c18-6cda942b98a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:23.795447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce76cf8-2c23-4764-8c18-6cda942b98a2 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:23.807463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1343/2658] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:23.811302 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d7749-87ab-4a57-8913-5166f52309d4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:23.822498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d7749-87ab-4a57-8913-5166f52309d4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:23.827253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d831ebb-11b1-4331-8828-d3f0462c48bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:23.828103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d831ebb-11b1-4331-8828-d3f0462c48bf admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.828103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d831ebb-11b1-4331-8828-d3f0462c48bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.828390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d831ebb-11b1-4331-8828-d3f0462c48bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.829061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d831ebb-11b1-4331-8828-d3f0462c48bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:23.830696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d831ebb-11b1-4331-8828-d3f0462c48bf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:23.842343 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1316/2659] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:23.846588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce76cf8-2c23-4764-8c18-6cda942b98a2 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:23.857544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce76cf8-2c23-4764-8c18-6cda942b98a2 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:23.862180 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc278b-91f8-4fd6-a872-9d13a87fd5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:23.862900 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc278b-91f8-4fd6-a872-9d13a87fd5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.863174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc278b-91f8-4fd6-a872-9d13a87fd5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.863586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc278b-91f8-4fd6-a872-9d13a87fd5cf admin admin] PATH_INFO: `/v3/projects/554da11d898e41459c50f5c68445a0a2/users/5b672cad02874426ae9113fa8dd47d14/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.878454 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc278b-91f8-4fd6-a872-9d13a87fd5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=554da11d898e41459c50f5c68445a0a2, user_id=5b672cad02874426ae9113fa8dd47d14, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:23.881090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc278b-91f8-4fd6-a872-9d13a87fd5cf admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:23.896514 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1344/2660] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:23 2022] PUT /identity/v3/projects/554da11d898e41459c50f5c68445a0a2/users/5b672cad02874426ae9113fa8dd47d14/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:23.908229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32021620-f121-48a8-b444-987c7dd1e080 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.908537 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32021620-f121-48a8-b444-987c7dd1e080 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.908810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32021620-f121-48a8-b444-987c7dd1e080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.936808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-32021620-f121-48a8-b444-987c7dd1e080 None None] MFA Rules not processed for user `5b672cad02874426ae9113fa8dd47d14`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:23.938017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-32021620-f121-48a8-b444-987c7dd1e080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:23.969827 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:24.004225 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1317/2661] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:24.008795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc278b-91f8-4fd6-a872-9d13a87fd5cf admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.068947 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc278b-91f8-4fd6-a872-9d13a87fd5cf admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.073608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff14e2-3254-433e-9111-8d9fcf29fe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.074208 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff14e2-3254-433e-9111-8d9fcf29fe82 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.074544 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff14e2-3254-433e-9111-8d9fcf29fe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.074817 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff14e2-3254-433e-9111-8d9fcf29fe82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.075448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff14e2-3254-433e-9111-8d9fcf29fe82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:24.077337 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff14e2-3254-433e-9111-8d9fcf29fe82 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:24.104761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1345/2662] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:24 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:24.108893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32021620-f121-48a8-b444-987c7dd1e080 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.119588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32021620-f121-48a8-b444-987c7dd1e080 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.177633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2373655-0a1c-4215-a75a-caccafe11fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.178245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2373655-0a1c-4215-a75a-caccafe11fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.178555 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2373655-0a1c-4215-a75a-caccafe11fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.178828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2373655-0a1c-4215-a75a-caccafe11fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.179450 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2373655-0a1c-4215-a75a-caccafe11fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:24.181393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2373655-0a1c-4215-a75a-caccafe11fd5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:24.202082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1318/2663] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:24 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:24.206145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff14e2-3254-433e-9111-8d9fcf29fe82 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.216901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff14e2-3254-433e-9111-8d9fcf29fe82 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.221420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78fe45-78e0-4cb7-b05f-1fe057163d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.222014 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78fe45-78e0-4cb7-b05f-1fe057163d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.223087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78fe45-78e0-4cb7-b05f-1fe057163d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.223458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78fe45-78e0-4cb7-b05f-1fe057163d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.224099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78fe45-78e0-4cb7-b05f-1fe057163d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:24.225696 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78fe45-78e0-4cb7-b05f-1fe057163d1a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:24.235878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1346/2664] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:24.239964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2373655-0a1c-4215-a75a-caccafe11fd5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.249818 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2373655-0a1c-4215-a75a-caccafe11fd5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.254942 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83420911-0ddc-49bf-bc6a-60b8b64b254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.255584 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83420911-0ddc-49bf-bc6a-60b8b64b254d admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.255863 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83420911-0ddc-49bf-bc6a-60b8b64b254d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.256138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83420911-0ddc-49bf-bc6a-60b8b64b254d admin admin] PATH_INFO: `/v3/projects/bd327080546c46a88049d4542a618a68/users/11eb8e9779ce45c7bc330d91f7969b39/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.271424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83420911-0ddc-49bf-bc6a-60b8b64b254d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd327080546c46a88049d4542a618a68, user_id=11eb8e9779ce45c7bc330d91f7969b39, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:24.274078 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83420911-0ddc-49bf-bc6a-60b8b64b254d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:24.286404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1319/2665] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:24 2022] PUT /identity/v3/projects/bd327080546c46a88049d4542a618a68/users/11eb8e9779ce45c7bc330d91f7969b39/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:24.290702 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78fe45-78e0-4cb7-b05f-1fe057163d1a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.296964 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:24.304070 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78fe45-78e0-4cb7-b05f-1fe057163d1a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.361740 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22733430-7139-41eb-9992-29f420252648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.362353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22733430-7139-41eb-9992-29f420252648 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.362666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22733430-7139-41eb-9992-29f420252648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.363091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22733430-7139-41eb-9992-29f420252648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.363927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22733430-7139-41eb-9992-29f420252648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:24.365525 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22733430-7139-41eb-9992-29f420252648 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:24.376599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1347/2666] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:24.383683 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83420911-0ddc-49bf-bc6a-60b8b64b254d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.395655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83420911-0ddc-49bf-bc6a-60b8b64b254d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.400654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea84ee7-2a0f-4037-8c2f-48de6c795017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.401319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea84ee7-2a0f-4037-8c2f-48de6c795017 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.401600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea84ee7-2a0f-4037-8c2f-48de6c795017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.401875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea84ee7-2a0f-4037-8c2f-48de6c795017 admin admin] PATH_INFO: `/v3/projects/bd327080546c46a88049d4542a618a68/users/11eb8e9779ce45c7bc330d91f7969b39/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.403841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea84ee7-2a0f-4037-8c2f-48de6c795017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd327080546c46a88049d4542a618a68, user_id=11eb8e9779ce45c7bc330d91f7969b39, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:24.406546 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea84ee7-2a0f-4037-8c2f-48de6c795017 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:24.420159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1320/2667] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:24 2022] PUT /identity/v3/projects/bd327080546c46a88049d4542a618a68/users/11eb8e9779ce45c7bc330d91f7969b39/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:24.430589 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb204d4-c316-4e2d-b437-65f69d35a89a None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.430806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb204d4-c316-4e2d-b437-65f69d35a89a None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.431048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb204d4-c316-4e2d-b437-65f69d35a89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.460140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cfb204d4-c316-4e2d-b437-65f69d35a89a None None] MFA Rules not processed for user `11eb8e9779ce45c7bc330d91f7969b39`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:24.461349 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cfb204d4-c316-4e2d-b437-65f69d35a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:24.542796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1348/2668] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:24.557147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea84ee7-2a0f-4037-8c2f-48de6c795017 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.560878 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fea84ee7-2a0f-4037-8c2f-48de6c795017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:24.627013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea84ee7-2a0f-4037-8c2f-48de6c795017 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.631067 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a1090-4630-4dde-a1d5-5aa7ef97ff0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.631728 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a1090-4630-4dde-a1d5-5aa7ef97ff0e service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.632012 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a1090-4630-4dde-a1d5-5aa7ef97ff0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.632290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a1090-4630-4dde-a1d5-5aa7ef97ff0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.641621 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a1090-4630-4dde-a1d5-5aa7ef97ff0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:24.643282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a1090-4630-4dde-a1d5-5aa7ef97ff0e service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:24.653404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1321/2669] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:25.066923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb204d4-c316-4e2d-b437-65f69d35a89a None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.131344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb204d4-c316-4e2d-b437-65f69d35a89a None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.135938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.136574 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.136861 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.137130 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] PATH_INFO: `/v3/users/5b672cad02874426ae9113fa8dd47d14` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.138285 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b672cad02874426ae9113fa8dd47d14)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.140228 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.172743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:25.194193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b672cad02874426ae9113fa8dd47d14'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.202646 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b672cad02874426ae9113fa8dd47d14'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.218498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b672cad02874426ae9113fa8dd47d14'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.219365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b672cad02874426ae9113fa8dd47d14'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.220078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b672cad02874426ae9113fa8dd47d14'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.234049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1349/2670] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:25 2022] DELETE /identity/v3/users/5b672cad02874426ae9113fa8dd47d14 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:25.239117 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ecc4-cadd-4680-ae2d-257de16f9255 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.239410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ecc4-cadd-4680-ae2d-257de16f9255 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.239687 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ecc4-cadd-4680-ae2d-257de16f9255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.263074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-77f4ecc4-cadd-4680-ae2d-257de16f9255 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:25.264299 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-77f4ecc4-cadd-4680-ae2d-257de16f9255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:25.292059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:25.328939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1322/2671] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:25.339449 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.340860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:25.399746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b7de-9892-40e8-af7c-07f6ba4d8718 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.403342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723467a-e11d-46fe-895a-00a57c01f1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.403950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723467a-e11d-46fe-895a-00a57c01f1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.404227 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723467a-e11d-46fe-895a-00a57c01f1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.404497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723467a-e11d-46fe-895a-00a57c01f1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.414416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723467a-e11d-46fe-895a-00a57c01f1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.415836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723467a-e11d-46fe-895a-00a57c01f1f1 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.425083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1350/2672] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:25.720709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4ecc4-cadd-4680-ae2d-257de16f9255 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.725171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-77f4ecc4-cadd-4680-ae2d-257de16f9255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:25.752775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4ecc4-cadd-4680-ae2d-257de16f9255 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.755781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723467a-e11d-46fe-895a-00a57c01f1f1 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.757371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7723467a-e11d-46fe-895a-00a57c01f1f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:25.760969 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.761454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.761771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.762021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] PATH_INFO: `/v3/projects/554da11d898e41459c50f5c68445a0a2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.763252 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=554da11d898e41459c50f5c68445a0a2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.765295 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.770911 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723467a-e11d-46fe-895a-00a57c01f1f1 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.774995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a1a6f-7c6b-46b6-a2af-a498640bc024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.775600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a1a6f-7c6b-46b6-a2af-a498640bc024 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.775877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a1a6f-7c6b-46b6-a2af-a498640bc024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.776145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a1a6f-7c6b-46b6-a2af-a498640bc024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.778270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a15a1a6f-7c6b-46b6-a2af-a498640bc024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:25.790798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a1a6f-7c6b-46b6-a2af-a498640bc024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.792241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a1a6f-7c6b-46b6-a2af-a498640bc024 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.803747 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1351/2673] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:25.815705 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554da11d898e41459c50f5c68445a0a2', 'request_id': 'req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.823828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554da11d898e41459c50f5c68445a0a2', 'request_id': 'req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.830203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554da11d898e41459c50f5c68445a0a2', 'request_id': 'req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.841319 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] The token cache is being invalidate because project 554da11d898e41459c50f5c68445a0a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:25.841608 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.842249 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.843982 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1323/2674] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:25 2022] DELETE /identity/v3/projects/554da11d898e41459c50f5c68445a0a2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:25.847996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a1a6f-7c6b-46b6-a2af-a498640bc024 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.857694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a1a6f-7c6b-46b6-a2af-a498640bc024 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.916104 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe991a70-adfe-412e-9e0f-e4f1ef5db089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.916649 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe991a70-adfe-412e-9e0f-e4f1ef5db089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.916924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe991a70-adfe-412e-9e0f-e4f1ef5db089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.917196 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe991a70-adfe-412e-9e0f-e4f1ef5db089 admin admin] PATH_INFO: `/v3/users/11eb8e9779ce45c7bc330d91f7969b39` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.918312 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe991a70-adfe-412e-9e0f-e4f1ef5db089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11eb8e9779ce45c7bc330d91f7969b39)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.920267 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe991a70-adfe-412e-9e0f-e4f1ef5db089 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.962601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:25.973315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-fe991a70-adfe-412e-9e0f-e4f1ef5db089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11eb8e9779ce45c7bc330d91f7969b39'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.980590 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-fe991a70-adfe-412e-9e0f-e4f1ef5db089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11eb8e9779ce45c7bc330d91f7969b39'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.993582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-fe991a70-adfe-412e-9e0f-e4f1ef5db089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11eb8e9779ce45c7bc330d91f7969b39'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.994309 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-fe991a70-adfe-412e-9e0f-e4f1ef5db089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11eb8e9779ce45c7bc330d91f7969b39'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:25.994972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-fe991a70-adfe-412e-9e0f-e4f1ef5db089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11eb8e9779ce45c7bc330d91f7969b39'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:26.009023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1352/2675] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:25 2022] DELETE /identity/v3/users/11eb8e9779ce45c7bc330d91f7969b39 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:26.294869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:26.297756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:26.314821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5fc66-d9f4-4b46-af67-a4b8617a81f1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.390473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db616fd-c867-4cdf-aeca-6c5146287691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:26.391123 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db616fd-c867-4cdf-aeca-6c5146287691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.391419 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db616fd-c867-4cdf-aeca-6c5146287691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.391674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db616fd-c867-4cdf-aeca-6c5146287691 admin admin] PATH_INFO: `/v3/projects/bd327080546c46a88049d4542a618a68` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.392787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db616fd-c867-4cdf-aeca-6c5146287691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd327080546c46a88049d4542a618a68)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:26.395399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db616fd-c867-4cdf-aeca-6c5146287691 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:26.445373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0db616fd-c867-4cdf-aeca-6c5146287691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd327080546c46a88049d4542a618a68', 'request_id': 'req-0db616fd-c867-4cdf-aeca-6c5146287691'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:26.449334 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:26.455838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0db616fd-c867-4cdf-aeca-6c5146287691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd327080546c46a88049d4542a618a68', 'request_id': 'req-0db616fd-c867-4cdf-aeca-6c5146287691'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:26.464194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0db616fd-c867-4cdf-aeca-6c5146287691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd327080546c46a88049d4542a618a68', 'request_id': 'req-0db616fd-c867-4cdf-aeca-6c5146287691'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:26.477276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0db616fd-c867-4cdf-aeca-6c5146287691 admin admin] The token cache is being invalidate because project bd327080546c46a88049d4542a618a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:26.477393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0db616fd-c867-4cdf-aeca-6c5146287691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:26.478030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0db616fd-c867-4cdf-aeca-6c5146287691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:26.479599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1324/2676] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:26 2022] DELETE /identity/v3/projects/bd327080546c46a88049d4542a618a68 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:26.484851 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9438d22-bd76-454d-819e-100ff77396b7 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.485879 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9438d22-bd76-454d-819e-100ff77396b7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.486325 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9438d22-bd76-454d-819e-100ff77396b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.508458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b9438d22-bd76-454d-819e-100ff77396b7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:26.509678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b9438d22-bd76-454d-819e-100ff77396b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:26.572439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1353/2677] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:26.580059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297c6c0-ef3b-449c-86e1-a3229b6dc843 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.580351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297c6c0-ef3b-449c-86e1-a3229b6dc843 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.580624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297c6c0-ef3b-449c-86e1-a3229b6dc843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.601031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b297c6c0-ef3b-449c-86e1-a3229b6dc843 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:26.602267 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b297c6c0-ef3b-449c-86e1-a3229b6dc843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:26.610303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1325/2678] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:26.615416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9438d22-bd76-454d-819e-100ff77396b7 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:26.624986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9438d22-bd76-454d-819e-100ff77396b7 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.629610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fc4b4-e4aa-4619-8ecc-01bed4b9fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:26.630234 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fc4b4-e4aa-4619-8ecc-01bed4b9fb27 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.630547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fc4b4-e4aa-4619-8ecc-01bed4b9fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.630821 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fc4b4-e4aa-4619-8ecc-01bed4b9fb27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.631464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fc4b4-e4aa-4619-8ecc-01bed4b9fb27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:26.631768 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fc4b4-e4aa-4619-8ecc-01bed4b9fb27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:26.633354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fc4b4-e4aa-4619-8ecc-01bed4b9fb27 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:26.644952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1354/2679] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:26.649510 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297c6c0-ef3b-449c-86e1-a3229b6dc843 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:26.659263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297c6c0-ef3b-449c-86e1-a3229b6dc843 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.664951 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689001f-adaa-48b0-ab57-7d42b6f8a12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:26.665559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689001f-adaa-48b0-ab57-7d42b6f8a12e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.665838 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689001f-adaa-48b0-ab57-7d42b6f8a12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.666119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689001f-adaa-48b0-ab57-7d42b6f8a12e admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.666808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689001f-adaa-48b0-ab57-7d42b6f8a12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:26.668763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689001f-adaa-48b0-ab57-7d42b6f8a12e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:26.698028 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1326/2680] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:26 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:26.702106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fc4b4-e4aa-4619-8ecc-01bed4b9fb27 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:26.712926 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fc4b4-e4aa-4619-8ecc-01bed4b9fb27 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.772144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451b1b2-d8dd-45e5-8894-c2ede35d7abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:26.772942 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451b1b2-d8dd-45e5-8894-c2ede35d7abe admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.773056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451b1b2-d8dd-45e5-8894-c2ede35d7abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.773332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451b1b2-d8dd-45e5-8894-c2ede35d7abe admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.773960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451b1b2-d8dd-45e5-8894-c2ede35d7abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:26.776026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451b1b2-d8dd-45e5-8894-c2ede35d7abe admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:26.800336 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1355/2681] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:26 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:26.804363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689001f-adaa-48b0-ab57-7d42b6f8a12e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:26.815657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689001f-adaa-48b0-ab57-7d42b6f8a12e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.821529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f1937-3d81-4ede-970e-64bc2b049463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:26.822446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f1937-3d81-4ede-970e-64bc2b049463 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.822797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f1937-3d81-4ede-970e-64bc2b049463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.823135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f1937-3d81-4ede-970e-64bc2b049463 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.823861 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f1937-3d81-4ede-970e-64bc2b049463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:26.825557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f1937-3d81-4ede-970e-64bc2b049463 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:26.840233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1327/2682] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:26.841726 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451b1b2-d8dd-45e5-8894-c2ede35d7abe admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:26.852443 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451b1b2-d8dd-45e5-8894-c2ede35d7abe admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.857243 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e655498-247d-4f76-818b-ddb9bcad0df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:26.857861 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e655498-247d-4f76-818b-ddb9bcad0df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.858134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e655498-247d-4f76-818b-ddb9bcad0df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.858426 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e655498-247d-4f76-818b-ddb9bcad0df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.859071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e655498-247d-4f76-818b-ddb9bcad0df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:26.860682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e655498-247d-4f76-818b-ddb9bcad0df3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:26.876317 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1356/2683] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:26.879020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f1937-3d81-4ede-970e-64bc2b049463 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:26.889767 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f1937-3d81-4ede-970e-64bc2b049463 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.895024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7822036-6d30-42c1-a9c5-71d64bbbec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:26.895733 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7822036-6d30-42c1-a9c5-71d64bbbec6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.896013 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7822036-6d30-42c1-a9c5-71d64bbbec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.896285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7822036-6d30-42c1-a9c5-71d64bbbec6a admin admin] PATH_INFO: `/v3/projects/bc9be125456142acb293722df008c31d/users/365360f3eb7346a69834d291098dd771/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.912918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7822036-6d30-42c1-a9c5-71d64bbbec6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9be125456142acb293722df008c31d, user_id=365360f3eb7346a69834d291098dd771, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:26.916183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7822036-6d30-42c1-a9c5-71d64bbbec6a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:26.932946 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1328/2684] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:26 2022] PUT /identity/v3/projects/bc9be125456142acb293722df008c31d/users/365360f3eb7346a69834d291098dd771/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:26.945233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ea9a-e014-49d2-947b-0931e3b24b43 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.945573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ea9a-e014-49d2-947b-0931e3b24b43 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.945772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ea9a-e014-49d2-947b-0931e3b24b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.977244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-6920ea9a-e014-49d2-947b-0931e3b24b43 None None] MFA Rules not processed for user `365360f3eb7346a69834d291098dd771`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:26.978628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-6920ea9a-e014-49d2-947b-0931e3b24b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:26.986873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:27.053138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1357/2685] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:27.057675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7822036-6d30-42c1-a9c5-71d64bbbec6a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:27.127654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7822036-6d30-42c1-a9c5-71d64bbbec6a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:27.133137 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d2578-17d9-4cf5-8154-3d9e9542e34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:27.133761 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2578-17d9-4cf5-8154-3d9e9542e34e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.134043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2578-17d9-4cf5-8154-3d9e9542e34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.134485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2578-17d9-4cf5-8154-3d9e9542e34e admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:27.135125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d2578-17d9-4cf5-8154-3d9e9542e34e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:27.137047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d2578-17d9-4cf5-8154-3d9e9542e34e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:27.168589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1329/2686] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:27 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:27.173001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920ea9a-e014-49d2-947b-0931e3b24b43 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:27.185782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920ea9a-e014-49d2-947b-0931e3b24b43 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:27.273460 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad7bfd-82e2-46c7-951e-21e92d869acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:27.274081 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad7bfd-82e2-46c7-951e-21e92d869acd admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.274359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad7bfd-82e2-46c7-951e-21e92d869acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.274670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad7bfd-82e2-46c7-951e-21e92d869acd admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:27.275383 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad7bfd-82e2-46c7-951e-21e92d869acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:27.277391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad7bfd-82e2-46c7-951e-21e92d869acd admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:27.303324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1358/2687] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:27 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:27.306515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d2578-17d9-4cf5-8154-3d9e9542e34e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:27.319787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d2578-17d9-4cf5-8154-3d9e9542e34e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:27.323261 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5427f-8a58-4a3b-bf27-3efedc75dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:27.323784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5427f-8a58-4a3b-bf27-3efedc75dffe admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.324069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5427f-8a58-4a3b-bf27-3efedc75dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.324391 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5427f-8a58-4a3b-bf27-3efedc75dffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:27.325195 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5427f-8a58-4a3b-bf27-3efedc75dffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:27.326841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5427f-8a58-4a3b-bf27-3efedc75dffe admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:27.341674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1330/2688] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:27.342861 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad7bfd-82e2-46c7-951e-21e92d869acd admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:27.355302 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad7bfd-82e2-46c7-951e-21e92d869acd admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:27.361061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16492fe0-cdb4-44cf-b009-2eb5c7642886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:27.361855 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16492fe0-cdb4-44cf-b009-2eb5c7642886 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.362132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16492fe0-cdb4-44cf-b009-2eb5c7642886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.362439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16492fe0-cdb4-44cf-b009-2eb5c7642886 admin admin] PATH_INFO: `/v3/projects/8fdd75a2c2ea4043b863ded739f630ec/users/275df765240f441788c0306ccf002574/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:27.398004 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16492fe0-cdb4-44cf-b009-2eb5c7642886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdd75a2c2ea4043b863ded739f630ec, user_id=275df765240f441788c0306ccf002574, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:27.406985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16492fe0-cdb4-44cf-b009-2eb5c7642886 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:27.434425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1359/2689] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:27 2022] PUT /identity/v3/projects/8fdd75a2c2ea4043b863ded739f630ec/users/275df765240f441788c0306ccf002574/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:27.436417 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5427f-8a58-4a3b-bf27-3efedc75dffe admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:27.454974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5427f-8a58-4a3b-bf27-3efedc75dffe admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:27.536053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:27.552368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c76a8b-9343-4035-966e-ca04aa9c1454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:27.554128 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c76a8b-9343-4035-966e-ca04aa9c1454 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.554797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c76a8b-9343-4035-966e-ca04aa9c1454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.555369 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c76a8b-9343-4035-966e-ca04aa9c1454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:27.556672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c76a8b-9343-4035-966e-ca04aa9c1454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:27.559673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c76a8b-9343-4035-966e-ca04aa9c1454 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:27.576939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1331/2690] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:27.580910 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16492fe0-cdb4-44cf-b009-2eb5c7642886 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:27.592571 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16492fe0-cdb4-44cf-b009-2eb5c7642886 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:27.598843 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6504716-dce9-4953-93fe-85a3b0c68e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:27.599605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6504716-dce9-4953-93fe-85a3b0c68e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.599953 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6504716-dce9-4953-93fe-85a3b0c68e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.600456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6504716-dce9-4953-93fe-85a3b0c68e88 admin admin] PATH_INFO: `/v3/projects/8fdd75a2c2ea4043b863ded739f630ec/users/275df765240f441788c0306ccf002574/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:27.602613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6504716-dce9-4953-93fe-85a3b0c68e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdd75a2c2ea4043b863ded739f630ec, user_id=275df765240f441788c0306ccf002574, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:27.605384 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6504716-dce9-4953-93fe-85a3b0c68e88 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:27.626576 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1360/2691] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:27 2022] PUT /identity/v3/projects/8fdd75a2c2ea4043b863ded739f630ec/users/275df765240f441788c0306ccf002574/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:27.628682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555613f-1e5d-4aa1-ab4e-b9df050e01b9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.629057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555613f-1e5d-4aa1-ab4e-b9df050e01b9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.629246 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555613f-1e5d-4aa1-ab4e-b9df050e01b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:27.678416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3555613f-1e5d-4aa1-ab4e-b9df050e01b9 None None] MFA Rules not processed for user `275df765240f441788c0306ccf002574`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:27.678416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3555613f-1e5d-4aa1-ab4e-b9df050e01b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:27.767144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1332/2692] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:27.776051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6504716-dce9-4953-93fe-85a3b0c68e88 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:27.778176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-d6504716-dce9-4953-93fe-85a3b0c68e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:27.845134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6504716-dce9-4953-93fe-85a3b0c68e88 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:27.850521 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26727c50-cdb2-4713-a1b5-e12bcf0c0f8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:27.851209 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26727c50-cdb2-4713-a1b5-e12bcf0c0f8a service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.851553 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26727c50-cdb2-4713-a1b5-e12bcf0c0f8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.851888 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26727c50-cdb2-4713-a1b5-e12bcf0c0f8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:27.861392 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26727c50-cdb2-4713-a1b5-e12bcf0c0f8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:27.863048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26727c50-cdb2-4713-a1b5-e12bcf0c0f8a service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:27.873042 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1361/2693] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:27.959422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555613f-1e5d-4aa1-ab4e-b9df050e01b9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:27.970401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555613f-1e5d-4aa1-ab4e-b9df050e01b9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:27.975934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f164c3-f52b-4b51-9982-27f6fa0b5a0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:27.975934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f164c3-f52b-4b51-9982-27f6fa0b5a0e service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.975934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f164c3-f52b-4b51-9982-27f6fa0b5a0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.975934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f164c3-f52b-4b51-9982-27f6fa0b5a0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:28.037655 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f164c3-f52b-4b51-9982-27f6fa0b5a0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:28.039423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f164c3-f52b-4b51-9982-27f6fa0b5a0e service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:28.048805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1333/2694] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:29.104870 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26727c50-cdb2-4713-a1b5-e12bcf0c0f8a service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:29.106512 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-26727c50-cdb2-4713-a1b5-e12bcf0c0f8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:29.115122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:29.181846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26727c50-cdb2-4713-a1b5-e12bcf0c0f8a service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:29.186364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737d1fe-e7eb-4792-9974-63e8c3b05e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:29.187149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737d1fe-e7eb-4792-9974-63e8c3b05e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.187275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737d1fe-e7eb-4792-9974-63e8c3b05e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.187549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737d1fe-e7eb-4792-9974-63e8c3b05e06 admin admin] PATH_INFO: `/v3/users/83f5ffa7705f46c2b76fd2c8e91a701d` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.188806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737d1fe-e7eb-4792-9974-63e8c3b05e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f5ffa7705f46c2b76fd2c8e91a701d)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:29.191040 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737d1fe-e7eb-4792-9974-63e8c3b05e06 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:29.249160 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8737d1fe-e7eb-4792-9974-63e8c3b05e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f5ffa7705f46c2b76fd2c8e91a701d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:29.256355 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8737d1fe-e7eb-4792-9974-63e8c3b05e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f5ffa7705f46c2b76fd2c8e91a701d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:29.274047 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8737d1fe-e7eb-4792-9974-63e8c3b05e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f5ffa7705f46c2b76fd2c8e91a701d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:29.274809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8737d1fe-e7eb-4792-9974-63e8c3b05e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f5ffa7705f46c2b76fd2c8e91a701d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:29.275425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8737d1fe-e7eb-4792-9974-63e8c3b05e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f5ffa7705f46c2b76fd2c8e91a701d'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:29.291118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1362/2695] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:29 2022] DELETE /identity/v3/users/83f5ffa7705f46c2b76fd2c8e91a701d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:29.497003 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f164c3-f52b-4b51-9982-27f6fa0b5a0e service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:29.509202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f164c3-f52b-4b51-9982-27f6fa0b5a0e service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:29.574891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c74d59-3354-49a6-b68f-43c96758a0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:29.575548 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c74d59-3354-49a6-b68f-43c96758a0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.575900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c74d59-3354-49a6-b68f-43c96758a0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.576243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c74d59-3354-49a6-b68f-43c96758a0bf admin admin] PATH_INFO: `/v3/projects/c626f07e739940ef970f9d386bc21638` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.577405 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c74d59-3354-49a6-b68f-43c96758a0bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c626f07e739940ef970f9d386bc21638)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:29.579444 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c74d59-3354-49a6-b68f-43c96758a0bf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:29.596483 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:29.628133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d9c74d59-3354-49a6-b68f-43c96758a0bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c626f07e739940ef970f9d386bc21638', 'request_id': 'req-d9c74d59-3354-49a6-b68f-43c96758a0bf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:29.636258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d9c74d59-3354-49a6-b68f-43c96758a0bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c626f07e739940ef970f9d386bc21638', 'request_id': 'req-d9c74d59-3354-49a6-b68f-43c96758a0bf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:29.643075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d9c74d59-3354-49a6-b68f-43c96758a0bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c626f07e739940ef970f9d386bc21638', 'request_id': 'req-d9c74d59-3354-49a6-b68f-43c96758a0bf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:29.654244 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d9c74d59-3354-49a6-b68f-43c96758a0bf admin admin] The token cache is being invalidate because project c626f07e739940ef970f9d386bc21638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:29.654577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d9c74d59-3354-49a6-b68f-43c96758a0bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:29.655230 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d9c74d59-3354-49a6-b68f-43c96758a0bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:29.656725 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1334/2696] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:29 2022] DELETE /identity/v3/projects/c626f07e739940ef970f9d386bc21638 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:29.661655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffb810-9638-45fe-a92f-19874434a1eb None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.661936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffb810-9638-45fe-a92f-19874434a1eb None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.662203 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffb810-9638-45fe-a92f-19874434a1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.685938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e8ffb810-9638-45fe-a92f-19874434a1eb None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:29.687194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e8ffb810-9638-45fe-a92f-19874434a1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:29.752997 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1363/2697] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:29.762879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383204ad-0d90-4ed8-a8d6-49c996802e0a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.763217 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383204ad-0d90-4ed8-a8d6-49c996802e0a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.763533 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383204ad-0d90-4ed8-a8d6-49c996802e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.784132 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-383204ad-0d90-4ed8-a8d6-49c996802e0a None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:29.785542 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-383204ad-0d90-4ed8-a8d6-49c996802e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:29.793710 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1335/2698] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:29.798013 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffb810-9638-45fe-a92f-19874434a1eb None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:29.807746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffb810-9638-45fe-a92f-19874434a1eb None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:29.812530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378b38-ba72-4df4-9e78-2913203f2cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:29.813314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378b38-ba72-4df4-9e78-2913203f2cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.813599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378b38-ba72-4df4-9e78-2913203f2cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.813865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378b38-ba72-4df4-9e78-2913203f2cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.814713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53378b38-ba72-4df4-9e78-2913203f2cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:29.815106 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53378b38-ba72-4df4-9e78-2913203f2cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:29.817834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53378b38-ba72-4df4-9e78-2913203f2cdc admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:29.830125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1364/2699] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:29.834314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383204ad-0d90-4ed8-a8d6-49c996802e0a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:29.843642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383204ad-0d90-4ed8-a8d6-49c996802e0a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:29.848464 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde80ee-e519-457f-b3c0-99a69dc9bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:29.849092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde80ee-e519-457f-b3c0-99a69dc9bcac admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.849370 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde80ee-e519-457f-b3c0-99a69dc9bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.849642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde80ee-e519-457f-b3c0-99a69dc9bcac admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.850268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde80ee-e519-457f-b3c0-99a69dc9bcac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:29.852203 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde80ee-e519-457f-b3c0-99a69dc9bcac admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:29.879479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1336/2700] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:29 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:29.883795 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378b38-ba72-4df4-9e78-2913203f2cdc admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:29.893741 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378b38-ba72-4df4-9e78-2913203f2cdc admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:29.901927 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:29.953046 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e98e75-f2e7-4810-a967-9041fa1ae4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:29.953659 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98e75-f2e7-4810-a967-9041fa1ae4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.953939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98e75-f2e7-4810-a967-9041fa1ae4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.954210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98e75-f2e7-4810-a967-9041fa1ae4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.954863 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e98e75-f2e7-4810-a967-9041fa1ae4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:29.957317 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e98e75-f2e7-4810-a967-9041fa1ae4a6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:29.980827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1365/2701] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:29 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:29.985382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde80ee-e519-457f-b3c0-99a69dc9bcac admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:29.996560 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde80ee-e519-457f-b3c0-99a69dc9bcac admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.001348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9604e-e4b6-4dea-a52b-4ebfae9083e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.002007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9604e-e4b6-4dea-a52b-4ebfae9083e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.002286 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9604e-e4b6-4dea-a52b-4ebfae9083e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.002605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9604e-e4b6-4dea-a52b-4ebfae9083e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.003384 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9604e-e4b6-4dea-a52b-4ebfae9083e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.004883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9604e-e4b6-4dea-a52b-4ebfae9083e9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.016146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1337/2702] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:30.020890 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e98e75-f2e7-4810-a967-9041fa1ae4a6 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.031652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e98e75-f2e7-4810-a967-9041fa1ae4a6 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.037036 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83ac6c-f09d-4ba8-9532-5d7d0aa3af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.037658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ac6c-f09d-4ba8-9532-5d7d0aa3af44 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.037938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ac6c-f09d-4ba8-9532-5d7d0aa3af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.038213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ac6c-f09d-4ba8-9532-5d7d0aa3af44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.039159 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83ac6c-f09d-4ba8-9532-5d7d0aa3af44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.040787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83ac6c-f09d-4ba8-9532-5d7d0aa3af44 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.052373 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1366/2703] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:30.057007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9604e-e4b6-4dea-a52b-4ebfae9083e9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.068082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9604e-e4b6-4dea-a52b-4ebfae9083e9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.072807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bf7a8-408e-48d2-b3cb-86d3d2ea054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.073489 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bf7a8-408e-48d2-b3cb-86d3d2ea054a admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.073797 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bf7a8-408e-48d2-b3cb-86d3d2ea054a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.074073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bf7a8-408e-48d2-b3cb-86d3d2ea054a admin admin] PATH_INFO: `/v3/projects/237010c1e17f4c5890fcac4b8eec8f55/users/afbc25f2874b44a181d9e73abd301aa8/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.090630 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bf7a8-408e-48d2-b3cb-86d3d2ea054a admin admin] RBAC: Authorizing `identity:create_grant(project_id=237010c1e17f4c5890fcac4b8eec8f55, user_id=afbc25f2874b44a181d9e73abd301aa8, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.093233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bf7a8-408e-48d2-b3cb-86d3d2ea054a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.108742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1338/2704] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:30 2022] PUT /identity/v3/projects/237010c1e17f4c5890fcac4b8eec8f55/users/afbc25f2874b44a181d9e73abd301aa8/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:30.119578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191d276-a213-446c-89d0-afd322ff4027 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.120168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191d276-a213-446c-89d0-afd322ff4027 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.120279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191d276-a213-446c-89d0-afd322ff4027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.150697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b191d276-a213-446c-89d0-afd322ff4027 None None] MFA Rules not processed for user `afbc25f2874b44a181d9e73abd301aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:30.152113 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b191d276-a213-446c-89d0-afd322ff4027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:30.221677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1367/2705] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:30.227062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bf7a8-408e-48d2-b3cb-86d3d2ea054a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.291337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bf7a8-408e-48d2-b3cb-86d3d2ea054a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.296494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1a0f8-dd31-4b0a-ac1c-bd4240b8c8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.297104 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1a0f8-dd31-4b0a-ac1c-bd4240b8c8ec admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.297377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1a0f8-dd31-4b0a-ac1c-bd4240b8c8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.297666 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1a0f8-dd31-4b0a-ac1c-bd4240b8c8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.298304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1a0f8-dd31-4b0a-ac1c-bd4240b8c8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.300256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1a0f8-dd31-4b0a-ac1c-bd4240b8c8ec admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.329172 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1339/2706] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:30 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:30.333814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191d276-a213-446c-89d0-afd322ff4027 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.344505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191d276-a213-446c-89d0-afd322ff4027 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.409476 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb29d96-80ec-4f3b-9652-8e874dadd114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.410121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb29d96-80ec-4f3b-9652-8e874dadd114 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.410439 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb29d96-80ec-4f3b-9652-8e874dadd114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.410720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb29d96-80ec-4f3b-9652-8e874dadd114 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.411360 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb29d96-80ec-4f3b-9652-8e874dadd114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.415353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb29d96-80ec-4f3b-9652-8e874dadd114 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.438195 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1368/2707] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:30 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:30.442547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1a0f8-dd31-4b0a-ac1c-bd4240b8c8ec admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.453023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1a0f8-dd31-4b0a-ac1c-bd4240b8c8ec admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.458768 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cff7f-0884-4c06-9ed0-651f1808ab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.459411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cff7f-0884-4c06-9ed0-651f1808ab5f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.459723 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cff7f-0884-4c06-9ed0-651f1808ab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.460024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cff7f-0884-4c06-9ed0-651f1808ab5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.460793 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cff7f-0884-4c06-9ed0-651f1808ab5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.463473 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cff7f-0884-4c06-9ed0-651f1808ab5f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.478335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1340/2708] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:30.479462 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb29d96-80ec-4f3b-9652-8e874dadd114 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.490092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb29d96-80ec-4f3b-9652-8e874dadd114 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.494645 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5a0a-946a-4807-8302-d737a8b7d753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.495493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5a0a-946a-4807-8302-d737a8b7d753 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.495769 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5a0a-946a-4807-8302-d737a8b7d753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.496126 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5a0a-946a-4807-8302-d737a8b7d753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.496757 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5a0a-946a-4807-8302-d737a8b7d753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.498328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5a0a-946a-4807-8302-d737a8b7d753 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.500663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:30.513662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1369/2709] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:38:30.514826 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cff7f-0884-4c06-9ed0-651f1808ab5f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.525966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cff7f-0884-4c06-9ed0-651f1808ab5f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.530785 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45277eee-d571-42e7-a21c-ee84eceaf2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.531516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45277eee-d571-42e7-a21c-ee84eceaf2b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.531889 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45277eee-d571-42e7-a21c-ee84eceaf2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.532346 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45277eee-d571-42e7-a21c-ee84eceaf2b5 admin admin] PATH_INFO: `/v3/projects/436f314192d24026ad44374dc2ada638/users/925699e1b3974067b1f8346aadcd0ff1/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.545125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:30.551527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45277eee-d571-42e7-a21c-ee84eceaf2b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436f314192d24026ad44374dc2ada638, user_id=925699e1b3974067b1f8346aadcd0ff1, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.555039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45277eee-d571-42e7-a21c-ee84eceaf2b5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.570109 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1341/2710] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:30 2022] PUT /identity/v3/projects/436f314192d24026ad44374dc2ada638/users/925699e1b3974067b1f8346aadcd0ff1/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:30.582170 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d384a6-5476-4e4e-affd-99fd882710f4 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.582499 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d384a6-5476-4e4e-affd-99fd882710f4 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.582789 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d384a6-5476-4e4e-affd-99fd882710f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.610579 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e0d384a6-5476-4e4e-affd-99fd882710f4 None None] MFA Rules not processed for user `925699e1b3974067b1f8346aadcd0ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:30.611802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e0d384a6-5476-4e4e-affd-99fd882710f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:30.681915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1370/2711] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:30.686755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45277eee-d571-42e7-a21c-ee84eceaf2b5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.761351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45277eee-d571-42e7-a21c-ee84eceaf2b5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.771448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aebf70-444a-4b2d-abb1-1244c7aeeb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.772151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aebf70-444a-4b2d-abb1-1244c7aeeb97 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.772548 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aebf70-444a-4b2d-abb1-1244c7aeeb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.772979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aebf70-444a-4b2d-abb1-1244c7aeeb97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.773842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aebf70-444a-4b2d-abb1-1244c7aeeb97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.776043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aebf70-444a-4b2d-abb1-1244c7aeeb97 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.822788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1342/2712] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:30 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:30.826793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d384a6-5476-4e4e-affd-99fd882710f4 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.839584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d384a6-5476-4e4e-affd-99fd882710f4 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.864329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aebf70-444a-4b2d-abb1-1244c7aeeb97 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.866113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-77aebf70-444a-4b2d-abb1-1244c7aeeb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:30.907841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9878e-c1b9-4dcc-aee4-a46f121966c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.908452 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9878e-c1b9-4dcc-aee4-a46f121966c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.908730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9878e-c1b9-4dcc-aee4-a46f121966c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.909003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9878e-c1b9-4dcc-aee4-a46f121966c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.909685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9878e-c1b9-4dcc-aee4-a46f121966c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.911636 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9878e-c1b9-4dcc-aee4-a46f121966c6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.935068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1371/2713] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:30 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:30.936198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aebf70-444a-4b2d-abb1-1244c7aeeb97 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.939103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9878e-c1b9-4dcc-aee4-a46f121966c6 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.942487 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b70e37-13e4-4e6f-8ea8-d0d0e639dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.943133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b70e37-13e4-4e6f-8ea8-d0d0e639dc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.943414 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b70e37-13e4-4e6f-8ea8-d0d0e639dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.943689 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b70e37-13e4-4e6f-8ea8-d0d0e639dc3d admin admin] PATH_INFO: `/v3/users/365360f3eb7346a69834d291098dd771` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.944833 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b70e37-13e4-4e6f-8ea8-d0d0e639dc3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=365360f3eb7346a69834d291098dd771)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.946808 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b70e37-13e4-4e6f-8ea8-d0d0e639dc3d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.949968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9878e-c1b9-4dcc-aee4-a46f121966c6 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.954958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53255e3-4b14-4df9-8a3c-4c27e9f53939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.955560 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53255e3-4b14-4df9-8a3c-4c27e9f53939 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.955841 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53255e3-4b14-4df9-8a3c-4c27e9f53939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.956116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53255e3-4b14-4df9-8a3c-4c27e9f53939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.956873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53255e3-4b14-4df9-8a3c-4c27e9f53939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.958575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53255e3-4b14-4df9-8a3c-4c27e9f53939 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.971680 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1372/2714] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:38:30.973370 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53255e3-4b14-4df9-8a3c-4c27e9f53939 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.985121 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53255e3-4b14-4df9-8a3c-4c27e9f53939 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.990624 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ea6a2-ab24-4ed8-ac41-3f36cdcf65a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.991275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ea6a2-ab24-4ed8-ac41-3f36cdcf65a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.991555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ea6a2-ab24-4ed8-ac41-3f36cdcf65a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.991830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ea6a2-ab24-4ed8-ac41-3f36cdcf65a2 admin admin] PATH_INFO: `/v3/projects/17990c3f634243cab0c7bed41e2aed98/users/4235bbc4a9974bc6b6bb1ff72a68fbf9/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.998727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38b70e37-13e4-4e6f-8ea8-d0d0e639dc3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365360f3eb7346a69834d291098dd771'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:31.007407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38b70e37-13e4-4e6f-8ea8-d0d0e639dc3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365360f3eb7346a69834d291098dd771'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:31.010846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ea6a2-ab24-4ed8-ac41-3f36cdcf65a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17990c3f634243cab0c7bed41e2aed98, user_id=4235bbc4a9974bc6b6bb1ff72a68fbf9, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:31.014084 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ea6a2-ab24-4ed8-ac41-3f36cdcf65a2 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:31.021814 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38b70e37-13e4-4e6f-8ea8-d0d0e639dc3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365360f3eb7346a69834d291098dd771'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:31.022879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38b70e37-13e4-4e6f-8ea8-d0d0e639dc3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365360f3eb7346a69834d291098dd771'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:31.023509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38b70e37-13e4-4e6f-8ea8-d0d0e639dc3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365360f3eb7346a69834d291098dd771'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:31.026165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:31.030982 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1373/2715] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:30 2022] PUT /identity/v3/projects/17990c3f634243cab0c7bed41e2aed98/users/4235bbc4a9974bc6b6bb1ff72a68fbf9/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:31.035821 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ea6a2-ab24-4ed8-ac41-3f36cdcf65a2 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:31.037604 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a32ea6a2-ab24-4ed8-ac41-3f36cdcf65a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:31.042835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1343/2716] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:30 2022] DELETE /identity/v3/users/365360f3eb7346a69834d291098dd771 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:31.047159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0feca-cda7-48d5-8306-692f928b5f4c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.047455 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0feca-cda7-48d5-8306-692f928b5f4c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.047815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0feca-cda7-48d5-8306-692f928b5f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.071981 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c1f0feca-cda7-48d5-8306-692f928b5f4c None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:31.073232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c1f0feca-cda7-48d5-8306-692f928b5f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:31.092435 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:31.113031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ea6a2-ab24-4ed8-ac41-3f36cdcf65a2 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:31.137113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1344/2717] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:31.147770 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0feca-cda7-48d5-8306-692f928b5f4c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:31.149314 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c1f0feca-cda7-48d5-8306-692f928b5f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:31.180292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcecbf5-a0e8-4f05-b92b-751d0474e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:31.180831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcecbf5-a0e8-4f05-b92b-751d0474e48a admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.181065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcecbf5-a0e8-4f05-b92b-751d0474e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.181331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcecbf5-a0e8-4f05-b92b-751d0474e48a admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.181959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcecbf5-a0e8-4f05-b92b-751d0474e48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:31.183607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcecbf5-a0e8-4f05-b92b-751d0474e48a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:31.196412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1374/2718] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:31.201103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcecbf5-a0e8-4f05-b92b-751d0474e48a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:31.217432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcecbf5-a0e8-4f05-b92b-751d0474e48a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:31.221435 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0feca-cda7-48d5-8306-692f928b5f4c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:31.224459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0db51-7b35-48a7-90aa-ea3e6a729fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:31.225125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0db51-7b35-48a7-90aa-ea3e6a729fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.225251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b40324-35cf-4e74-bc33-6bfc9d06a934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:31.225402 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0db51-7b35-48a7-90aa-ea3e6a729fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.225671 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0db51-7b35-48a7-90aa-ea3e6a729fb2 admin admin] PATH_INFO: `/v3/projects/17990c3f634243cab0c7bed41e2aed98/users/4235bbc4a9974bc6b6bb1ff72a68fbf9/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.225858 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b40324-35cf-4e74-bc33-6bfc9d06a934 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.226137 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b40324-35cf-4e74-bc33-6bfc9d06a934 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.226577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b40324-35cf-4e74-bc33-6bfc9d06a934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.227921 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0db51-7b35-48a7-90aa-ea3e6a729fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17990c3f634243cab0c7bed41e2aed98, user_id=4235bbc4a9974bc6b6bb1ff72a68fbf9, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:31.232382 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0db51-7b35-48a7-90aa-ea3e6a729fb2 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:31.236486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b40324-35cf-4e74-bc33-6bfc9d06a934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:31.238072 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b40324-35cf-4e74-bc33-6bfc9d06a934 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:31.244950 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1375/2719] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:31 2022] PUT /identity/v3/projects/17990c3f634243cab0c7bed41e2aed98/users/4235bbc4a9974bc6b6bb1ff72a68fbf9/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:31.249637 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1345/2720] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:31.255918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed2db-8c14-425c-a8a0-fd2a9e6a5f08 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.256363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed2db-8c14-425c-a8a0-fd2a9e6a5f08 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.256713 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed2db-8c14-425c-a8a0-fd2a9e6a5f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.287092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-23aed2db-8c14-425c-a8a0-fd2a9e6a5f08 None None] MFA Rules not processed for user `4235bbc4a9974bc6b6bb1ff72a68fbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:31.288247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-23aed2db-8c14-425c-a8a0-fd2a9e6a5f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:31.382456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1376/2721] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:31.396741 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b40324-35cf-4e74-bc33-6bfc9d06a934 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:31.398953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-52b40324-35cf-4e74-bc33-6bfc9d06a934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:31.464475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b40324-35cf-4e74-bc33-6bfc9d06a934 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:31.526795 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d341-0d69-4495-b040-21886ce05640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:31.527553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d341-0d69-4495-b040-21886ce05640 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.527696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d341-0d69-4495-b040-21886ce05640 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.527970 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d341-0d69-4495-b040-21886ce05640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.538575 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:31.541497 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4d341-0d69-4495-b040-21886ce05640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:31.543565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4d341-0d69-4495-b040-21886ce05640 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:31.557222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1346/2722] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:31.781680 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed2db-8c14-425c-a8a0-fd2a9e6a5f08 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:31.781680 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-23aed2db-8c14-425c-a8a0-fd2a9e6a5f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:31.871323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:31.876414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed2db-8c14-425c-a8a0-fd2a9e6a5f08 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:31.882362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:31.883035 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.883294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.883620 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] PATH_INFO: `/v3/projects/bc9be125456142acb293722df008c31d` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.884699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9be125456142acb293722df008c31d)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:31.886628 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:31.939903 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9be125456142acb293722df008c31d', 'request_id': 'req-78c58c4d-3f99-4729-90bc-9db13e40d335'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:31.947359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9be125456142acb293722df008c31d', 'request_id': 'req-78c58c4d-3f99-4729-90bc-9db13e40d335'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:31.953419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9be125456142acb293722df008c31d', 'request_id': 'req-78c58c4d-3f99-4729-90bc-9db13e40d335'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:31.967756 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] The token cache is being invalidate because project bc9be125456142acb293722df008c31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:31.968055 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:31.968676 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:31.970145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1377/2723] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:31 2022] DELETE /identity/v3/projects/bc9be125456142acb293722df008c31d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:31.974909 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d341-0d69-4495-b040-21886ce05640 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:31.986615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d341-0d69-4495-b040-21886ce05640 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:32.051103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:32.051802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:32.052155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:32.052506 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] PATH_INFO: `/v3/users/275df765240f441788c0306ccf002574` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:32.053647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=275df765240f441788c0306ccf002574)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:32.055609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:32.111245 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275df765240f441788c0306ccf002574'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:32.119653 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275df765240f441788c0306ccf002574'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:32.135933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275df765240f441788c0306ccf002574'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:32.136626 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275df765240f441788c0306ccf002574'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:32.137229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275df765240f441788c0306ccf002574'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:32.149925 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:32.151466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:32.157530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1347/2724] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:31 2022] DELETE /identity/v3/users/275df765240f441788c0306ccf002574 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:32.215518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c58c4d-3f99-4729-90bc-9db13e40d335 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:32.276416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f48a8d-54e1-4579-9099-ce29a806371e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:32.276416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48a8d-54e1-4579-9099-ce29a806371e service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:32.276702 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48a8d-54e1-4579-9099-ce29a806371e service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:32.276804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48a8d-54e1-4579-9099-ce29a806371e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:32.278627 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-48f48a8d-54e1-4579-9099-ce29a806371e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:32.348506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f48a8d-54e1-4579-9099-ce29a806371e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:32.350134 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f48a8d-54e1-4579-9099-ce29a806371e service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:32.355719 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:32.360736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1378/2725] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:32.463436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:32.465400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:32.557212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9bbd1-8542-4f74-8f19-7df4bb9e3e9c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:32.562285 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b08968-a9f6-44b1-89c6-24a5df0a46eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:32.563071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b08968-a9f6-44b1-89c6-24a5df0a46eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:32.563354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b08968-a9f6-44b1-89c6-24a5df0a46eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:32.563625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b08968-a9f6-44b1-89c6-24a5df0a46eb admin admin] PATH_INFO: `/v3/projects/8fdd75a2c2ea4043b863ded739f630ec` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:32.564799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b08968-a9f6-44b1-89c6-24a5df0a46eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fdd75a2c2ea4043b863ded739f630ec)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:32.567893 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b08968-a9f6-44b1-89c6-24a5df0a46eb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:32.588899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:32.623622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-68b08968-a9f6-44b1-89c6-24a5df0a46eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fdd75a2c2ea4043b863ded739f630ec', 'request_id': 'req-68b08968-a9f6-44b1-89c6-24a5df0a46eb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:32.637873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-68b08968-a9f6-44b1-89c6-24a5df0a46eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fdd75a2c2ea4043b863ded739f630ec', 'request_id': 'req-68b08968-a9f6-44b1-89c6-24a5df0a46eb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:32.644927 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-68b08968-a9f6-44b1-89c6-24a5df0a46eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fdd75a2c2ea4043b863ded739f630ec', 'request_id': 'req-68b08968-a9f6-44b1-89c6-24a5df0a46eb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:32.661365 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-68b08968-a9f6-44b1-89c6-24a5df0a46eb admin admin] The token cache is being invalidate because project 8fdd75a2c2ea4043b863ded739f630ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:32.661726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-68b08968-a9f6-44b1-89c6-24a5df0a46eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:32.662709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-68b08968-a9f6-44b1-89c6-24a5df0a46eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:32.665144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1348/2726] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:32 2022] DELETE /identity/v3/projects/8fdd75a2c2ea4043b863ded739f630ec => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:32.669620 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed87b8d-ba71-4882-b87c-949f9f7b62fe None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:32.669901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed87b8d-ba71-4882-b87c-949f9f7b62fe None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:32.670174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed87b8d-ba71-4882-b87c-949f9f7b62fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:32.709076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-8ed87b8d-ba71-4882-b87c-949f9f7b62fe None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:32.710467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8ed87b8d-ba71-4882-b87c-949f9f7b62fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:32.775643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1379/2727] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:32.784860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5a9ce-a39f-43a1-9f4f-feb2535767cf None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:32.785094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5a9ce-a39f-43a1-9f4f-feb2535767cf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:32.785378 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5a9ce-a39f-43a1-9f4f-feb2535767cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:32.805577 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-90c5a9ce-a39f-43a1-9f4f-feb2535767cf None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:32.806835 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-90c5a9ce-a39f-43a1-9f4f-feb2535767cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:32.814709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1349/2728] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:32.819504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed87b8d-ba71-4882-b87c-949f9f7b62fe None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:32.828880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed87b8d-ba71-4882-b87c-949f9f7b62fe None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:32.834273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21173-5641-473d-b411-4758b297239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:32.834896 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21173-5641-473d-b411-4758b297239f admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:32.835176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21173-5641-473d-b411-4758b297239f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:32.835448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21173-5641-473d-b411-4758b297239f admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:32.836114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d21173-5641-473d-b411-4758b297239f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:32.836416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d21173-5641-473d-b411-4758b297239f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:32.838001 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d21173-5641-473d-b411-4758b297239f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:32.849606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1380/2729] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:32.853781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5a9ce-a39f-43a1-9f4f-feb2535767cf None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:32.863839 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5a9ce-a39f-43a1-9f4f-feb2535767cf None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:32.868624 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98ef8-3cba-4020-83bd-3c0f0f821a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:32.869224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98ef8-3cba-4020-83bd-3c0f0f821a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:32.869500 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98ef8-3cba-4020-83bd-3c0f0f821a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:32.869771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98ef8-3cba-4020-83bd-3c0f0f821a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:32.870437 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e98ef8-3cba-4020-83bd-3c0f0f821a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:32.872350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e98ef8-3cba-4020-83bd-3c0f0f821a73 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:32.900595 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1350/2730] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:32 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:32.904826 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21173-5641-473d-b411-4758b297239f admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:32.916181 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21173-5641-473d-b411-4758b297239f admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:32.974564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568c575-4a28-4c99-a208-7229c593a982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:32.975171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568c575-4a28-4c99-a208-7229c593a982 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:32.975451 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568c575-4a28-4c99-a208-7229c593a982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:32.975724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568c575-4a28-4c99-a208-7229c593a982 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:32.976357 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568c575-4a28-4c99-a208-7229c593a982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:32.978308 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568c575-4a28-4c99-a208-7229c593a982 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:32.999872 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1381/2731] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:32 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:33.006438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98ef8-3cba-4020-83bd-3c0f0f821a73 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:33.017041 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98ef8-3cba-4020-83bd-3c0f0f821a73 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:33.022631 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43ed49-6959-4f6f-80f9-6488709641a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:33.023231 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43ed49-6959-4f6f-80f9-6488709641a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.023512 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43ed49-6959-4f6f-80f9-6488709641a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.023784 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43ed49-6959-4f6f-80f9-6488709641a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.024415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43ed49-6959-4f6f-80f9-6488709641a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:33.026015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43ed49-6959-4f6f-80f9-6488709641a4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:33.038130 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1351/2732] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:33.042437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568c575-4a28-4c99-a208-7229c593a982 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:33.053545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568c575-4a28-4c99-a208-7229c593a982 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:33.058564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a63ee-5bf2-4381-84d5-c76f777a95a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:33.059273 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a63ee-5bf2-4381-84d5-c76f777a95a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.059555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a63ee-5bf2-4381-84d5-c76f777a95a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.059985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a63ee-5bf2-4381-84d5-c76f777a95a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.060636 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a63ee-5bf2-4381-84d5-c76f777a95a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:33.062250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a63ee-5bf2-4381-84d5-c76f777a95a4 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:33.073873 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1382/2733] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:33.078193 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43ed49-6959-4f6f-80f9-6488709641a4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:33.088437 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43ed49-6959-4f6f-80f9-6488709641a4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:33.093310 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115b89c-e5b9-4e31-a1de-d1750bfe1938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:33.093959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115b89c-e5b9-4e31-a1de-d1750bfe1938 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.094237 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115b89c-e5b9-4e31-a1de-d1750bfe1938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.094541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115b89c-e5b9-4e31-a1de-d1750bfe1938 admin admin] PATH_INFO: `/v3/projects/7fba9033f30d46d7aa7dc4ab6cff7b74/users/e71c509afef8467d90272af17cdac757/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.109481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115b89c-e5b9-4e31-a1de-d1750bfe1938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fba9033f30d46d7aa7dc4ab6cff7b74, user_id=e71c509afef8467d90272af17cdac757, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:33.112168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115b89c-e5b9-4e31-a1de-d1750bfe1938 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:33.129228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1352/2734] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:33 2022] PUT /identity/v3/projects/7fba9033f30d46d7aa7dc4ab6cff7b74/users/e71c509afef8467d90272af17cdac757/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:33.140010 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07296c-5de0-4e95-a315-82e8ac48588d None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.140230 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07296c-5de0-4e95-a315-82e8ac48588d None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.140501 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07296c-5de0-4e95-a315-82e8ac48588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.170655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-cf07296c-5de0-4e95-a315-82e8ac48588d None None] MFA Rules not processed for user `e71c509afef8467d90272af17cdac757`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:33.171891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cf07296c-5de0-4e95-a315-82e8ac48588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:33.227685 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:33.239102 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1383/2735] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:33.243792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115b89c-e5b9-4e31-a1de-d1750bfe1938 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:33.310615 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115b89c-e5b9-4e31-a1de-d1750bfe1938 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:33.315393 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54199b72-dc28-47a0-8e03-78f0e8cacecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:33.316206 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54199b72-dc28-47a0-8e03-78f0e8cacecd admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.316495 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54199b72-dc28-47a0-8e03-78f0e8cacecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.316772 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54199b72-dc28-47a0-8e03-78f0e8cacecd admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.317424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54199b72-dc28-47a0-8e03-78f0e8cacecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:33.319415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54199b72-dc28-47a0-8e03-78f0e8cacecd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:33.345990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1353/2736] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:33 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:33.351353 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07296c-5de0-4e95-a315-82e8ac48588d None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:33.361912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07296c-5de0-4e95-a315-82e8ac48588d None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:33.423487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c2477-b993-42a9-afbf-52671449c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:33.424050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2477-b993-42a9-afbf-52671449c102 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.424326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2477-b993-42a9-afbf-52671449c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.424589 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2477-b993-42a9-afbf-52671449c102 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.425919 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c2477-b993-42a9-afbf-52671449c102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:33.428253 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c2477-b993-42a9-afbf-52671449c102 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:33.449667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1384/2737] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:33 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:33.453776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54199b72-dc28-47a0-8e03-78f0e8cacecd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:33.464426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54199b72-dc28-47a0-8e03-78f0e8cacecd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:33.469091 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8021cc-ce81-49ac-932c-7c748d88cf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:33.469699 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8021cc-ce81-49ac-932c-7c748d88cf97 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.469978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8021cc-ce81-49ac-932c-7c748d88cf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.470251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8021cc-ce81-49ac-932c-7c748d88cf97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.470955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8021cc-ce81-49ac-932c-7c748d88cf97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:33.473292 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8021cc-ce81-49ac-932c-7c748d88cf97 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:33.485708 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1354/2738] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:38:33.490569 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c2477-b993-42a9-afbf-52671449c102 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:33.501041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c2477-b993-42a9-afbf-52671449c102 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:33.506874 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb94e4-560f-4fd1-b264-d2d3b3d9dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:33.507567 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb94e4-560f-4fd1-b264-d2d3b3d9dccd admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.507847 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb94e4-560f-4fd1-b264-d2d3b3d9dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.508116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb94e4-560f-4fd1-b264-d2d3b3d9dccd admin admin] PATH_INFO: `/v3/projects/9d90f6802c8246049c8b39d33d9011f5/users/8ce1554277d4488897a460d2ba434036/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.523600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb94e4-560f-4fd1-b264-d2d3b3d9dccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d90f6802c8246049c8b39d33d9011f5, user_id=8ce1554277d4488897a460d2ba434036, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:33.526249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb94e4-560f-4fd1-b264-d2d3b3d9dccd admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:33.540293 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1385/2739] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:33 2022] PUT /identity/v3/projects/9d90f6802c8246049c8b39d33d9011f5/users/8ce1554277d4488897a460d2ba434036/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:33.544471 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8021cc-ce81-49ac-932c-7c748d88cf97 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:33.554955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8021cc-ce81-49ac-932c-7c748d88cf97 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:33.566709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:33.615029 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d793d-13e6-401d-a6e8-aa7b17353d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:33.615643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d793d-13e6-401d-a6e8-aa7b17353d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.615920 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d793d-13e6-401d-a6e8-aa7b17353d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.616189 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d793d-13e6-401d-a6e8-aa7b17353d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.616821 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d793d-13e6-401d-a6e8-aa7b17353d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:33.618415 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d793d-13e6-401d-a6e8-aa7b17353d3d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:33.628098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1355/2740] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:33.632352 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb94e4-560f-4fd1-b264-d2d3b3d9dccd admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:33.643092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb94e4-560f-4fd1-b264-d2d3b3d9dccd admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:33.648479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a0828-f444-4f5e-8681-92f8c06fe6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:33.649138 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a0828-f444-4f5e-8681-92f8c06fe6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.649419 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a0828-f444-4f5e-8681-92f8c06fe6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.649692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a0828-f444-4f5e-8681-92f8c06fe6ca admin admin] PATH_INFO: `/v3/projects/9d90f6802c8246049c8b39d33d9011f5/users/8ce1554277d4488897a460d2ba434036/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.651610 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a0828-f444-4f5e-8681-92f8c06fe6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d90f6802c8246049c8b39d33d9011f5, user_id=8ce1554277d4488897a460d2ba434036, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:33.654573 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a0828-f444-4f5e-8681-92f8c06fe6ca admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:33.666011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1386/2741] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:33 2022] PUT /identity/v3/projects/9d90f6802c8246049c8b39d33d9011f5/users/8ce1554277d4488897a460d2ba434036/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:33.676884 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97931313-f706-4a97-8c1e-eaaf70fb4fdd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.677097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97931313-f706-4a97-8c1e-eaaf70fb4fdd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.677373 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97931313-f706-4a97-8c1e-eaaf70fb4fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.706112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-97931313-f706-4a97-8c1e-eaaf70fb4fdd None None] MFA Rules not processed for user `8ce1554277d4488897a460d2ba434036`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:33.708226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-97931313-f706-4a97-8c1e-eaaf70fb4fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:33.786096 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1356/2742] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:33 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:33.797470 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a0828-f444-4f5e-8681-92f8c06fe6ca admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:33.799286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-fd6a0828-f444-4f5e-8681-92f8c06fe6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:33.863464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a0828-f444-4f5e-8681-92f8c06fe6ca admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:33.867258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fe2fd-639a-4c2f-b646-a1730115d314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:33.867972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fe2fd-639a-4c2f-b646-a1730115d314 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.868249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fe2fd-639a-4c2f-b646-a1730115d314 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.868596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fe2fd-639a-4c2f-b646-a1730115d314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.879487 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fe2fd-639a-4c2f-b646-a1730115d314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:33.880952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fe2fd-639a-4c2f-b646-a1730115d314 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:33.891132 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1387/2743] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:33.951825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97931313-f706-4a97-8c1e-eaaf70fb4fdd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:33.962751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97931313-f706-4a97-8c1e-eaaf70fb4fdd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:33.966806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54902fb2-1237-43c8-968f-d93d9a1790a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:33.967414 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54902fb2-1237-43c8-968f-d93d9a1790a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.967697 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54902fb2-1237-43c8-968f-d93d9a1790a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.967972 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54902fb2-1237-43c8-968f-d93d9a1790a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:34.027667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54902fb2-1237-43c8-968f-d93d9a1790a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:34.029111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54902fb2-1237-43c8-968f-d93d9a1790a4 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:34.038355 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1357/2744] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:36.480664 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fe2fd-639a-4c2f-b646-a1730115d314 service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:36.481815 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9e1fe2fd-639a-4c2f-b646-a1730115d314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:36.494171 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fe2fd-639a-4c2f-b646-a1730115d314 service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:36.497890 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e78b80-dc37-4a19-a590-8ade85bddb60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:36.498533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e78b80-dc37-4a19-a590-8ade85bddb60 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:36.498808 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e78b80-dc37-4a19-a590-8ade85bddb60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:36.499097 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e78b80-dc37-4a19-a590-8ade85bddb60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:36.501074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-83e78b80-dc37-4a19-a590-8ade85bddb60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:36.549960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:36.565328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e78b80-dc37-4a19-a590-8ade85bddb60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:36.566904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e78b80-dc37-4a19-a590-8ade85bddb60 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:36.575715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1388/2745] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:37.349910 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54902fb2-1237-43c8-968f-d93d9a1790a4 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:37.392431 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:37.419023 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54902fb2-1237-43c8-968f-d93d9a1790a4 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:37.423960 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:37.424599 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:37.424875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:37.425183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] PATH_INFO: `/v3/users/e71c509afef8467d90272af17cdac757` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:37.426371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e71c509afef8467d90272af17cdac757)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:37.428326 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:37.477294 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e71c509afef8467d90272af17cdac757'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:37.484585 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e71c509afef8467d90272af17cdac757'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:37.496267 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e71c509afef8467d90272af17cdac757'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:37.497017 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e71c509afef8467d90272af17cdac757'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:37.497570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e71c509afef8467d90272af17cdac757'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:37.510640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1358/2746] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:37 2022] DELETE /identity/v3/users/e71c509afef8467d90272af17cdac757 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:37.515452 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440e8f2-c558-4910-ab8c-7108e553e35b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:37.515952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440e8f2-c558-4910-ab8c-7108e553e35b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:37.516074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440e8f2-c558-4910-ab8c-7108e553e35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:37.536073 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-e440e8f2-c558-4910-ab8c-7108e553e35b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:37.537279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e440e8f2-c558-4910-ab8c-7108e553e35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:37.599051 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1389/2747] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:37.608954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:37.610367 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:37.670805 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b993-b519-4a38-ad44-f525202eb69b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:37.674527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742eb27-c0ef-41e1-9f60-6b07664434bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:37.675175 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742eb27-c0ef-41e1-9f60-6b07664434bb service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:37.675460 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742eb27-c0ef-41e1-9f60-6b07664434bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:37.675923 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742eb27-c0ef-41e1-9f60-6b07664434bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:37.685350 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742eb27-c0ef-41e1-9f60-6b07664434bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:37.686852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742eb27-c0ef-41e1-9f60-6b07664434bb service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:37.696530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1359/2748] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:37.978652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440e8f2-c558-4910-ab8c-7108e553e35b None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:37.980052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e440e8f2-c558-4910-ab8c-7108e553e35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:37.998629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440e8f2-c558-4910-ab8c-7108e553e35b None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:38.005179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:38.005764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:38.006263 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:38.006513 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] PATH_INFO: `/v3/projects/7fba9033f30d46d7aa7dc4ab6cff7b74` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:38.007721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fba9033f30d46d7aa7dc4ab6cff7b74)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:38.009648 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:38.059619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fba9033f30d46d7aa7dc4ab6cff7b74', 'request_id': 'req-893697ee-9428-4f74-a843-5dec7e3b0d21'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.066733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fba9033f30d46d7aa7dc4ab6cff7b74', 'request_id': 'req-893697ee-9428-4f74-a843-5dec7e3b0d21'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.072821 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fba9033f30d46d7aa7dc4ab6cff7b74', 'request_id': 'req-893697ee-9428-4f74-a843-5dec7e3b0d21'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.086184 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] The token cache is being invalidate because project 7fba9033f30d46d7aa7dc4ab6cff7b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:38.086511 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.087137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.088607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1390/2749] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:37 2022] DELETE /identity/v3/projects/7fba9033f30d46d7aa7dc4ab6cff7b74 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:38.092633 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742eb27-c0ef-41e1-9f60-6b07664434bb service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:38.102763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742eb27-c0ef-41e1-9f60-6b07664434bb service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:38.156167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:38.164530 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36321f1c-36d0-4af5-962e-7a0d353cd7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:38.165400 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36321f1c-36d0-4af5-962e-7a0d353cd7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:38.165658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36321f1c-36d0-4af5-962e-7a0d353cd7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:38.165931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36321f1c-36d0-4af5-962e-7a0d353cd7d8 admin admin] PATH_INFO: `/v3/users/8ce1554277d4488897a460d2ba434036` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:38.167222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36321f1c-36d0-4af5-962e-7a0d353cd7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce1554277d4488897a460d2ba434036)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:38.169944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36321f1c-36d0-4af5-962e-7a0d353cd7d8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:38.220090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-36321f1c-36d0-4af5-962e-7a0d353cd7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce1554277d4488897a460d2ba434036'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.227782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-36321f1c-36d0-4af5-962e-7a0d353cd7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce1554277d4488897a460d2ba434036'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.239998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-36321f1c-36d0-4af5-962e-7a0d353cd7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce1554277d4488897a460d2ba434036'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.240715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-36321f1c-36d0-4af5-962e-7a0d353cd7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce1554277d4488897a460d2ba434036'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.241322 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-36321f1c-36d0-4af5-962e-7a0d353cd7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce1554277d4488897a460d2ba434036'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.254778 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1360/2750] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:38 2022] DELETE /identity/v3/users/8ce1554277d4488897a460d2ba434036 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:38.557494 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:38.559071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:38.572770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893697ee-9428-4f74-a843-5dec7e3b0d21 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:38.638591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:38.639609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:38.639894 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:38.640176 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] PATH_INFO: `/v3/projects/9d90f6802c8246049c8b39d33d9011f5` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:38.641367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d90f6802c8246049c8b39d33d9011f5)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:38.643535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:38.657043 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:38.702124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d90f6802c8246049c8b39d33d9011f5', 'request_id': 'req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.709455 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d90f6802c8246049c8b39d33d9011f5', 'request_id': 'req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.715594 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d90f6802c8246049c8b39d33d9011f5', 'request_id': 'req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.732533 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] The token cache is being invalidate because project 9d90f6802c8246049c8b39d33d9011f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:38.732902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.733600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.735477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1391/2751] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:38 2022] DELETE /identity/v3/projects/9d90f6802c8246049c8b39d33d9011f5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:38.741288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ffe1b-7535-43ea-bc1b-364cec2519c8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:38.741288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ffe1b-7535-43ea-bc1b-364cec2519c8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:38.741288 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ffe1b-7535-43ea-bc1b-364cec2519c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:38.746840 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:38.748924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:38.763636 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ce6ffe1b-7535-43ea-bc1b-364cec2519c8 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:38.764999 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ce6ffe1b-7535-43ea-bc1b-364cec2519c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:38.822692 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37576a-7dcf-4f1d-b16f-fe7534f87f2c admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:38.827830 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180c389-8a3c-4e68-ba0c-3a64a5a1be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:38.828474 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180c389-8a3c-4e68-ba0c-3a64a5a1be7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:38.828899 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180c389-8a3c-4e68-ba0c-3a64a5a1be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:38.829177 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180c389-8a3c-4e68-ba0c-3a64a5a1be7b admin admin] PATH_INFO: `/v3/users/afbc25f2874b44a181d9e73abd301aa8` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:38.830307 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180c389-8a3c-4e68-ba0c-3a64a5a1be7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=afbc25f2874b44a181d9e73abd301aa8)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:38.832902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180c389-8a3c-4e68-ba0c-3a64a5a1be7b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:38.836125 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1361/2752] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:38.889958 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-4180c389-8a3c-4e68-ba0c-3a64a5a1be7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afbc25f2874b44a181d9e73abd301aa8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.898940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-4180c389-8a3c-4e68-ba0c-3a64a5a1be7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afbc25f2874b44a181d9e73abd301aa8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.903251 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd90a12-e009-4954-911e-a11a3d861298 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:38.903810 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd90a12-e009-4954-911e-a11a3d861298 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:38.904119 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd90a12-e009-4954-911e-a11a3d861298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:38.911538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-4180c389-8a3c-4e68-ba0c-3a64a5a1be7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afbc25f2874b44a181d9e73abd301aa8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.912342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-4180c389-8a3c-4e68-ba0c-3a64a5a1be7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afbc25f2874b44a181d9e73abd301aa8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.913156 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-4180c389-8a3c-4e68-ba0c-3a64a5a1be7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afbc25f2874b44a181d9e73abd301aa8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:38.927109 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4dd90a12-e009-4954-911e-a11a3d861298 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:38.927556 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1392/2753] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:38 2022] DELETE /identity/v3/users/afbc25f2874b44a181d9e73abd301aa8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:38.928379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4dd90a12-e009-4954-911e-a11a3d861298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:38.931906 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a15c28-14c0-4895-9e24-5e915259efb1 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:38.932289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a15c28-14c0-4895-9e24-5e915259efb1 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:38.932459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a15c28-14c0-4895-9e24-5e915259efb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:38.952893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-56a15c28-14c0-4895-9e24-5e915259efb1 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:38.954031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-56a15c28-14c0-4895-9e24-5e915259efb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:38.967083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:38.998652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1362/2754] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:39.003000 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd90a12-e009-4954-911e-a11a3d861298 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.012455 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd90a12-e009-4954-911e-a11a3d861298 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.020802 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032754a-0da7-4b88-a889-6a0b023d930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.021695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032754a-0da7-4b88-a889-6a0b023d930c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.021979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032754a-0da7-4b88-a889-6a0b023d930c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.022259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032754a-0da7-4b88-a889-6a0b023d930c admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.022950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032754a-0da7-4b88-a889-6a0b023d930c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:39.023254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032754a-0da7-4b88-a889-6a0b023d930c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.024866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032754a-0da7-4b88-a889-6a0b023d930c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.029597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1393/2755] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:39.038424 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1363/2756] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:39.040289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a15c28-14c0-4895-9e24-5e915259efb1 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.041714 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-56a15c28-14c0-4895-9e24-5e915259efb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:39.042668 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032754a-0da7-4b88-a889-6a0b023d930c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.049113 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:39.054567 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032754a-0da7-4b88-a889-6a0b023d930c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.060991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa446ff-7a55-4b88-94b8-b8079a78fe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.061801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa446ff-7a55-4b88-94b8-b8079a78fe59 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.062515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa446ff-7a55-4b88-94b8-b8079a78fe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.062515 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa446ff-7a55-4b88-94b8-b8079a78fe59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.063241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa446ff-7a55-4b88-94b8-b8079a78fe59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.065532 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa446ff-7a55-4b88-94b8-b8079a78fe59 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.100571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1364/2757] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:39 2022] POST /identity/v3/projects => generated 401 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:39.101695 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa446ff-7a55-4b88-94b8-b8079a78fe59 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.113911 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a15c28-14c0-4895-9e24-5e915259efb1 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.165122 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7debb-3478-4697-8e26-3a3a85c4b22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.165780 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7debb-3478-4697-8e26-3a3a85c4b22b service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.166065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7debb-3478-4697-8e26-3a3a85c4b22b service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.166355 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7debb-3478-4697-8e26-3a3a85c4b22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.170948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa446ff-7a55-4b88-94b8-b8079a78fe59 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.176918 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7debb-3478-4697-8e26-3a3a85c4b22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.177156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a465437-140a-410d-849e-d099633a6f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.177751 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a465437-140a-410d-849e-d099633a6f84 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.178037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a465437-140a-410d-849e-d099633a6f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.178312 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a465437-140a-410d-849e-d099633a6f84 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.178469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7debb-3478-4697-8e26-3a3a85c4b22b service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.178984 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a465437-140a-410d-849e-d099633a6f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.180923 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a465437-140a-410d-849e-d099633a6f84 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.188395 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1394/2758] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:39.206094 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1365/2759] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:39 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:39.210311 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7debb-3478-4697-8e26-3a3a85c4b22b service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.219960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7debb-3478-4697-8e26-3a3a85c4b22b service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.226059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38406c71-1b0c-41fc-9ea5-128d407fc446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.226688 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38406c71-1b0c-41fc-9ea5-128d407fc446 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.227011 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38406c71-1b0c-41fc-9ea5-128d407fc446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.227325 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38406c71-1b0c-41fc-9ea5-128d407fc446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.227842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38406c71-1b0c-41fc-9ea5-128d407fc446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.230605 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38406c71-1b0c-41fc-9ea5-128d407fc446 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.242086 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1395/2760] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:38:39.247031 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a465437-140a-410d-849e-d099633a6f84 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.258769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a465437-140a-410d-849e-d099633a6f84 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.265042 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519f822-431a-4b96-b68e-da16c67871e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.265646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519f822-431a-4b96-b68e-da16c67871e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.265924 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519f822-431a-4b96-b68e-da16c67871e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.266212 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519f822-431a-4b96-b68e-da16c67871e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.266990 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519f822-431a-4b96-b68e-da16c67871e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.268484 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519f822-431a-4b96-b68e-da16c67871e6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.280411 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1366/2761] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:38:39.285125 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38406c71-1b0c-41fc-9ea5-128d407fc446 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.296416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38406c71-1b0c-41fc-9ea5-128d407fc446 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.304481 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed2207-394f-416d-9e53-9a5b3d90e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.305163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed2207-394f-416d-9e53-9a5b3d90e9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.305468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed2207-394f-416d-9e53-9a5b3d90e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.305738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed2207-394f-416d-9e53-9a5b3d90e9d9 admin admin] PATH_INFO: `/v3/projects/a8d32e37c07948e880b6024ca00b5db9/users/2ad6b33635f749acb4644ca61589643a/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.322850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed2207-394f-416d-9e53-9a5b3d90e9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d32e37c07948e880b6024ca00b5db9, user_id=2ad6b33635f749acb4644ca61589643a, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.325939 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed2207-394f-416d-9e53-9a5b3d90e9d9 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.339739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1396/2762] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:39 2022] PUT /identity/v3/projects/a8d32e37c07948e880b6024ca00b5db9/users/2ad6b33635f749acb4644ca61589643a/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:39.351070 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d8402-b852-44fb-9225-167027707858 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.351438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d8402-b852-44fb-9225-167027707858 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.351716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d8402-b852-44fb-9225-167027707858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.382815 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c30d8402-b852-44fb-9225-167027707858 None None] MFA Rules not processed for user `2ad6b33635f749acb4644ca61589643a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:39.384298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c30d8402-b852-44fb-9225-167027707858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:39.470158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1367/2763] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:39 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:39.476417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed2207-394f-416d-9e53-9a5b3d90e9d9 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.528949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:39.539786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d8402-b852-44fb-9225-167027707858 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.541860 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c30d8402-b852-44fb-9225-167027707858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:39.552292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed2207-394f-416d-9e53-9a5b3d90e9d9 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.557255 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d8402-b852-44fb-9225-167027707858 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.558734 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1c54f-e8b2-4db5-b615-dbbaddb384a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.559378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1c54f-e8b2-4db5-b615-dbbaddb384a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.559658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1c54f-e8b2-4db5-b615-dbbaddb384a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.559938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1c54f-e8b2-4db5-b615-dbbaddb384a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.560706 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1c54f-e8b2-4db5-b615-dbbaddb384a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.562591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1c54f-e8b2-4db5-b615-dbbaddb384a6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.563273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.564039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.564418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.564790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] PATH_INFO: `/v3/projects/237010c1e17f4c5890fcac4b8eec8f55` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.566625 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237010c1e17f4c5890fcac4b8eec8f55)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.568634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.594913 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1397/2764] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:39 2022] POST /identity/v3/projects => generated 399 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:39.599581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1c54f-e8b2-4db5-b615-dbbaddb384a6 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.621336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:39.624047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237010c1e17f4c5890fcac4b8eec8f55', 'request_id': 'req-ea83c7aa-5386-4374-a72a-73541fa13eb7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:39.634616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237010c1e17f4c5890fcac4b8eec8f55', 'request_id': 'req-ea83c7aa-5386-4374-a72a-73541fa13eb7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:39.642155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237010c1e17f4c5890fcac4b8eec8f55', 'request_id': 'req-ea83c7aa-5386-4374-a72a-73541fa13eb7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:39.653433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] The token cache is being invalidate because project 237010c1e17f4c5890fcac4b8eec8f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:39.653700 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:39.654368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:39.656144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1368/2765] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:39 2022] DELETE /identity/v3/projects/237010c1e17f4c5890fcac4b8eec8f55 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:39.659945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.661488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:39.669143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1c54f-e8b2-4db5-b615-dbbaddb384a6 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.727988 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89eba7-a0c5-4a5d-bd8f-9f13a7e8b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.728506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89eba7-a0c5-4a5d-bd8f-9f13a7e8b3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.728782 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89eba7-a0c5-4a5d-bd8f-9f13a7e8b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.729056 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89eba7-a0c5-4a5d-bd8f-9f13a7e8b3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.729665 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83c7aa-5386-4374-a72a-73541fa13eb7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.729786 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89eba7-a0c5-4a5d-bd8f-9f13a7e8b3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.731749 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89eba7-a0c5-4a5d-bd8f-9f13a7e8b3b8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.735719 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.736368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.736643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.736912 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] PATH_INFO: `/v3/users/925699e1b3974067b1f8346aadcd0ff1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.739097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=925699e1b3974067b1f8346aadcd0ff1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.741043 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.755992 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1398/2766] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:39 2022] POST /identity/v3/users => generated 306 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:39.759862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89eba7-a0c5-4a5d-bd8f-9f13a7e8b3b8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.761598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bc89eba7-a0c5-4a5d-bd8f-9f13a7e8b3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:39.774898 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89eba7-a0c5-4a5d-bd8f-9f13a7e8b3b8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.780787 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad9919-d3f1-4828-b3e2-113b2a2ea973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.781680 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad9919-d3f1-4828-b3e2-113b2a2ea973 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.782002 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad9919-d3f1-4828-b3e2-113b2a2ea973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.782448 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad9919-d3f1-4828-b3e2-113b2a2ea973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.783274 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad9919-d3f1-4828-b3e2-113b2a2ea973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.785363 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad9919-d3f1-4828-b3e2-113b2a2ea973 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.800609 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1399/2767] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:38:39.801960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad9919-d3f1-4828-b3e2-113b2a2ea973 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.803227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925699e1b3974067b1f8346aadcd0ff1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:39.810541 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925699e1b3974067b1f8346aadcd0ff1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:39.812068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad9919-d3f1-4828-b3e2-113b2a2ea973 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.817771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ee410-6d2d-4585-aa08-79bbf3a47c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.818456 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ee410-6d2d-4585-aa08-79bbf3a47c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.818736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ee410-6d2d-4585-aa08-79bbf3a47c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.819009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ee410-6d2d-4585-aa08-79bbf3a47c03 admin admin] PATH_INFO: `/v3/projects/a5e377f7cd7f4cc987e1e1f83183a128/users/1900687149c54008bfccda0062a70194/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.825014 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925699e1b3974067b1f8346aadcd0ff1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:39.825754 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925699e1b3974067b1f8346aadcd0ff1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:39.826413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925699e1b3974067b1f8346aadcd0ff1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:39.834791 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ee410-6d2d-4585-aa08-79bbf3a47c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e377f7cd7f4cc987e1e1f83183a128, user_id=1900687149c54008bfccda0062a70194, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.837529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ee410-6d2d-4585-aa08-79bbf3a47c03 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.843047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1369/2768] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:39 2022] DELETE /identity/v3/users/925699e1b3974067b1f8346aadcd0ff1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:39.852834 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1400/2769] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:39 2022] PUT /identity/v3/projects/a5e377f7cd7f4cc987e1e1f83183a128/users/1900687149c54008bfccda0062a70194/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:39.856727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.858311 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:39.921937 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:39.936580 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ae861-f1cc-48c2-a984-e658a1122ca9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:40.008621 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae92a58-5b0b-4713-ad76-4909caeadd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:40.009169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92a58-5b0b-4713-ad76-4909caeadd19 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.009414 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92a58-5b0b-4713-ad76-4909caeadd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.009692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92a58-5b0b-4713-ad76-4909caeadd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.010348 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae92a58-5b0b-4713-ad76-4909caeadd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:40.012056 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae92a58-5b0b-4713-ad76-4909caeadd19 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:40.022783 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1370/2770] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:40.026677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ee410-6d2d-4585-aa08-79bbf3a47c03 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:40.039225 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ee410-6d2d-4585-aa08-79bbf3a47c03 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:40.043889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59628c6b-0c4a-4bf9-9298-df9d82fc33f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:40.044546 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59628c6b-0c4a-4bf9-9298-df9d82fc33f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.044821 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59628c6b-0c4a-4bf9-9298-df9d82fc33f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.045092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59628c6b-0c4a-4bf9-9298-df9d82fc33f8 admin admin] PATH_INFO: `/v3/projects/a5e377f7cd7f4cc987e1e1f83183a128/users/1900687149c54008bfccda0062a70194/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.047276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59628c6b-0c4a-4bf9-9298-df9d82fc33f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e377f7cd7f4cc987e1e1f83183a128, user_id=1900687149c54008bfccda0062a70194, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:40.049907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59628c6b-0c4a-4bf9-9298-df9d82fc33f8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:40.066800 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1401/2771] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:40 2022] PUT /identity/v3/projects/a5e377f7cd7f4cc987e1e1f83183a128/users/1900687149c54008bfccda0062a70194/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:40.076899 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab04c8-8b32-4b12-b10b-8ac72fce4438 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.077185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab04c8-8b32-4b12-b10b-8ac72fce4438 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.077462 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab04c8-8b32-4b12-b10b-8ac72fce4438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.109387 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-95ab04c8-8b32-4b12-b10b-8ac72fce4438 None None] MFA Rules not processed for user `1900687149c54008bfccda0062a70194`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:40.111646 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-95ab04c8-8b32-4b12-b10b-8ac72fce4438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:40.133760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59628c6b-0c4a-4bf9-9298-df9d82fc33f8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:40.136880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-59628c6b-0c4a-4bf9-9298-df9d82fc33f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:40.178857 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:40.197533 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1371/2772] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:40 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:40.210958 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab04c8-8b32-4b12-b10b-8ac72fce4438 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:40.212771 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-95ab04c8-8b32-4b12-b10b-8ac72fce4438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:40.229362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59628c6b-0c4a-4bf9-9298-df9d82fc33f8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:40.234142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:40.234793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.235071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.235340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] PATH_INFO: `/v3/projects/436f314192d24026ad44374dc2ada638` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.236462 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=436f314192d24026ad44374dc2ada638)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:40.239312 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:40.296230 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436f314192d24026ad44374dc2ada638', 'request_id': 'req-322a6d32-07d2-47d0-9252-a69c2e16f8bf'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:40.313472 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436f314192d24026ad44374dc2ada638', 'request_id': 'req-322a6d32-07d2-47d0-9252-a69c2e16f8bf'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:40.324597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436f314192d24026ad44374dc2ada638', 'request_id': 'req-322a6d32-07d2-47d0-9252-a69c2e16f8bf'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:40.354916 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] The token cache is being invalidate because project 436f314192d24026ad44374dc2ada638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:40.355328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:40.356071 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:40.357660 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1402/2773] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:40 2022] DELETE /identity/v3/projects/436f314192d24026ad44374dc2ada638 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:40.361564 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:40.362994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:40.411900 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab04c8-8b32-4b12-b10b-8ac72fce4438 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:40.439937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a6d32-07d2-47d0-9252-a69c2e16f8bf admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:40.444865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:40.445537 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.445817 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.446090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] PATH_INFO: `/v3/users/4235bbc4a9974bc6b6bb1ff72a68fbf9` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.447420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4235bbc4a9974bc6b6bb1ff72a68fbf9)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:40.449249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:40.450898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:40.468335 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b792d-e4ad-4f0a-93d3-9bbd0a49f43e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:40.469799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b792d-e4ad-4f0a-93d3-9bbd0a49f43e service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.470095 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b792d-e4ad-4f0a-93d3-9bbd0a49f43e service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.470559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b792d-e4ad-4f0a-93d3-9bbd0a49f43e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.472782 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f56b792d-e4ad-4f0a-93d3-9bbd0a49f43e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:40.502971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4235bbc4a9974bc6b6bb1ff72a68fbf9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:40.505365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:40.514272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4235bbc4a9974bc6b6bb1ff72a68fbf9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:40.527555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4235bbc4a9974bc6b6bb1ff72a68fbf9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:40.528313 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4235bbc4a9974bc6b6bb1ff72a68fbf9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:40.528964 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4235bbc4a9974bc6b6bb1ff72a68fbf9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:40.543967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1403/2774] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:40 2022] DELETE /identity/v3/users/4235bbc4a9974bc6b6bb1ff72a68fbf9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:40.549071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b792d-e4ad-4f0a-93d3-9bbd0a49f43e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:40.550623 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b792d-e4ad-4f0a-93d3-9bbd0a49f43e service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:40.560271 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1372/2775] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:40 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:40.640315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:40.641761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:40.733928 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b706-3d02-4e3f-9d8f-7a0a69048f5d admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:40.738491 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df99f-d34e-419c-bd3b-56d2f2057cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:40.739231 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df99f-d34e-419c-bd3b-56d2f2057cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.739626 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df99f-d34e-419c-bd3b-56d2f2057cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.739996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df99f-d34e-419c-bd3b-56d2f2057cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.743429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-320df99f-d34e-419c-bd3b-56d2f2057cd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:40.811915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320df99f-d34e-419c-bd3b-56d2f2057cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:40.813731 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320df99f-d34e-419c-bd3b-56d2f2057cd2 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:40.824772 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1404/2776] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:40 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:40.844250 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b792d-e4ad-4f0a-93d3-9bbd0a49f43e service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:40.857364 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b792d-e4ad-4f0a-93d3-9bbd0a49f43e service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:40.923195 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74ce5-631a-44f9-aa47-b40bed7149aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:40.923864 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74ce5-631a-44f9-aa47-b40bed7149aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.924142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74ce5-631a-44f9-aa47-b40bed7149aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.924436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74ce5-631a-44f9-aa47-b40bed7149aa admin admin] PATH_INFO: `/v3/projects/17990c3f634243cab0c7bed41e2aed98` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.926107 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b74ce5-631a-44f9-aa47-b40bed7149aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=17990c3f634243cab0c7bed41e2aed98)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:40.928030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b74ce5-631a-44f9-aa47-b40bed7149aa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:40.982006 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d7b74ce5-631a-44f9-aa47-b40bed7149aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17990c3f634243cab0c7bed41e2aed98', 'request_id': 'req-d7b74ce5-631a-44f9-aa47-b40bed7149aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:40.989952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d7b74ce5-631a-44f9-aa47-b40bed7149aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17990c3f634243cab0c7bed41e2aed98', 'request_id': 'req-d7b74ce5-631a-44f9-aa47-b40bed7149aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:41.001947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d7b74ce5-631a-44f9-aa47-b40bed7149aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17990c3f634243cab0c7bed41e2aed98', 'request_id': 'req-d7b74ce5-631a-44f9-aa47-b40bed7149aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:41.017199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d7b74ce5-631a-44f9-aa47-b40bed7149aa admin admin] The token cache is being invalidate because project 17990c3f634243cab0c7bed41e2aed98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:41.017439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d7b74ce5-631a-44f9-aa47-b40bed7149aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:41.018088 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d7b74ce5-631a-44f9-aa47-b40bed7149aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:41.019786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1373/2777] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:40 2022] DELETE /identity/v3/projects/17990c3f634243cab0c7bed41e2aed98 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:41.026199 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66196d59-ca09-417c-a1c3-0ea0d48e0f87 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.026507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66196d59-ca09-417c-a1c3-0ea0d48e0f87 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.026784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66196d59-ca09-417c-a1c3-0ea0d48e0f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.052269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-66196d59-ca09-417c-a1c3-0ea0d48e0f87 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:41.053743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-66196d59-ca09-417c-a1c3-0ea0d48e0f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:41.121762 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1405/2778] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:41.131590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7159-aeb8-4568-8a46-64f9dcfc0f40 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.131875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7159-aeb8-4568-8a46-64f9dcfc0f40 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.132153 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7159-aeb8-4568-8a46-64f9dcfc0f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.155703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b92e7159-aeb8-4568-8a46-64f9dcfc0f40 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:41.157242 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b92e7159-aeb8-4568-8a46-64f9dcfc0f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:41.178418 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1374/2779] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:41.180216 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66196d59-ca09-417c-a1c3-0ea0d48e0f87 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.190242 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66196d59-ca09-417c-a1c3-0ea0d48e0f87 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.196113 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73087f-553c-4247-a182-aba16bbf6ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.196763 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73087f-553c-4247-a182-aba16bbf6ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.197085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73087f-553c-4247-a182-aba16bbf6ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.197389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73087f-553c-4247-a182-aba16bbf6ab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.198137 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73087f-553c-4247-a182-aba16bbf6ab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:41.198470 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73087f-553c-4247-a182-aba16bbf6ab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.200091 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73087f-553c-4247-a182-aba16bbf6ab4 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.213615 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1406/2780] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:41.217750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7159-aeb8-4568-8a46-64f9dcfc0f40 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.228658 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7159-aeb8-4568-8a46-64f9dcfc0f40 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.233268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0840cc4-a6d8-4479-8a77-a2620a3d667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.233859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0840cc4-a6d8-4479-8a77-a2620a3d667a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.234135 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0840cc4-a6d8-4479-8a77-a2620a3d667a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.234421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0840cc4-a6d8-4479-8a77-a2620a3d667a admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.235053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0840cc4-a6d8-4479-8a77-a2620a3d667a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.236933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0840cc4-a6d8-4479-8a77-a2620a3d667a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.246202 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:41.265923 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1375/2781] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:41 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:41.270931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73087f-553c-4247-a182-aba16bbf6ab4 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.280946 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73087f-553c-4247-a182-aba16bbf6ab4 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.286514 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:41.351974 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce010bc2-244b-4ee9-8d13-cfebb43821f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.352929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce010bc2-244b-4ee9-8d13-cfebb43821f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.352929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce010bc2-244b-4ee9-8d13-cfebb43821f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.353204 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce010bc2-244b-4ee9-8d13-cfebb43821f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.353831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce010bc2-244b-4ee9-8d13-cfebb43821f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.355774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce010bc2-244b-4ee9-8d13-cfebb43821f6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.386812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1407/2782] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:41 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:41.391127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0840cc4-a6d8-4479-8a77-a2620a3d667a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.408150 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0840cc4-a6d8-4479-8a77-a2620a3d667a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.409100 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d3640-a662-4906-a520-02288c244f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.411401 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d3640-a662-4906-a520-02288c244f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.411737 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d3640-a662-4906-a520-02288c244f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.412329 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d3640-a662-4906-a520-02288c244f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.412987 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d3640-a662-4906-a520-02288c244f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.416127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d3640-a662-4906-a520-02288c244f00 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.427558 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1376/2783] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:41.431606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce010bc2-244b-4ee9-8d13-cfebb43821f6 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.441793 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce010bc2-244b-4ee9-8d13-cfebb43821f6 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.446345 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19300567-e1f9-4d46-b6dc-6f3d78db171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.446959 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19300567-e1f9-4d46-b6dc-6f3d78db171d admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.447237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19300567-e1f9-4d46-b6dc-6f3d78db171d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.447510 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19300567-e1f9-4d46-b6dc-6f3d78db171d admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.448140 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19300567-e1f9-4d46-b6dc-6f3d78db171d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.449715 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19300567-e1f9-4d46-b6dc-6f3d78db171d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.460705 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1408/2784] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:41.464636 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d3640-a662-4906-a520-02288c244f00 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.475241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d3640-a662-4906-a520-02288c244f00 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.479820 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6348d-0d76-4d51-a955-4db990fc4931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.480469 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6348d-0d76-4d51-a955-4db990fc4931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.480752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6348d-0d76-4d51-a955-4db990fc4931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.481030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6348d-0d76-4d51-a955-4db990fc4931 admin admin] PATH_INFO: `/v3/projects/3e8b0da67df1498dba803a161b500596/users/7a413fa9e0ef4e11ac54bbba37a974b1/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.496290 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6348d-0d76-4d51-a955-4db990fc4931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8b0da67df1498dba803a161b500596, user_id=7a413fa9e0ef4e11ac54bbba37a974b1, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.499021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6348d-0d76-4d51-a955-4db990fc4931 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.513339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1377/2785] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:41 2022] PUT /identity/v3/projects/3e8b0da67df1498dba803a161b500596/users/7a413fa9e0ef4e11ac54bbba37a974b1/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:41.525241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c82c7-159d-4139-91f8-8da8cdd964d9 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.525463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c82c7-159d-4139-91f8-8da8cdd964d9 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.525736 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c82c7-159d-4139-91f8-8da8cdd964d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.555566 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-452c82c7-159d-4139-91f8-8da8cdd964d9 None None] MFA Rules not processed for user `7a413fa9e0ef4e11ac54bbba37a974b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:41.556781 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-452c82c7-159d-4139-91f8-8da8cdd964d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:41.621531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1409/2786] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:41.625966 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6348d-0d76-4d51-a955-4db990fc4931 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.688026 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6348d-0d76-4d51-a955-4db990fc4931 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.693479 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cfa79-a3f9-402d-b9a6-cee1238d3e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.694080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cfa79-a3f9-402d-b9a6-cee1238d3e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.694358 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cfa79-a3f9-402d-b9a6-cee1238d3e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.694653 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cfa79-a3f9-402d-b9a6-cee1238d3e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.695275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cfa79-a3f9-402d-b9a6-cee1238d3e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.697187 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cfa79-a3f9-402d-b9a6-cee1238d3e66 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.724856 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1378/2787] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:41 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:41.729387 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c82c7-159d-4139-91f8-8da8cdd964d9 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.740794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c82c7-159d-4139-91f8-8da8cdd964d9 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.799678 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392d1e6-a126-4f07-bf4c-634fae457050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.800250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392d1e6-a126-4f07-bf4c-634fae457050 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.800526 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392d1e6-a126-4f07-bf4c-634fae457050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.800796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392d1e6-a126-4f07-bf4c-634fae457050 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.801458 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392d1e6-a126-4f07-bf4c-634fae457050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.803469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392d1e6-a126-4f07-bf4c-634fae457050 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.825139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1410/2788] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:41 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:41.829200 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cfa79-a3f9-402d-b9a6-cee1238d3e66 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.839879 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cfa79-a3f9-402d-b9a6-cee1238d3e66 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.844475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11bf9e-4133-4d8c-8e81-dfb60780f6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.846280 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11bf9e-4133-4d8c-8e81-dfb60780f6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.846690 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11bf9e-4133-4d8c-8e81-dfb60780f6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.847081 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11bf9e-4133-4d8c-8e81-dfb60780f6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.847760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11bf9e-4133-4d8c-8e81-dfb60780f6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.849407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11bf9e-4133-4d8c-8e81-dfb60780f6d6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.860214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1379/2789] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:41.865087 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392d1e6-a126-4f07-bf4c-634fae457050 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.874929 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392d1e6-a126-4f07-bf4c-634fae457050 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.881577 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68433438-132c-4319-8c73-04b715e0f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.882261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68433438-132c-4319-8c73-04b715e0f168 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.882672 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68433438-132c-4319-8c73-04b715e0f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.882996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68433438-132c-4319-8c73-04b715e0f168 admin admin] PATH_INFO: `/v3/projects/a3d9ae7319344c47862635095cfe3e87/users/724d12d98af747d59a448985ae9425f2/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.885394 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:41.900725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68433438-132c-4319-8c73-04b715e0f168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d9ae7319344c47862635095cfe3e87, user_id=724d12d98af747d59a448985ae9425f2, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.903691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68433438-132c-4319-8c73-04b715e0f168 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.917791 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1411/2790] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:41 2022] PUT /identity/v3/projects/a3d9ae7319344c47862635095cfe3e87/users/724d12d98af747d59a448985ae9425f2/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:41.921707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11bf9e-4133-4d8c-8e81-dfb60780f6d6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.932339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11bf9e-4133-4d8c-8e81-dfb60780f6d6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.989743 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf77869-41c2-44e3-9cc7-2b54c3eeb9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.990344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf77869-41c2-44e3-9cc7-2b54c3eeb9db admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.990653 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf77869-41c2-44e3-9cc7-2b54c3eeb9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.990924 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf77869-41c2-44e3-9cc7-2b54c3eeb9db admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.991559 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf77869-41c2-44e3-9cc7-2b54c3eeb9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.993158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf77869-41c2-44e3-9cc7-2b54c3eeb9db admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:42.002959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1380/2791] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:42.008161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68433438-132c-4319-8c73-04b715e0f168 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:42.018291 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68433438-132c-4319-8c73-04b715e0f168 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:42.023286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cf04f-193c-4ac7-bd88-0c85438db683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:42.024075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cf04f-193c-4ac7-bd88-0c85438db683 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:42.024348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cf04f-193c-4ac7-bd88-0c85438db683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:42.024614 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cf04f-193c-4ac7-bd88-0c85438db683 admin admin] PATH_INFO: `/v3/projects/a3d9ae7319344c47862635095cfe3e87/users/724d12d98af747d59a448985ae9425f2/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:42.026516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cf04f-193c-4ac7-bd88-0c85438db683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d9ae7319344c47862635095cfe3e87, user_id=724d12d98af747d59a448985ae9425f2, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:42.029117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cf04f-193c-4ac7-bd88-0c85438db683 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:42.040338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1412/2792] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:42 2022] PUT /identity/v3/projects/a3d9ae7319344c47862635095cfe3e87/users/724d12d98af747d59a448985ae9425f2/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:42.051009 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75852935-d91e-491d-982e-70c022a96816 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:42.051228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75852935-d91e-491d-982e-70c022a96816 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:42.051496 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75852935-d91e-491d-982e-70c022a96816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:42.079548 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-75852935-d91e-491d-982e-70c022a96816 None None] MFA Rules not processed for user `724d12d98af747d59a448985ae9425f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:42.080766 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-75852935-d91e-491d-982e-70c022a96816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:42.093018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:42.152746 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1381/2793] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:42.165888 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cf04f-193c-4ac7-bd88-0c85438db683 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:42.167651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8f2cf04f-193c-4ac7-bd88-0c85438db683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:42.232853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cf04f-193c-4ac7-bd88-0c85438db683 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:42.236838 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3f313-a42a-437a-baaf-1d436a44228e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:42.237502 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3f313-a42a-437a-baaf-1d436a44228e service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:42.238331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3f313-a42a-437a-baaf-1d436a44228e service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:42.238720 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3f313-a42a-437a-baaf-1d436a44228e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:42.248306 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3f313-a42a-437a-baaf-1d436a44228e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:42.249755 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3f313-a42a-437a-baaf-1d436a44228e service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:42.259888 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1413/2794] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:42.350776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75852935-d91e-491d-982e-70c022a96816 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:42.361020 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75852935-d91e-491d-982e-70c022a96816 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:42.365256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e31e3-8456-4fbb-98c1-cf3f80a9e500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:42.365979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e31e3-8456-4fbb-98c1-cf3f80a9e500 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:42.366324 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e31e3-8456-4fbb-98c1-cf3f80a9e500 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:42.366722 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e31e3-8456-4fbb-98c1-cf3f80a9e500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:42.443331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e31e3-8456-4fbb-98c1-cf3f80a9e500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:42.444816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e31e3-8456-4fbb-98c1-cf3f80a9e500 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:42.454650 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1382/2795] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:45.013438 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3f313-a42a-437a-baaf-1d436a44228e service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:45.014917 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-56e3f313-a42a-437a-baaf-1d436a44228e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:45.080565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3f313-a42a-437a-baaf-1d436a44228e service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:45.086142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:45.086970 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:45.087365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:45.087642 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] PATH_INFO: `/v3/users/2ad6b33635f749acb4644ca61589643a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:45.088758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad6b33635f749acb4644ca61589643a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:45.090724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:45.141509 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad6b33635f749acb4644ca61589643a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.149807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad6b33635f749acb4644ca61589643a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.164485 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad6b33635f749acb4644ca61589643a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.165761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad6b33635f749acb4644ca61589643a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.166432 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad6b33635f749acb4644ca61589643a'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.170807 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:45.183960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1414/2796] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:45 2022] DELETE /identity/v3/users/2ad6b33635f749acb4644ca61589643a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:45.188349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d092d1b-a6e6-41b1-80a7-46b7f07d16f7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:45.188809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d092d1b-a6e6-41b1-80a7-46b7f07d16f7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:45.188933 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d092d1b-a6e6-41b1-80a7-46b7f07d16f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:45.208866 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1d092d1b-a6e6-41b1-80a7-46b7f07d16f7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:45.210047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1d092d1b-a6e6-41b1-80a7-46b7f07d16f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:45.280549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1383/2797] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:45.291641 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:45.293174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:45.351463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b99316-a136-49b2-b5dc-9de65d35e83a admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:45.357653 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807d34d-b60f-4d20-ac43-b522afebd5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:45.358369 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807d34d-b60f-4d20-ac43-b522afebd5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:45.358686 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807d34d-b60f-4d20-ac43-b522afebd5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:45.358960 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807d34d-b60f-4d20-ac43-b522afebd5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:45.369638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807d34d-b60f-4d20-ac43-b522afebd5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:45.371115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807d34d-b60f-4d20-ac43-b522afebd5b4 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:45.381949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1415/2798] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:45.667498 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d092d1b-a6e6-41b1-80a7-46b7f07d16f7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:45.669073 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1d092d1b-a6e6-41b1-80a7-46b7f07d16f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:45.683129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d092d1b-a6e6-41b1-80a7-46b7f07d16f7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:45.688055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:45.688693 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:45.688975 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:45.689377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] PATH_INFO: `/v3/projects/a8d32e37c07948e880b6024ca00b5db9` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:45.690406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d32e37c07948e880b6024ca00b5db9)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:45.693491 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:45.742250 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:45.746621 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d32e37c07948e880b6024ca00b5db9', 'request_id': 'req-84ab785c-8fa0-44d7-8966-28b751455737'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.755776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d32e37c07948e880b6024ca00b5db9', 'request_id': 'req-84ab785c-8fa0-44d7-8966-28b751455737'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.762590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d32e37c07948e880b6024ca00b5db9', 'request_id': 'req-84ab785c-8fa0-44d7-8966-28b751455737'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.773676 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] The token cache is being invalidate because project a8d32e37c07948e880b6024ca00b5db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:45.773965 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.774643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.776117 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1384/2799] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:45 2022] DELETE /identity/v3/projects/a8d32e37c07948e880b6024ca00b5db9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:45.780139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807d34d-b60f-4d20-ac43-b522afebd5b4 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:45.790155 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807d34d-b60f-4d20-ac43-b522afebd5b4 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:45.848319 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321daac5-76d6-47bc-bf60-8e9403faf4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:45.849039 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321daac5-76d6-47bc-bf60-8e9403faf4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:45.849447 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321daac5-76d6-47bc-bf60-8e9403faf4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:45.849809 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321daac5-76d6-47bc-bf60-8e9403faf4d6 admin admin] PATH_INFO: `/v3/users/1900687149c54008bfccda0062a70194` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:45.851012 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321daac5-76d6-47bc-bf60-8e9403faf4d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1900687149c54008bfccda0062a70194)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:45.853003 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321daac5-76d6-47bc-bf60-8e9403faf4d6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:45.905296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-321daac5-76d6-47bc-bf60-8e9403faf4d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1900687149c54008bfccda0062a70194'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.913835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-321daac5-76d6-47bc-bf60-8e9403faf4d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1900687149c54008bfccda0062a70194'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.926901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-321daac5-76d6-47bc-bf60-8e9403faf4d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1900687149c54008bfccda0062a70194'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.927613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-321daac5-76d6-47bc-bf60-8e9403faf4d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1900687149c54008bfccda0062a70194'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.928237 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-321daac5-76d6-47bc-bf60-8e9403faf4d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1900687149c54008bfccda0062a70194'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:45.941530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1416/2800] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:45 2022] DELETE /identity/v3/users/1900687149c54008bfccda0062a70194 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:46.243957 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:46.245221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:46.260641 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab785c-8fa0-44d7-8966-28b751455737 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:46.317461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:46.318097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.318410 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.318682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b admin admin] PATH_INFO: `/v3/projects/a5e377f7cd7f4cc987e1e1f83183a128` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.319809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e377f7cd7f4cc987e1e1f83183a128)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:46.321729 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:46.369382 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e377f7cd7f4cc987e1e1f83183a128', 'request_id': 'req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:46.378133 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e377f7cd7f4cc987e1e1f83183a128', 'request_id': 'req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:46.386921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e377f7cd7f4cc987e1e1f83183a128', 'request_id': 'req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:46.398716 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b admin admin] The token cache is being invalidate because project a5e377f7cd7f4cc987e1e1f83183a128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:46.398940 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:46.399590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6f2682fa-21a4-4a3f-acb4-7da62a12fa9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:46.401091 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1385/2801] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:46 2022] DELETE /identity/v3/projects/a5e377f7cd7f4cc987e1e1f83183a128 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:46.406436 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8c816-e72e-4299-933e-49dced5e7de8 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.406949 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8c816-e72e-4299-933e-49dced5e7de8 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.407044 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8c816-e72e-4299-933e-49dced5e7de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.429218 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-b3c8c816-e72e-4299-933e-49dced5e7de8 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:46.430425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b3c8c816-e72e-4299-933e-49dced5e7de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:46.438708 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:46.493465 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1417/2802] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:46.504354 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c375b1-a111-4046-8c9f-ce5e220fb8e8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.504672 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c375b1-a111-4046-8c9f-ce5e220fb8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.505068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c375b1-a111-4046-8c9f-ce5e220fb8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.525446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b8c375b1-a111-4046-8c9f-ce5e220fb8e8 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:46.526691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b8c375b1-a111-4046-8c9f-ce5e220fb8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:46.535166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1386/2803] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:46.539901 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8c816-e72e-4299-933e-49dced5e7de8 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:46.549666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8c816-e72e-4299-933e-49dced5e7de8 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:46.554493 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414475d-4411-4279-96cf-efd408b8066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:46.555116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414475d-4411-4279-96cf-efd408b8066b admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.555406 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414475d-4411-4279-96cf-efd408b8066b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.555674 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414475d-4411-4279-96cf-efd408b8066b admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.556375 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414475d-4411-4279-96cf-efd408b8066b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:46.556682 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414475d-4411-4279-96cf-efd408b8066b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:46.558286 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414475d-4411-4279-96cf-efd408b8066b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:46.569849 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1418/2804] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:46.574087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c375b1-a111-4046-8c9f-ce5e220fb8e8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:46.583649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c375b1-a111-4046-8c9f-ce5e220fb8e8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:46.588287 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa435b-d6ce-44e2-92c6-bab66a2de6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:46.588876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa435b-d6ce-44e2-92c6-bab66a2de6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.589156 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa435b-d6ce-44e2-92c6-bab66a2de6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.589425 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa435b-d6ce-44e2-92c6-bab66a2de6d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.590058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa435b-d6ce-44e2-92c6-bab66a2de6d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:46.591978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa435b-d6ce-44e2-92c6-bab66a2de6d5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:46.618974 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1387/2805] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:46 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:46.623070 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414475d-4411-4279-96cf-efd408b8066b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:46.633123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414475d-4411-4279-96cf-efd408b8066b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:46.690085 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d0cf0-32d8-440a-91a1-beba2c4007a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:46.690694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d0cf0-32d8-440a-91a1-beba2c4007a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.690974 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d0cf0-32d8-440a-91a1-beba2c4007a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.691249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d0cf0-32d8-440a-91a1-beba2c4007a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.691886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d0cf0-32d8-440a-91a1-beba2c4007a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:46.693849 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d0cf0-32d8-440a-91a1-beba2c4007a1 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:46.714547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1419/2806] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:46 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:46.718696 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa435b-d6ce-44e2-92c6-bab66a2de6d5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:46.729399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa435b-d6ce-44e2-92c6-bab66a2de6d5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:46.734593 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352de605-7d3d-4872-be87-6d8126819bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:46.735198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352de605-7d3d-4872-be87-6d8126819bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.735488 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352de605-7d3d-4872-be87-6d8126819bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.735804 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352de605-7d3d-4872-be87-6d8126819bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.736446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352de605-7d3d-4872-be87-6d8126819bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:46.738205 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352de605-7d3d-4872-be87-6d8126819bc3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:46.748721 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1388/2807] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:46.752961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d0cf0-32d8-440a-91a1-beba2c4007a1 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:46.763802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d0cf0-32d8-440a-91a1-beba2c4007a1 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:46.769417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173889d-ee3a-47e7-b4d2-28402a092a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:46.770314 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173889d-ee3a-47e7-b4d2-28402a092a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.770752 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173889d-ee3a-47e7-b4d2-28402a092a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.771049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173889d-ee3a-47e7-b4d2-28402a092a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.771691 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173889d-ee3a-47e7-b4d2-28402a092a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:46.773310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173889d-ee3a-47e7-b4d2-28402a092a7f admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:46.785470 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1420/2808] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:46.789862 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352de605-7d3d-4872-be87-6d8126819bc3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:46.799578 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352de605-7d3d-4872-be87-6d8126819bc3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:46.804591 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4de1a-f187-4674-bcfa-42980afc35f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:46.805233 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4de1a-f187-4674-bcfa-42980afc35f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.805511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4de1a-f187-4674-bcfa-42980afc35f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.805783 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4de1a-f187-4674-bcfa-42980afc35f3 admin admin] PATH_INFO: `/v3/projects/1d470b06dc704e2495bf159153977d6d/users/b447471168b747bca5ad5fc41f6982aa/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.821069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4de1a-f187-4674-bcfa-42980afc35f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d470b06dc704e2495bf159153977d6d, user_id=b447471168b747bca5ad5fc41f6982aa, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:46.823731 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4de1a-f187-4674-bcfa-42980afc35f3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:46.832304 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:46.838273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1389/2809] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:46 2022] PUT /identity/v3/projects/1d470b06dc704e2495bf159153977d6d/users/b447471168b747bca5ad5fc41f6982aa/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:46.848804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159efae-2403-464d-b37e-665dcc0874b2 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.849083 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159efae-2403-464d-b37e-665dcc0874b2 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.849350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159efae-2403-464d-b37e-665dcc0874b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.886936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-3159efae-2403-464d-b37e-665dcc0874b2 None None] MFA Rules not processed for user `b447471168b747bca5ad5fc41f6982aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:46.888803 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3159efae-2403-464d-b37e-665dcc0874b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:46.953408 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1421/2810] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:46.958590 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4de1a-f187-4674-bcfa-42980afc35f3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.020260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4de1a-f187-4674-bcfa-42980afc35f3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.024823 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb94ba5-c03c-4837-93e7-575b4021a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.025416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb94ba5-c03c-4837-93e7-575b4021a52a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.025692 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb94ba5-c03c-4837-93e7-575b4021a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.025963 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb94ba5-c03c-4837-93e7-575b4021a52a admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.026623 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb94ba5-c03c-4837-93e7-575b4021a52a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.028507 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb94ba5-c03c-4837-93e7-575b4021a52a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.054214 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1390/2811] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:46 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:47.058575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159efae-2403-464d-b37e-665dcc0874b2 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.070639 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159efae-2403-464d-b37e-665dcc0874b2 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.075117 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:47.127770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f369-857d-4d66-8c3f-23c54585e45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.128972 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f369-857d-4d66-8c3f-23c54585e45b admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.129249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f369-857d-4d66-8c3f-23c54585e45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.129515 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f369-857d-4d66-8c3f-23c54585e45b admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.130131 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7f369-857d-4d66-8c3f-23c54585e45b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.132096 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7f369-857d-4d66-8c3f-23c54585e45b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.153467 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1422/2812] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:47 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:47.158731 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb94ba5-c03c-4837-93e7-575b4021a52a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.172318 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb94ba5-c03c-4837-93e7-575b4021a52a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.180412 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aff100-2161-44dc-85cf-175404929a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.181421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aff100-2161-44dc-85cf-175404929a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.182066 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aff100-2161-44dc-85cf-175404929a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.182570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aff100-2161-44dc-85cf-175404929a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.183628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aff100-2161-44dc-85cf-175404929a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.186763 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aff100-2161-44dc-85cf-175404929a1c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.208682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1391/2813] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:47.214424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f369-857d-4d66-8c3f-23c54585e45b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.228049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f369-857d-4d66-8c3f-23c54585e45b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.233378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdb852-5fae-4b44-9ef7-3c8289f167b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.234527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdb852-5fae-4b44-9ef7-3c8289f167b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.234527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdb852-5fae-4b44-9ef7-3c8289f167b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.234764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdb852-5fae-4b44-9ef7-3c8289f167b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.235232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdb852-5fae-4b44-9ef7-3c8289f167b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.236978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdb852-5fae-4b44-9ef7-3c8289f167b9 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.250516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1423/2814] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:47.255407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aff100-2161-44dc-85cf-175404929a1c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.266083 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aff100-2161-44dc-85cf-175404929a1c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.272315 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9942b3-ba6f-4d7c-90c9-72ae92f0e7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.273154 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9942b3-ba6f-4d7c-90c9-72ae92f0e7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.273338 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9942b3-ba6f-4d7c-90c9-72ae92f0e7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.273574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9942b3-ba6f-4d7c-90c9-72ae92f0e7c4 admin admin] PATH_INFO: `/v3/projects/6e05788e4c194de9ad6c28366396d532/users/bf4c8095f253469fa4b28bf8b61854ab/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.295325 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9942b3-ba6f-4d7c-90c9-72ae92f0e7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e05788e4c194de9ad6c28366396d532, user_id=bf4c8095f253469fa4b28bf8b61854ab, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.298087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9942b3-ba6f-4d7c-90c9-72ae92f0e7c4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.314901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1392/2815] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:47 2022] PUT /identity/v3/projects/6e05788e4c194de9ad6c28366396d532/users/bf4c8095f253469fa4b28bf8b61854ab/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:47.327527 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b9fe8-7fa6-4c06-b0df-45bb19f8d42f None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.327871 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b9fe8-7fa6-4c06-b0df-45bb19f8d42f None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.328079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b9fe8-7fa6-4c06-b0df-45bb19f8d42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.358461 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-645b9fe8-7fa6-4c06-b0df-45bb19f8d42f None None] MFA Rules not processed for user `bf4c8095f253469fa4b28bf8b61854ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:47.359748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-645b9fe8-7fa6-4c06-b0df-45bb19f8d42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:47.379953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9942b3-ba6f-4d7c-90c9-72ae92f0e7c4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.388662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bb9942b3-ba6f-4d7c-90c9-72ae92f0e7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:47.435430 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1424/2816] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:47.439931 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b9fe8-7fa6-4c06-b0df-45bb19f8d42f None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.452353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9942b3-ba6f-4d7c-90c9-72ae92f0e7c4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.456978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58525a8b-3a04-41b2-bf00-ee5a66b03823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.457605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58525a8b-3a04-41b2-bf00-ee5a66b03823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.457882 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58525a8b-3a04-41b2-bf00-ee5a66b03823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.458159 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58525a8b-3a04-41b2-bf00-ee5a66b03823 admin admin] PATH_INFO: `/v3/users/7a413fa9e0ef4e11ac54bbba37a974b1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.459377 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58525a8b-3a04-41b2-bf00-ee5a66b03823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a413fa9e0ef4e11ac54bbba37a974b1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.461475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58525a8b-3a04-41b2-bf00-ee5a66b03823 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.505064 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b9fe8-7fa6-4c06-b0df-45bb19f8d42f None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.509024 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-58525a8b-3a04-41b2-bf00-ee5a66b03823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a413fa9e0ef4e11ac54bbba37a974b1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:47.509836 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1f681-ef44-4018-80bb-a0a433ca7a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.510514 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1f681-ef44-4018-80bb-a0a433ca7a42 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.511249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1f681-ef44-4018-80bb-a0a433ca7a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.511249 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1f681-ef44-4018-80bb-a0a433ca7a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.511456 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:47.511693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1f681-ef44-4018-80bb-a0a433ca7a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.513661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1f681-ef44-4018-80bb-a0a433ca7a42 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.518405 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-58525a8b-3a04-41b2-bf00-ee5a66b03823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a413fa9e0ef4e11ac54bbba37a974b1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:47.533097 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-58525a8b-3a04-41b2-bf00-ee5a66b03823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a413fa9e0ef4e11ac54bbba37a974b1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:47.533938 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-58525a8b-3a04-41b2-bf00-ee5a66b03823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a413fa9e0ef4e11ac54bbba37a974b1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:47.535891 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-58525a8b-3a04-41b2-bf00-ee5a66b03823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a413fa9e0ef4e11ac54bbba37a974b1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:47.544188 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1425/2817] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:47 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:47.548287 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1f681-ef44-4018-80bb-a0a433ca7a42 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.549995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-43e1f681-ef44-4018-80bb-a0a433ca7a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:47.551760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1393/2818] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:47 2022] DELETE /identity/v3/users/7a413fa9e0ef4e11ac54bbba37a974b1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:47.555726 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e085cbe-09fb-4c66-a317-3da0c7a1148b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.556016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e085cbe-09fb-4c66-a317-3da0c7a1148b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.556291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e085cbe-09fb-4c66-a317-3da0c7a1148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.558088 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:47.575493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7e085cbe-09fb-4c66-a317-3da0c7a1148b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:47.576700 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7e085cbe-09fb-4c66-a317-3da0c7a1148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:47.619695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1f681-ef44-4018-80bb-a0a433ca7a42 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.637391 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1394/2819] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:47.647253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e085cbe-09fb-4c66-a317-3da0c7a1148b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.648707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7e085cbe-09fb-4c66-a317-3da0c7a1148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:47.678897 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73301fa-5d24-469f-b57b-e730b844d920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.679531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73301fa-5d24-469f-b57b-e730b844d920 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.679790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73301fa-5d24-469f-b57b-e730b844d920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.680063 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73301fa-5d24-469f-b57b-e730b844d920 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.680735 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73301fa-5d24-469f-b57b-e730b844d920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.682806 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73301fa-5d24-469f-b57b-e730b844d920 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.703994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1426/2820] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:47 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:47.706363 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e085cbe-09fb-4c66-a317-3da0c7a1148b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.708362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73301fa-5d24-469f-b57b-e730b844d920 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.710293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334cf9e-889f-49f9-b01c-3aebfb862202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.710914 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334cf9e-889f-49f9-b01c-3aebfb862202 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.711191 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334cf9e-889f-49f9-b01c-3aebfb862202 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.711460 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334cf9e-889f-49f9-b01c-3aebfb862202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.718617 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73301fa-5d24-469f-b57b-e730b844d920 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.721413 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334cf9e-889f-49f9-b01c-3aebfb862202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.723643 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334cf9e-889f-49f9-b01c-3aebfb862202 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.723952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ac71b-657b-475f-a370-41357ded7a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.724545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ac71b-657b-475f-a370-41357ded7a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.724850 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ac71b-657b-475f-a370-41357ded7a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.725120 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ac71b-657b-475f-a370-41357ded7a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.725776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ac71b-657b-475f-a370-41357ded7a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.727399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ac71b-657b-475f-a370-41357ded7a66 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.733595 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1395/2821] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:47.738076 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1427/2822] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:38:47.742441 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334cf9e-889f-49f9-b01c-3aebfb862202 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.752313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334cf9e-889f-49f9-b01c-3aebfb862202 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.757178 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4fc2b-57b2-43b6-8d3a-8cd04dc16ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.757825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4fc2b-57b2-43b6-8d3a-8cd04dc16ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.758103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4fc2b-57b2-43b6-8d3a-8cd04dc16ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.758403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4fc2b-57b2-43b6-8d3a-8cd04dc16ddb admin admin] PATH_INFO: `/v3/projects/be33db5dfcb948f294b9e7e8a817ba4a/users/384018400db94b44aeb3828c29f00dc5/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.774461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4fc2b-57b2-43b6-8d3a-8cd04dc16ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=be33db5dfcb948f294b9e7e8a817ba4a, user_id=384018400db94b44aeb3828c29f00dc5, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.777536 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4fc2b-57b2-43b6-8d3a-8cd04dc16ddb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.796605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1396/2823] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:47 2022] PUT /identity/v3/projects/be33db5dfcb948f294b9e7e8a817ba4a/users/384018400db94b44aeb3828c29f00dc5/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:47.798033 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ac71b-657b-475f-a370-41357ded7a66 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.812647 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ac71b-657b-475f-a370-41357ded7a66 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.873006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eb87f-ba18-44b6-8498-780f8813f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.873612 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eb87f-ba18-44b6-8498-780f8813f6be admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.873902 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eb87f-ba18-44b6-8498-780f8813f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.874157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eb87f-ba18-44b6-8498-780f8813f6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.874814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62eb87f-ba18-44b6-8498-780f8813f6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.876400 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62eb87f-ba18-44b6-8498-780f8813f6be admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.891166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1428/2824] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:47.895985 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4fc2b-57b2-43b6-8d3a-8cd04dc16ddb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.906064 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4fc2b-57b2-43b6-8d3a-8cd04dc16ddb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.911562 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cfcf0-8bd2-4cb7-9d7b-dbb9d9ed3943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.912213 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cfcf0-8bd2-4cb7-9d7b-dbb9d9ed3943 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.912493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cfcf0-8bd2-4cb7-9d7b-dbb9d9ed3943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.912762 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cfcf0-8bd2-4cb7-9d7b-dbb9d9ed3943 admin admin] PATH_INFO: `/v3/projects/be33db5dfcb948f294b9e7e8a817ba4a/users/384018400db94b44aeb3828c29f00dc5/roles/6413aac4240a46ba816472c29e305973` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.914945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cfcf0-8bd2-4cb7-9d7b-dbb9d9ed3943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be33db5dfcb948f294b9e7e8a817ba4a, user_id=384018400db94b44aeb3828c29f00dc5, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.917548 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cfcf0-8bd2-4cb7-9d7b-dbb9d9ed3943 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.928493 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1397/2825] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:47 2022] PUT /identity/v3/projects/be33db5dfcb948f294b9e7e8a817ba4a/users/384018400db94b44aeb3828c29f00dc5/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:47.938440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044de355-a762-4d74-aadf-c31bd9582635 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.938728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044de355-a762-4d74-aadf-c31bd9582635 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.939000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044de355-a762-4d74-aadf-c31bd9582635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.968006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-044de355-a762-4d74-aadf-c31bd9582635 None None] MFA Rules not processed for user `384018400db94b44aeb3828c29f00dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:47.969259 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-044de355-a762-4d74-aadf-c31bd9582635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:47.982416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:48.017147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cfcf0-8bd2-4cb7-9d7b-dbb9d9ed3943 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:48.020876 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7d3cfcf0-8bd2-4cb7-9d7b-dbb9d9ed3943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:48.056251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1429/2826] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:48.063912 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:48.068328 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044de355-a762-4d74-aadf-c31bd9582635 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:48.069690 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-044de355-a762-4d74-aadf-c31bd9582635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:48.096904 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cfcf0-8bd2-4cb7-9d7b-dbb9d9ed3943 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:48.101843 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:48.102516 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.102799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.103072 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] PATH_INFO: `/v3/projects/3e8b0da67df1498dba803a161b500596` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.104235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8b0da67df1498dba803a161b500596)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:48.106147 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:48.128880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044de355-a762-4d74-aadf-c31bd9582635 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:48.133355 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2921d8-4837-4011-b4b2-48cee871c733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:48.133962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2921d8-4837-4011-b4b2-48cee871c733 service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.134261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2921d8-4837-4011-b4b2-48cee871c733 service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.134687 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2921d8-4837-4011-b4b2-48cee871c733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.144059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2921d8-4837-4011-b4b2-48cee871c733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:48.145667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2921d8-4837-4011-b4b2-48cee871c733 service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:48.154594 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8b0da67df1498dba803a161b500596', 'request_id': 'req-ce278c83-c398-4c4c-9687-ec49659801b8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.155598 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1430/2827] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:48.165339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8b0da67df1498dba803a161b500596', 'request_id': 'req-ce278c83-c398-4c4c-9687-ec49659801b8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.172939 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8b0da67df1498dba803a161b500596', 'request_id': 'req-ce278c83-c398-4c4c-9687-ec49659801b8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.184753 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] The token cache is being invalidate because project 3e8b0da67df1498dba803a161b500596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:48.185087 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.185694 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.187226 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1398/2828] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:48 2022] DELETE /identity/v3/projects/3e8b0da67df1498dba803a161b500596 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:48.191768 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2921d8-4837-4011-b4b2-48cee871c733 service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:48.198466 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:48.199831 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:48.202022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2921d8-4837-4011-b4b2-48cee871c733 service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:48.264700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71243a38-3123-4b19-8d4a-4773069db061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:48.265339 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243a38-3123-4b19-8d4a-4773069db061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.265613 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243a38-3123-4b19-8d4a-4773069db061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.265880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243a38-3123-4b19-8d4a-4773069db061 admin admin] PATH_INFO: `/v3/users/724d12d98af747d59a448985ae9425f2` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.266111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce278c83-c398-4c4c-9687-ec49659801b8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:48.266998 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71243a38-3123-4b19-8d4a-4773069db061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=724d12d98af747d59a448985ae9425f2)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:48.269022 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71243a38-3123-4b19-8d4a-4773069db061 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:48.270011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a2265-2795-4996-9e5a-3efff38173e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:48.270649 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a2265-2795-4996-9e5a-3efff38173e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.270928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a2265-2795-4996-9e5a-3efff38173e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.271198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a2265-2795-4996-9e5a-3efff38173e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.273012 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5b9a2265-2795-4996-9e5a-3efff38173e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:48.318673 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-71243a38-3123-4b19-8d4a-4773069db061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724d12d98af747d59a448985ae9425f2'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.323887 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:48.326535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-71243a38-3123-4b19-8d4a-4773069db061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724d12d98af747d59a448985ae9425f2'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.335475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a2265-2795-4996-9e5a-3efff38173e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:48.336944 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a2265-2795-4996-9e5a-3efff38173e3 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:48.339280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-71243a38-3123-4b19-8d4a-4773069db061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724d12d98af747d59a448985ae9425f2'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.339981 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-71243a38-3123-4b19-8d4a-4773069db061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724d12d98af747d59a448985ae9425f2'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.340759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-71243a38-3123-4b19-8d4a-4773069db061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724d12d98af747d59a448985ae9425f2'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.345774 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1399/2829] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:48.354516 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1431/2830] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:48 2022] DELETE /identity/v3/users/724d12d98af747d59a448985ae9425f2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:48.634458 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a2265-2795-4996-9e5a-3efff38173e3 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:48.636757 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5b9a2265-2795-4996-9e5a-3efff38173e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:48.680006 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a2265-2795-4996-9e5a-3efff38173e3 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:48.699171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:48.750149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8df24b-4532-44df-a3a8-8bc820fda016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:48.750873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df24b-4532-44df-a3a8-8bc820fda016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.751155 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df24b-4532-44df-a3a8-8bc820fda016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.751426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df24b-4532-44df-a3a8-8bc820fda016 admin admin] PATH_INFO: `/v3/projects/a3d9ae7319344c47862635095cfe3e87` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.752574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8df24b-4532-44df-a3a8-8bc820fda016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d9ae7319344c47862635095cfe3e87)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:48.754686 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8df24b-4532-44df-a3a8-8bc820fda016 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:48.806657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad8df24b-4532-44df-a3a8-8bc820fda016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d9ae7319344c47862635095cfe3e87', 'request_id': 'req-ad8df24b-4532-44df-a3a8-8bc820fda016'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.814934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad8df24b-4532-44df-a3a8-8bc820fda016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d9ae7319344c47862635095cfe3e87', 'request_id': 'req-ad8df24b-4532-44df-a3a8-8bc820fda016'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.821570 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad8df24b-4532-44df-a3a8-8bc820fda016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d9ae7319344c47862635095cfe3e87', 'request_id': 'req-ad8df24b-4532-44df-a3a8-8bc820fda016'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.832607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad8df24b-4532-44df-a3a8-8bc820fda016 admin admin] The token cache is being invalidate because project a3d9ae7319344c47862635095cfe3e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:48.832898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad8df24b-4532-44df-a3a8-8bc820fda016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.833532 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ad8df24b-4532-44df-a3a8-8bc820fda016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:48.835049 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1400/2831] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:48 2022] DELETE /identity/v3/projects/a3d9ae7319344c47862635095cfe3e87 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:48.839683 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177b66-1b37-49ec-87d5-252651db61b5 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.840174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177b66-1b37-49ec-87d5-252651db61b5 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.840617 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177b66-1b37-49ec-87d5-252651db61b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.860517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-80177b66-1b37-49ec-87d5-252651db61b5 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:48.861717 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-80177b66-1b37-49ec-87d5-252651db61b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:48.922246 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1432/2832] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:48.930988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdcb16-eaa4-4096-ad3b-3b8ea9660cec None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.931273 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdcb16-eaa4-4096-ad3b-3b8ea9660cec None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.931578 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdcb16-eaa4-4096-ad3b-3b8ea9660cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.955779 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a2cdcb16-eaa4-4096-ad3b-3b8ea9660cec None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:48.957816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a2cdcb16-eaa4-4096-ad3b-3b8ea9660cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:48.974529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1401/2833] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:48.980761 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177b66-1b37-49ec-87d5-252651db61b5 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:48.990667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177b66-1b37-49ec-87d5-252651db61b5 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:48.996506 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ad821-509c-4bf1-82af-0e473ce71e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:48.997104 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ad821-509c-4bf1-82af-0e473ce71e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.997386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ad821-509c-4bf1-82af-0e473ce71e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.997655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ad821-509c-4bf1-82af-0e473ce71e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.999638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ad821-509c-4bf1-82af-0e473ce71e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:48.999638 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ad821-509c-4bf1-82af-0e473ce71e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.001279 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ad821-509c-4bf1-82af-0e473ce71e32 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.016100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1433/2834] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:49.021018 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdcb16-eaa4-4096-ad3b-3b8ea9660cec None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.031869 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdcb16-eaa4-4096-ad3b-3b8ea9660cec None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.036971 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d5bc8-6330-468b-871d-4d02e83c3b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.037583 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d5bc8-6330-468b-871d-4d02e83c3b41 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.037902 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d5bc8-6330-468b-871d-4d02e83c3b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.038168 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d5bc8-6330-468b-871d-4d02e83c3b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.039639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d5bc8-6330-468b-871d-4d02e83c3b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.042648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d5bc8-6330-468b-871d-4d02e83c3b41 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.079341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1402/2835] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:49 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:49.084275 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ad821-509c-4bf1-82af-0e473ce71e32 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.094179 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ad821-509c-4bf1-82af-0e473ce71e32 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.154214 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d522cc-bcb2-448f-b433-60168c816210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.154859 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d522cc-bcb2-448f-b433-60168c816210 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.155457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d522cc-bcb2-448f-b433-60168c816210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.155681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d522cc-bcb2-448f-b433-60168c816210 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.156395 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d522cc-bcb2-448f-b433-60168c816210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.158326 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d522cc-bcb2-448f-b433-60168c816210 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.180822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1434/2836] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:49 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:49.185667 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d5bc8-6330-468b-871d-4d02e83c3b41 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.196964 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d5bc8-6330-468b-871d-4d02e83c3b41 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.201685 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5de8c5-556f-487c-966e-5c1ce9d0e4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.202598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5de8c5-556f-487c-966e-5c1ce9d0e4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.202878 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5de8c5-556f-487c-966e-5c1ce9d0e4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.203146 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5de8c5-556f-487c-966e-5c1ce9d0e4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.203905 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5de8c5-556f-487c-966e-5c1ce9d0e4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.205505 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5de8c5-556f-487c-966e-5c1ce9d0e4e9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.218019 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1403/2837] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:49.222332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d522cc-bcb2-448f-b433-60168c816210 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.234215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d522cc-bcb2-448f-b433-60168c816210 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.242517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33999b-6cbc-427f-b136-3eeda0242776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.243119 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33999b-6cbc-427f-b136-3eeda0242776 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.243400 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33999b-6cbc-427f-b136-3eeda0242776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.243670 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33999b-6cbc-427f-b136-3eeda0242776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.244304 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33999b-6cbc-427f-b136-3eeda0242776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.245891 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33999b-6cbc-427f-b136-3eeda0242776 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.262468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1435/2838] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:49.266836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5de8c5-556f-487c-966e-5c1ce9d0e4e9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.280198 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5de8c5-556f-487c-966e-5c1ce9d0e4e9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.288859 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2014d2c-83d9-4b60-ad6f-254c4ee8d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.289764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2014d2c-83d9-4b60-ad6f-254c4ee8d3af admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.290036 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2014d2c-83d9-4b60-ad6f-254c4ee8d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.290301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2014d2c-83d9-4b60-ad6f-254c4ee8d3af admin admin] PATH_INFO: `/v3/projects/2183d05d33f24505a832d51da37cb421/users/3c18b9294b624c89a0018a6d3f6eacbc/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.308788 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2014d2c-83d9-4b60-ad6f-254c4ee8d3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2183d05d33f24505a832d51da37cb421, user_id=3c18b9294b624c89a0018a6d3f6eacbc, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.311475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2014d2c-83d9-4b60-ad6f-254c4ee8d3af admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.325817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1404/2839] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:49 2022] PUT /identity/v3/projects/2183d05d33f24505a832d51da37cb421/users/3c18b9294b624c89a0018a6d3f6eacbc/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:49.337461 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09c099-113e-48d4-aa6d-89d9a8d60257 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.337746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09c099-113e-48d4-aa6d-89d9a8d60257 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.338021 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09c099-113e-48d4-aa6d-89d9a8d60257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.370739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-be09c099-113e-48d4-aa6d-89d9a8d60257 None None] MFA Rules not processed for user `3c18b9294b624c89a0018a6d3f6eacbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:49.371969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-be09c099-113e-48d4-aa6d-89d9a8d60257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:49.403679 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:49.455401 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1436/2840] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:49.460652 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2014d2c-83d9-4b60-ad6f-254c4ee8d3af admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.516529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:49.539423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2014d2c-83d9-4b60-ad6f-254c4ee8d3af admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.544185 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66dd71-dc7e-4ead-9632-d9364a718848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.544792 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66dd71-dc7e-4ead-9632-d9364a718848 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.545072 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66dd71-dc7e-4ead-9632-d9364a718848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.545341 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66dd71-dc7e-4ead-9632-d9364a718848 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.546098 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66dd71-dc7e-4ead-9632-d9364a718848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.548062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66dd71-dc7e-4ead-9632-d9364a718848 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.587011 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1405/2841] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:49 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:49.591292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09c099-113e-48d4-aa6d-89d9a8d60257 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.607784 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09c099-113e-48d4-aa6d-89d9a8d60257 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.671675 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc1d8b-1d2a-428f-a26e-b31148f5c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.672699 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1d8b-1d2a-428f-a26e-b31148f5c044 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.673150 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1d8b-1d2a-428f-a26e-b31148f5c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.673583 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1d8b-1d2a-428f-a26e-b31148f5c044 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.674658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc1d8b-1d2a-428f-a26e-b31148f5c044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.678526 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc1d8b-1d2a-428f-a26e-b31148f5c044 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.708232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1437/2842] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:49 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:49.712394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66dd71-dc7e-4ead-9632-d9364a718848 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.723813 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66dd71-dc7e-4ead-9632-d9364a718848 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.728524 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18decc1e-de91-4945-a9b9-f30cb187b419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.729127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18decc1e-de91-4945-a9b9-f30cb187b419 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.729404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18decc1e-de91-4945-a9b9-f30cb187b419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.729671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18decc1e-de91-4945-a9b9-f30cb187b419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.730302 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18decc1e-de91-4945-a9b9-f30cb187b419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.731916 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18decc1e-de91-4945-a9b9-f30cb187b419 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.743165 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1406/2843] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:49.747350 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc1d8b-1d2a-428f-a26e-b31148f5c044 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.757747 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc1d8b-1d2a-428f-a26e-b31148f5c044 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.762479 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378524df-085f-4ad3-bf90-1e2e55b378a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.763142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378524df-085f-4ad3-bf90-1e2e55b378a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.763420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378524df-085f-4ad3-bf90-1e2e55b378a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.763693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378524df-085f-4ad3-bf90-1e2e55b378a0 admin admin] PATH_INFO: `/v3/projects/2137abb292544ba983b1f4476562bdaa/users/60d934ba03044bb3b51cc9af4955fe7a/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.778969 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378524df-085f-4ad3-bf90-1e2e55b378a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2137abb292544ba983b1f4476562bdaa, user_id=60d934ba03044bb3b51cc9af4955fe7a, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.781635 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378524df-085f-4ad3-bf90-1e2e55b378a0 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.795844 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1438/2844] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:49 2022] PUT /identity/v3/projects/2137abb292544ba983b1f4476562bdaa/users/60d934ba03044bb3b51cc9af4955fe7a/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:49.800463 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18decc1e-de91-4945-a9b9-f30cb187b419 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.815186 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18decc1e-de91-4945-a9b9-f30cb187b419 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.876911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dacbf7-3df0-420b-b88d-60f16f5ebe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.877628 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dacbf7-3df0-420b-b88d-60f16f5ebe68 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.877798 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dacbf7-3df0-420b-b88d-60f16f5ebe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.878128 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dacbf7-3df0-420b-b88d-60f16f5ebe68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.878820 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dacbf7-3df0-420b-b88d-60f16f5ebe68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.880436 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dacbf7-3df0-420b-b88d-60f16f5ebe68 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.895007 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1407/2845] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:49.896707 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378524df-085f-4ad3-bf90-1e2e55b378a0 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.908934 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378524df-085f-4ad3-bf90-1e2e55b378a0 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.915116 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b5638-ff33-40bc-aa50-b3dd6438341d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.915768 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b5638-ff33-40bc-aa50-b3dd6438341d admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.916050 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b5638-ff33-40bc-aa50-b3dd6438341d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.916323 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b5638-ff33-40bc-aa50-b3dd6438341d admin admin] PATH_INFO: `/v3/projects/2137abb292544ba983b1f4476562bdaa/users/60d934ba03044bb3b51cc9af4955fe7a/roles/6413aac4240a46ba816472c29e305973` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.918284 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b5638-ff33-40bc-aa50-b3dd6438341d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2137abb292544ba983b1f4476562bdaa, user_id=60d934ba03044bb3b51cc9af4955fe7a, role_id=6413aac4240a46ba816472c29e305973)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.920962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b5638-ff33-40bc-aa50-b3dd6438341d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.934694 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1439/2846] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:49 2022] PUT /identity/v3/projects/2137abb292544ba983b1f4476562bdaa/users/60d934ba03044bb3b51cc9af4955fe7a/roles/6413aac4240a46ba816472c29e305973 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:49.945897 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c052a-c98f-4fa3-8cdb-fbabedfc6bca None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.946180 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c052a-c98f-4fa3-8cdb-fbabedfc6bca None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.946485 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c052a-c98f-4fa3-8cdb-fbabedfc6bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.983105 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c85c052a-c98f-4fa3-8cdb-fbabedfc6bca None None] MFA Rules not processed for user `60d934ba03044bb3b51cc9af4955fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:49.983691 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c85c052a-c98f-4fa3-8cdb-fbabedfc6bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:50.071640 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1408/2847] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:50.086943 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b5638-ff33-40bc-aa50-b3dd6438341d admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:50.088648 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e29b5638-ff33-40bc-aa50-b3dd6438341d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:50.161141 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b5638-ff33-40bc-aa50-b3dd6438341d admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:50.165025 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df998d3-34cd-4040-8607-b87a971bafeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:50.165681 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df998d3-34cd-4040-8607-b87a971bafeb service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:50.165956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df998d3-34cd-4040-8607-b87a971bafeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:50.166244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df998d3-34cd-4040-8607-b87a971bafeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:50.177637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df998d3-34cd-4040-8607-b87a971bafeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:50.179318 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df998d3-34cd-4040-8607-b87a971bafeb service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:50.189565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1440/2848] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:50.278549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c052a-c98f-4fa3-8cdb-fbabedfc6bca None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:50.290397 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c052a-c98f-4fa3-8cdb-fbabedfc6bca None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:50.294345 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c132a-a9ff-4d29-b726-86328a8a542f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:50.294978 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c132a-a9ff-4d29-b726-86328a8a542f service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:50.295257 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c132a-a9ff-4d29-b726-86328a8a542f service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:50.295529 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c132a-a9ff-4d29-b726-86328a8a542f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:50.348509 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:50.370587 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c132a-a9ff-4d29-b726-86328a8a542f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:50.372036 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c132a-a9ff-4d29-b726-86328a8a542f service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:50.392006 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1409/2849] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:50.658340 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df998d3-34cd-4040-8607-b87a971bafeb service cinder] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:50.688425 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:50.732006 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df998d3-34cd-4040-8607-b87a971bafeb service cinder] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:50.736549 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:50.737174 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:50.737565 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:50.737865 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] PATH_INFO: `/v3/users/3c18b9294b624c89a0018a6d3f6eacbc` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:50.738994 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c18b9294b624c89a0018a6d3f6eacbc)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:50.740905 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:50.787492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c18b9294b624c89a0018a6d3f6eacbc'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:50.794534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c18b9294b624c89a0018a6d3f6eacbc'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:50.806100 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c18b9294b624c89a0018a6d3f6eacbc'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:50.806770 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c18b9294b624c89a0018a6d3f6eacbc'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:50.807371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c18b9294b624c89a0018a6d3f6eacbc'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:50.820999 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1441/2850] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:50 2022] DELETE /identity/v3/users/3c18b9294b624c89a0018a6d3f6eacbc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:50.825518 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096b48f-4db7-40aa-9709-63fb9bd31217 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:50.825764 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096b48f-4db7-40aa-9709-63fb9bd31217 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:50.826040 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096b48f-4db7-40aa-9709-63fb9bd31217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:50.845663 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3096b48f-4db7-40aa-9709-63fb9bd31217 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:50.847166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3096b48f-4db7-40aa-9709-63fb9bd31217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:50.905673 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1410/2851] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:50.915633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:50.917274 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:50.973979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9d3df-b6a2-41e8-a671-dce8e32e3cdd admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:50.977652 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eb12d-7bea-47d1-83b7-61b38b67da10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:50.978252 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eb12d-7bea-47d1-83b7-61b38b67da10 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:50.978576 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eb12d-7bea-47d1-83b7-61b38b67da10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:50.978853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eb12d-7bea-47d1-83b7-61b38b67da10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:50.988580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3eb12d-7bea-47d1-83b7-61b38b67da10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:50.990015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3eb12d-7bea-47d1-83b7-61b38b67da10 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:50.999410 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1442/2852] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:51.275781 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096b48f-4db7-40aa-9709-63fb9bd31217 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:51.278138 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3096b48f-4db7-40aa-9709-63fb9bd31217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:51.292657 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096b48f-4db7-40aa-9709-63fb9bd31217 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:51.299080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:51.300527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:51.301001 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:51.301433 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] PATH_INFO: `/v3/projects/2183d05d33f24505a832d51da37cb421` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:51.302756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2183d05d33f24505a832d51da37cb421)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:51.304851 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:51.345717 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eb12d-7bea-47d1-83b7-61b38b67da10 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:51.347759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cf3eb12d-7bea-47d1-83b7-61b38b67da10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:51.358445 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2183d05d33f24505a832d51da37cb421', 'request_id': 'req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.360420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eb12d-7bea-47d1-83b7-61b38b67da10 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:51.367605 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2183d05d33f24505a832d51da37cb421', 'request_id': 'req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.374466 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2183d05d33f24505a832d51da37cb421', 'request_id': 'req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.391639 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] The token cache is being invalidate because project 2183d05d33f24505a832d51da37cb421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:51.392142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.392799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.394330 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1411/2853] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:51 2022] DELETE /identity/v3/projects/2183d05d33f24505a832d51da37cb421 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:51.398190 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:51.399566 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:51.408007 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:51.429529 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907f104-d22d-4cc0-b851-dcb37e1e492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:51.430473 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907f104-d22d-4cc0-b851-dcb37e1e492d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:51.431391 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907f104-d22d-4cc0-b851-dcb37e1e492d admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:51.431820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907f104-d22d-4cc0-b851-dcb37e1e492d admin admin] PATH_INFO: `/v3/users/b447471168b747bca5ad5fc41f6982aa` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:51.433378 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907f104-d22d-4cc0-b851-dcb37e1e492d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b447471168b747bca5ad5fc41f6982aa)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:51.435331 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907f104-d22d-4cc0-b851-dcb37e1e492d admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:51.476595 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ed49d-cf9d-437e-8481-c59d8eefb1ad admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:51.481357 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:51.482058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:51.482336 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:51.482634 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] PATH_INFO: `/v3/users/60d934ba03044bb3b51cc9af4955fe7a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:51.483741 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d934ba03044bb3b51cc9af4955fe7a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:51.485711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:51.488674 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:51.491619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9907f104-d22d-4cc0-b851-dcb37e1e492d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b447471168b747bca5ad5fc41f6982aa'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.504759 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9907f104-d22d-4cc0-b851-dcb37e1e492d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b447471168b747bca5ad5fc41f6982aa'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.519468 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9907f104-d22d-4cc0-b851-dcb37e1e492d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b447471168b747bca5ad5fc41f6982aa'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.520365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9907f104-d22d-4cc0-b851-dcb37e1e492d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b447471168b747bca5ad5fc41f6982aa'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.521061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9907f104-d22d-4cc0-b851-dcb37e1e492d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b447471168b747bca5ad5fc41f6982aa'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.536700 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1443/2854] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:51 2022] DELETE /identity/v3/users/b447471168b747bca5ad5fc41f6982aa => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:51.541361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868f0da-53cc-41ea-af8e-434cb6761b0b None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:51.542221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868f0da-53cc-41ea-af8e-434cb6761b0b None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:51.542221 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868f0da-53cc-41ea-af8e-434cb6761b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:51.546480 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d934ba03044bb3b51cc9af4955fe7a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.555709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d934ba03044bb3b51cc9af4955fe7a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.563624 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f868f0da-53cc-41ea-af8e-434cb6761b0b None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:51.564814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f868f0da-53cc-41ea-af8e-434cb6761b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:51.568877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d934ba03044bb3b51cc9af4955fe7a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.570012 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d934ba03044bb3b51cc9af4955fe7a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.571279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d934ba03044bb3b51cc9af4955fe7a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:51.589842 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1412/2855] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:51 2022] DELETE /identity/v3/users/60d934ba03044bb3b51cc9af4955fe7a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:51.635053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1444/2856] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:51.645801 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:51.647353 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:51.716075 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24516-74bc-4499-ba96-cc07c4028b78 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:51.719727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4c025-0a1c-414f-97af-46b82953c933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:51.720333 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4c025-0a1c-414f-97af-46b82953c933 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:51.720607 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4c025-0a1c-414f-97af-46b82953c933 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:51.720875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4c025-0a1c-414f-97af-46b82953c933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:51.788227 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4c025-0a1c-414f-97af-46b82953c933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:51.789947 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4c025-0a1c-414f-97af-46b82953c933 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:51.799945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1413/2857] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:51.959258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868f0da-53cc-41ea-af8e-434cb6761b0b None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:51.960701 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f868f0da-53cc-41ea-af8e-434cb6761b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:51.973193 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868f0da-53cc-41ea-af8e-434cb6761b0b None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:51.977788 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:51.978466 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:51.978747 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:51.979136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] PATH_INFO: `/v3/projects/2137abb292544ba983b1f4476562bdaa` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:51.980280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2137abb292544ba983b1f4476562bdaa)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:51.982192 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:52.039500 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2137abb292544ba983b1f4476562bdaa', 'request_id': 'req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.046318 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2137abb292544ba983b1f4476562bdaa', 'request_id': 'req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.050578 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:52.052971 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2137abb292544ba983b1f4476562bdaa', 'request_id': 'req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.069892 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] The token cache is being invalidate because project 2137abb292544ba983b1f4476562bdaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:52.070207 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.070862 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.072492 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1445/2858] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:51 2022] DELETE /identity/v3/projects/2137abb292544ba983b1f4476562bdaa => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:52.077268 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6354b-46a1-4dfc-b0cb-e97ca7ec7d01 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.077548 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6354b-46a1-4dfc-b0cb-e97ca7ec7d01 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.077816 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6354b-46a1-4dfc-b0cb-e97ca7ec7d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.098349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2db6354b-46a1-4dfc-b0cb-e97ca7ec7d01 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:52.099654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2db6354b-46a1-4dfc-b0cb-e97ca7ec7d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:52.126183 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:52.167648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1414/2859] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:52.169880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:52.171517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:52.175423 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b88ef8-e476-4fdc-9c7c-7955b3736da4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.176089 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b88ef8-e476-4fdc-9c7c-7955b3736da4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.176374 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b88ef8-e476-4fdc-9c7c-7955b3736da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.185327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af20c1-f9a5-4a23-b73a-4e055a4f9d8b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:52.191111 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:52.191858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.192213 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.192597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] PATH_INFO: `/v3/projects/1d470b06dc704e2495bf159153977d6d` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.194437 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d470b06dc704e2495bf159153977d6d)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:52.197504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:52.203454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-21b88ef8-e476-4fdc-9c7c-7955b3736da4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:52.205148 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-21b88ef8-e476-4fdc-9c7c-7955b3736da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:52.215221 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1415/2860] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:52.218991 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b88ef8-e476-4fdc-9c7c-7955b3736da4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:52.228224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b88ef8-e476-4fdc-9c7c-7955b3736da4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:52.232949 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf6b1a-aede-4064-b41a-f624975cb69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:52.233538 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6b1a-aede-4064-b41a-f624975cb69f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.233813 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6b1a-aede-4064-b41a-f624975cb69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.234080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6b1a-aede-4064-b41a-f624975cb69f admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.234743 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf6b1a-aede-4064-b41a-f624975cb69f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:52.235037 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf6b1a-aede-4064-b41a-f624975cb69f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:52.236616 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf6b1a-aede-4064-b41a-f624975cb69f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:52.248139 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d470b06dc704e2495bf159153977d6d', 'request_id': 'req-369852b5-573a-4540-beb5-a550c2339d10'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.248321 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1416/2861] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:52.252638 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf6b1a-aede-4064-b41a-f624975cb69f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:52.255535 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d470b06dc704e2495bf159153977d6d', 'request_id': 'req-369852b5-573a-4540-beb5-a550c2339d10'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.261589 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d470b06dc704e2495bf159153977d6d', 'request_id': 'req-369852b5-573a-4540-beb5-a550c2339d10'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.263059 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf6b1a-aede-4064-b41a-f624975cb69f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:52.275675 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] The token cache is being invalidate because project 1d470b06dc704e2495bf159153977d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:52.275961 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.276597 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.278090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1446/2862] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:52 2022] DELETE /identity/v3/projects/1d470b06dc704e2495bf159153977d6d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:52.281868 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:52.283219 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:52.324908 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3578a-08d6-4a36-84d5-f472ed8647ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:52.325517 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3578a-08d6-4a36-84d5-f472ed8647ec admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.325786 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3578a-08d6-4a36-84d5-f472ed8647ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.326053 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3578a-08d6-4a36-84d5-f472ed8647ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.326777 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3578a-08d6-4a36-84d5-f472ed8647ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:52.328698 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3578a-08d6-4a36-84d5-f472ed8647ec admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:52.349668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369852b5-573a-4540-beb5-a550c2339d10 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:52.354657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:52.355296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.355576 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.355851 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] PATH_INFO: `/v3/users/bf4c8095f253469fa4b28bf8b61854ab` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.357031 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4c8095f253469fa4b28bf8b61854ab)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:52.357809 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1417/2863] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:52 2022] POST /identity/v3/projects => generated 361 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:52.359115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:52.361959 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3578a-08d6-4a36-84d5-f472ed8647ec admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:52.364311 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2ca3578a-08d6-4a36-84d5-f472ed8647ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:52.411463 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4c8095f253469fa4b28bf8b61854ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.419450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4c8095f253469fa4b28bf8b61854ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.430619 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3578a-08d6-4a36-84d5-f472ed8647ec admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:52.430804 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:52.432098 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4c8095f253469fa4b28bf8b61854ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.432937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4c8095f253469fa4b28bf8b61854ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.433657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4c8095f253469fa4b28bf8b61854ab'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.435664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72262e-0d7d-4bfc-b99d-41f0b848b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:52.436276 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72262e-0d7d-4bfc-b99d-41f0b848b068 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.436557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72262e-0d7d-4bfc-b99d-41f0b848b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.436892 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72262e-0d7d-4bfc-b99d-41f0b848b068 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.437687 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72262e-0d7d-4bfc-b99d-41f0b848b068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:52.440008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72262e-0d7d-4bfc-b99d-41f0b848b068 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:52.450790 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1447/2864] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:52 2022] DELETE /identity/v3/users/bf4c8095f253469fa4b28bf8b61854ab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:52.463015 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1418/2865] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:52 2022] POST /identity/v3/users => generated 281 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:52.467239 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:52.468711 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:52.542555 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fee34-614f-4b0c-b0e3-edceae0a984c admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:52.547963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53616c38-33eb-499d-9e53-85134a644a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:52.548629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53616c38-33eb-499d-9e53-85134a644a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.549230 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53616c38-33eb-499d-9e53-85134a644a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.549230 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53616c38-33eb-499d-9e53-85134a644a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.550324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53616c38-33eb-499d-9e53-85134a644a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:52.551952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53616c38-33eb-499d-9e53-85134a644a0c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:52.562680 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1448/2866] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:52.568121 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72262e-0d7d-4bfc-b99d-41f0b848b068 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:52.579313 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72262e-0d7d-4bfc-b99d-41f0b848b068 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:52.584757 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd9466-a355-48ac-aa23-36af7ba14cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:52.585474 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd9466-a355-48ac-aa23-36af7ba14cba admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.585852 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd9466-a355-48ac-aa23-36af7ba14cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.586222 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd9466-a355-48ac-aa23-36af7ba14cba admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.587078 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd9466-a355-48ac-aa23-36af7ba14cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:52.588930 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd9466-a355-48ac-aa23-36af7ba14cba admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:52.602403 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1419/2867] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:38:52.603608 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53616c38-33eb-499d-9e53-85134a644a0c admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:52.616190 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53616c38-33eb-499d-9e53-85134a644a0c admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:52.621717 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5de73c-eb2b-483d-9e0e-58de5f199e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:52.622654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5de73c-eb2b-483d-9e0e-58de5f199e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.623168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5de73c-eb2b-483d-9e0e-58de5f199e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.623356 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5de73c-eb2b-483d-9e0e-58de5f199e8b admin admin] PATH_INFO: `/v3/projects/7a138dcd8b204e71b8f5649e018b8a6e/users/dc64d76bd1e0408bb6f9ffee8e65429d/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.640345 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5de73c-eb2b-483d-9e0e-58de5f199e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a138dcd8b204e71b8f5649e018b8a6e, user_id=dc64d76bd1e0408bb6f9ffee8e65429d, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:52.643248 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5de73c-eb2b-483d-9e0e-58de5f199e8b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:52.661233 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1449/2868] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:52 2022] PUT /identity/v3/projects/7a138dcd8b204e71b8f5649e018b8a6e/users/dc64d76bd1e0408bb6f9ffee8e65429d/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:52.672176 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd706-83ef-4984-94c7-a01b955666e8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.672394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd706-83ef-4984-94c7-a01b955666e8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.672614 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd706-83ef-4984-94c7-a01b955666e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.707342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dbafd706-83ef-4984-94c7-a01b955666e8 None None] MFA Rules not processed for user `dc64d76bd1e0408bb6f9ffee8e65429d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:52.709142 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dbafd706-83ef-4984-94c7-a01b955666e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:52.713743 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:52.782201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5de73c-eb2b-483d-9e0e-58de5f199e8b admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:52.784956 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8a5de73c-eb2b-483d-9e0e-58de5f199e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:52.822065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1420/2869] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:52.860291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafd706-83ef-4984-94c7-a01b955666e8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:52.861755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dbafd706-83ef-4984-94c7-a01b955666e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:52.869104 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5de73c-eb2b-483d-9e0e-58de5f199e8b admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:52.874112 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:52.874776 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.875053 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.875327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] PATH_INFO: `/v3/projects/6e05788e4c194de9ad6c28366396d532` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.876459 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e05788e4c194de9ad6c28366396d532)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:52.879133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:52.927071 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafd706-83ef-4984-94c7-a01b955666e8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:52.930771 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e05788e4c194de9ad6c28366396d532', 'request_id': 'req-9e640632-6f4c-42a9-8e42-0eb30347c1f8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.938315 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e05788e4c194de9ad6c28366396d532', 'request_id': 'req-9e640632-6f4c-42a9-8e42-0eb30347c1f8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.944979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e05788e4c194de9ad6c28366396d532', 'request_id': 'req-9e640632-6f4c-42a9-8e42-0eb30347c1f8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.946677 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:52.962418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] The token cache is being invalidate because project 6e05788e4c194de9ad6c28366396d532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:52.963026 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.963738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:52.966296 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1450/2870] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:52 2022] DELETE /identity/v3/projects/6e05788e4c194de9ad6c28366396d532 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:52.970161 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:52.971937 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:52.980738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694e7b5-29b9-40fb-bf7f-a23298a83cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:52.981597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694e7b5-29b9-40fb-bf7f-a23298a83cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:52.981883 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694e7b5-29b9-40fb-bf7f-a23298a83cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:52.982642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694e7b5-29b9-40fb-bf7f-a23298a83cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:52.984392 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2694e7b5-29b9-40fb-bf7f-a23298a83cd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.038364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e640632-6f4c-42a9-8e42-0eb30347c1f8 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:53.043362 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca7932-a35b-4b35-a077-06c5afed4042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:53.043986 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca7932-a35b-4b35-a077-06c5afed4042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.044261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca7932-a35b-4b35-a077-06c5afed4042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.044530 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca7932-a35b-4b35-a077-06c5afed4042 admin admin] PATH_INFO: `/v3/users/384018400db94b44aeb3828c29f00dc5` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.044631 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694e7b5-29b9-40fb-bf7f-a23298a83cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:53.045668 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca7932-a35b-4b35-a077-06c5afed4042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384018400db94b44aeb3828c29f00dc5)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:53.046070 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694e7b5-29b9-40fb-bf7f-a23298a83cd8 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:53.047603 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca7932-a35b-4b35-a077-06c5afed4042 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:53.054968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1421/2871] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:53.072035 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694e7b5-29b9-40fb-bf7f-a23298a83cd8 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:53.073675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2694e7b5-29b9-40fb-bf7f-a23298a83cd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.090593 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694e7b5-29b9-40fb-bf7f-a23298a83cd8 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:53.095451 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d138c-c3d1-47fd-89f6-b917cf94e7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:53.096086 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d138c-c3d1-47fd-89f6-b917cf94e7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.096376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d138c-c3d1-47fd-89f6-b917cf94e7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.096875 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d138c-c3d1-47fd-89f6-b917cf94e7f2 admin admin] PATH_INFO: `/v3/users/dc64d76bd1e0408bb6f9ffee8e65429d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.098010 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d138c-c3d1-47fd-89f6-b917cf94e7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc64d76bd1e0408bb6f9ffee8e65429d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:53.098318 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1fca7932-a35b-4b35-a077-06c5afed4042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384018400db94b44aeb3828c29f00dc5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.099975 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d138c-c3d1-47fd-89f6-b917cf94e7f2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:53.105538 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1fca7932-a35b-4b35-a077-06c5afed4042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384018400db94b44aeb3828c29f00dc5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.110259 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:53.118889 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1fca7932-a35b-4b35-a077-06c5afed4042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384018400db94b44aeb3828c29f00dc5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.119630 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1fca7932-a35b-4b35-a077-06c5afed4042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384018400db94b44aeb3828c29f00dc5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.120251 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-1fca7932-a35b-4b35-a077-06c5afed4042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384018400db94b44aeb3828c29f00dc5'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.136338 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1451/2872] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:52 2022] DELETE /identity/v3/users/384018400db94b44aeb3828c29f00dc5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:53.147968 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c96d138c-c3d1-47fd-89f6-b917cf94e7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc64d76bd1e0408bb6f9ffee8e65429d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.155731 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c96d138c-c3d1-47fd-89f6-b917cf94e7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc64d76bd1e0408bb6f9ffee8e65429d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.161061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dae02-ed93-480e-b7d4-1662e51574c5 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.161596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dae02-ed93-480e-b7d4-1662e51574c5 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.161957 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dae02-ed93-480e-b7d4-1662e51574c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.169664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c96d138c-c3d1-47fd-89f6-b917cf94e7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc64d76bd1e0408bb6f9ffee8e65429d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.170501 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c96d138c-c3d1-47fd-89f6-b917cf94e7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc64d76bd1e0408bb6f9ffee8e65429d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.171141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c96d138c-c3d1-47fd-89f6-b917cf94e7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc64d76bd1e0408bb6f9ffee8e65429d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.188253 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1422/2873] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:53 2022] DELETE /identity/v3/users/dc64d76bd1e0408bb6f9ffee8e65429d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:53.192277 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-7c1dae02-ed93-480e-b7d4-1662e51574c5 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:53.193048 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4da14c-eb8f-4932-9e2a-b17e9a3fda75 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.193342 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4da14c-eb8f-4932-9e2a-b17e9a3fda75 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.193609 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4da14c-eb8f-4932-9e2a-b17e9a3fda75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.194027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7c1dae02-ed93-480e-b7d4-1662e51574c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.214008 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fd4da14c-eb8f-4932-9e2a-b17e9a3fda75 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:53.215277 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fd4da14c-eb8f-4932-9e2a-b17e9a3fda75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.271908 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1452/2874] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 23:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:53.280787 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1423/2875] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:53.292266 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dae02-ed93-480e-b7d4-1662e51574c5 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:53.293979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-7c1dae02-ed93-480e-b7d4-1662e51574c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.297298 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4da14c-eb8f-4932-9e2a-b17e9a3fda75 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:53.299090 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fd4da14c-eb8f-4932-9e2a-b17e9a3fda75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.324380 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:53.381272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dae02-ed93-480e-b7d4-1662e51574c5 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:53.390154 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c719-5f6d-4ad0-9926-6972ad8093b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:53.390883 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c719-5f6d-4ad0-9926-6972ad8093b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.391244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c719-5f6d-4ad0-9926-6972ad8093b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.391584 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c719-5f6d-4ad0-9926-6972ad8093b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.403310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7c719-5f6d-4ad0-9926-6972ad8093b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:53.403715 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4da14c-eb8f-4932-9e2a-b17e9a3fda75 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:53.405212 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7c719-5f6d-4ad0-9926-6972ad8093b4 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:53.410440 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2eff2b-34f4-42aa-9251-f17da24e43ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:53.410855 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eff2b-34f4-42aa-9251-f17da24e43ca service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.411129 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eff2b-34f4-42aa-9251-f17da24e43ca service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.411526 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eff2b-34f4-42aa-9251-f17da24e43ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.418420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1453/2876] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:53.421865 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2eff2b-34f4-42aa-9251-f17da24e43ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:53.423734 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2eff2b-34f4-42aa-9251-f17da24e43ca service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:53.437048 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c719-5f6d-4ad0-9926-6972ad8093b4 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:53.438798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-83e7c719-5f6d-4ad0-9926-6972ad8093b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.446527 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1424/2877] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:53.453593 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c719-5f6d-4ad0-9926-6972ad8093b4 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:53.459802 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:53.460658 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.460987 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.461311 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b admin admin] PATH_INFO: `/v3/projects/be33db5dfcb948f294b9e7e8a817ba4a` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.462648 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be33db5dfcb948f294b9e7e8a817ba4a)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:53.464825 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:53.522464 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be33db5dfcb948f294b9e7e8a817ba4a', 'request_id': 'req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.529725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be33db5dfcb948f294b9e7e8a817ba4a', 'request_id': 'req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.536386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be33db5dfcb948f294b9e7e8a817ba4a', 'request_id': 'req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.549760 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b admin admin] The token cache is being invalidate because project be33db5dfcb948f294b9e7e8a817ba4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:53.550189 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.551407 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-16f5584b-9c3d-4f60-88cb-bd8e7313d01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.558757 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1454/2878] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:53 2022] DELETE /identity/v3/projects/be33db5dfcb948f294b9e7e8a817ba4a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:53.560099 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e566a-0441-4b85-abaf-f4244919ca62 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.560389 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e566a-0441-4b85-abaf-f4244919ca62 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.560670 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e566a-0441-4b85-abaf-f4244919ca62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.584525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-722e566a-0441-4b85-abaf-f4244919ca62 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:53.585120 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-722e566a-0441-4b85-abaf-f4244919ca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.595586 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:53.663151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1425/2879] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:53.673297 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff711d-49c4-49bd-9280-121473940832 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.673814 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff711d-49c4-49bd-9280-121473940832 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.674166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff711d-49c4-49bd-9280-121473940832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.696540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-45ff711d-49c4-49bd-9280-121473940832 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:53.697774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-45ff711d-49c4-49bd-9280-121473940832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.707392 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1455/2880] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:53.712301 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e566a-0441-4b85-abaf-f4244919ca62 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:53.720429 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff711d-49c4-49bd-9280-121473940832 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:53.722172 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-45ff711d-49c4-49bd-9280-121473940832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.723798 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e566a-0441-4b85-abaf-f4244919ca62 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:53.728826 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83860b5-6234-4fec-81c9-6937ab78418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:53.729460 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83860b5-6234-4fec-81c9-6937ab78418b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.729894 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83860b5-6234-4fec-81c9-6937ab78418b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.730171 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83860b5-6234-4fec-81c9-6937ab78418b admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.730857 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83860b5-6234-4fec-81c9-6937ab78418b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:53.731154 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83860b5-6234-4fec-81c9-6937ab78418b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:53.732740 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83860b5-6234-4fec-81c9-6937ab78418b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:53.736629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff711d-49c4-49bd-9280-121473940832 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:53.742657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:53.743342 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.743629 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.743907 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78 admin admin] PATH_INFO: `/v3/projects/7a138dcd8b204e71b8f5649e018b8a6e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.745079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a138dcd8b204e71b8f5649e018b8a6e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:53.745629 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1426/2881] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:53.747520 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:53.749923 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83860b5-6234-4fec-81c9-6937ab78418b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:53.762263 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83860b5-6234-4fec-81c9-6937ab78418b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:53.767103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde02f4c-03a7-4001-a376-7c352951ee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:53.767873 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde02f4c-03a7-4001-a376-7c352951ee33 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.768215 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde02f4c-03a7-4001-a376-7c352951ee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.768654 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde02f4c-03a7-4001-a376-7c352951ee33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.770278 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde02f4c-03a7-4001-a376-7c352951ee33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:53.772312 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde02f4c-03a7-4001-a376-7c352951ee33 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:53.801114 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a138dcd8b204e71b8f5649e018b8a6e', 'request_id': 'req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.801331 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1427/2882] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:53 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:53.805394 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde02f4c-03a7-4001-a376-7c352951ee33 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:53.807730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a138dcd8b204e71b8f5649e018b8a6e', 'request_id': 'req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.817332 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a138dcd8b204e71b8f5649e018b8a6e', 'request_id': 'req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.832803 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78 admin admin] The token cache is being invalidate because project 7a138dcd8b204e71b8f5649e018b8a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:53.833069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.833730 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-255f2426-6d48-4d2a-a7b1-11a01ca0dd78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:53.835576 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1456/2883] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:53 2022] DELETE /identity/v3/projects/7a138dcd8b204e71b8f5649e018b8a6e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:53.840853 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69116c28-7f92-4020-820f-0429a94488cc None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.841133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69116c28-7f92-4020-820f-0429a94488cc None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.841403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69116c28-7f92-4020-820f-0429a94488cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.860774 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-69116c28-7f92-4020-820f-0429a94488cc None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:53.861963 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-69116c28-7f92-4020-820f-0429a94488cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.871175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:53.874079 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde02f4c-03a7-4001-a376-7c352951ee33 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:53.880428 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae08fd1-0342-4a0d-905c-ccd64293a536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:53.881069 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae08fd1-0342-4a0d-905c-ccd64293a536 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.881351 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae08fd1-0342-4a0d-905c-ccd64293a536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.881627 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae08fd1-0342-4a0d-905c-ccd64293a536 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.882432 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae08fd1-0342-4a0d-905c-ccd64293a536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:53.884535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae08fd1-0342-4a0d-905c-ccd64293a536 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:53.906535 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1428/2884] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:53 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:53.910597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae08fd1-0342-4a0d-905c-ccd64293a536 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:53.912702 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4ae08fd1-0342-4a0d-905c-ccd64293a536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.926013 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1457/2885] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:53.926547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae08fd1-0342-4a0d-905c-ccd64293a536 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:53.931210 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802341e5-a6e7-4798-a152-1863c6ab089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:53.931830 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802341e5-a6e7-4798-a152-1863c6ab089e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.932112 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802341e5-a6e7-4798-a152-1863c6ab089e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.932407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802341e5-a6e7-4798-a152-1863c6ab089e admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.933060 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802341e5-a6e7-4798-a152-1863c6ab089e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:53.934738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802341e5-a6e7-4798-a152-1863c6ab089e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:53.946648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1429/2886] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:38:53.951748 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69116c28-7f92-4020-820f-0429a94488cc None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:53.962077 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69116c28-7f92-4020-820f-0429a94488cc None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:53.967075 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833aa6e-79ad-4fa0-9bb7-a1f43d4f0ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:53.967733 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833aa6e-79ad-4fa0-9bb7-a1f43d4f0ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.967975 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833aa6e-79ad-4fa0-9bb7-a1f43d4f0ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.968250 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833aa6e-79ad-4fa0-9bb7-a1f43d4f0ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.968912 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833aa6e-79ad-4fa0-9bb7-a1f43d4f0ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:53.970595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833aa6e-79ad-4fa0-9bb7-a1f43d4f0ba5 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:53.982194 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1458/2887] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:53.986656 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802341e5-a6e7-4798-a152-1863c6ab089e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:53.992280 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c218786-ee72-4613-a4e3-68481313f8f7 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.992567 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c218786-ee72-4613-a4e3-68481313f8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.992847 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c218786-ee72-4613-a4e3-68481313f8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.997769 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802341e5-a6e7-4798-a152-1863c6ab089e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.003945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b4a86-fe82-424b-a464-bbbd5ee7d06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.004621 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b4a86-fe82-424b-a464-bbbd5ee7d06a admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.004898 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b4a86-fe82-424b-a464-bbbd5ee7d06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.005167 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b4a86-fe82-424b-a464-bbbd5ee7d06a admin admin] PATH_INFO: `/v3/projects/5dce44e43f65449e9a8377af70a72923/users/21286e437f264fd28e71a7c245a1e6bd/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.012667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-0c218786-ee72-4613-a4e3-68481313f8f7 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:54.013880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0c218786-ee72-4613-a4e3-68481313f8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:54.020241 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b4a86-fe82-424b-a464-bbbd5ee7d06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dce44e43f65449e9a8377af70a72923, user_id=21286e437f264fd28e71a7c245a1e6bd, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:54.025201 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1459/2888] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:54.025344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b4a86-fe82-424b-a464-bbbd5ee7d06a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:54.026167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c218786-ee72-4613-a4e3-68481313f8f7 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.035504 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c218786-ee72-4613-a4e3-68481313f8f7 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.036647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1430/2889] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:53 2022] PUT /identity/v3/projects/5dce44e43f65449e9a8377af70a72923/users/21286e437f264fd28e71a7c245a1e6bd/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:54.049282 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2ffe1-d07c-457b-86ba-ad7b62c7df60 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.049561 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2ffe1-d07c-457b-86ba-ad7b62c7df60 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.050390 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2ffe1-d07c-457b-86ba-ad7b62c7df60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.079727 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5ab2ffe1-d07c-457b-86ba-ad7b62c7df60 None None] MFA Rules not processed for user `21286e437f264fd28e71a7c245a1e6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:54.080928 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5ab2ffe1-d07c-457b-86ba-ad7b62c7df60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:54.091979 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa8469-b525-44ef-a502-84b7e101a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.092600 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa8469-b525-44ef-a502-84b7e101a727 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.092885 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa8469-b525-44ef-a502-84b7e101a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.093167 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa8469-b525-44ef-a502-84b7e101a727 admin admin] PATH_INFO: `/v3/domains` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.093817 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa8469-b525-44ef-a502-84b7e101a727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:54.094124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa8469-b525-44ef-a502-84b7e101a727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:54.095766 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa8469-b525-44ef-a502-84b7e101a727 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:54.101439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:54.108133 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1460/2890] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:54.112798 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa8469-b525-44ef-a502-84b7e101a727 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.122518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa8469-b525-44ef-a502-84b7e101a727 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.127606 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb196662-0529-4bc1-9d0b-2eafacb5e7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.128779 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb196662-0529-4bc1-9d0b-2eafacb5e7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.129059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb196662-0529-4bc1-9d0b-2eafacb5e7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.129366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb196662-0529-4bc1-9d0b-2eafacb5e7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.130147 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb196662-0529-4bc1-9d0b-2eafacb5e7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:54.132081 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb196662-0529-4bc1-9d0b-2eafacb5e7e1 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:54.153438 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1431/2891] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:54.166420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1461/2892] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:54 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:54.167622 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2ffe1-d07c-457b-86ba-ad7b62c7df60 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.168109 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb196662-0529-4bc1-9d0b-2eafacb5e7e1 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.169257 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5ab2ffe1-d07c-457b-86ba-ad7b62c7df60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:54.227825 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2ffe1-d07c-457b-86ba-ad7b62c7df60 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.232633 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb196662-0529-4bc1-9d0b-2eafacb5e7e1 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.237403 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dabd4d-9e25-4ecb-b977-d9ee908a3b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.238163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dabd4d-9e25-4ecb-b977-d9ee908a3b04 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.238477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dabd4d-9e25-4ecb-b977-d9ee908a3b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.238775 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dabd4d-9e25-4ecb-b977-d9ee908a3b04 admin admin] PATH_INFO: `/v3/users` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.239386 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dabd4d-9e25-4ecb-b977-d9ee908a3b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:54.241306 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dabd4d-9e25-4ecb-b977-d9ee908a3b04 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:54.257701 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:54.266725 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1462/2893] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:54 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:54.267739 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dabd4d-9e25-4ecb-b977-d9ee908a3b04 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.277827 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dabd4d-9e25-4ecb-b977-d9ee908a3b04 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.280140 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd605f30-639c-487c-a556-c778ac46a2e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.280750 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605f30-639c-487c-a556-c778ac46a2e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.281030 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605f30-639c-487c-a556-c778ac46a2e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.281303 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605f30-639c-487c-a556-c778ac46a2e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.282442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ffdfc-d538-4811-90e8-3d4353032429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.283038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ffdfc-d538-4811-90e8-3d4353032429 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.283329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ffdfc-d538-4811-90e8-3d4353032429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.283601 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ffdfc-d538-4811-90e8-3d4353032429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.284822 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ffdfc-d538-4811-90e8-3d4353032429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:54.286469 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ffdfc-d538-4811-90e8-3d4353032429 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:54.298643 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1463/2894] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:54.304241 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ffdfc-d538-4811-90e8-3d4353032429 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.314037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ffdfc-d538-4811-90e8-3d4353032429 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.320372 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447374d8-93fb-4bed-939d-0b9b17386bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.321103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447374d8-93fb-4bed-939d-0b9b17386bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.321507 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447374d8-93fb-4bed-939d-0b9b17386bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.321880 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447374d8-93fb-4bed-939d-0b9b17386bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.322650 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447374d8-93fb-4bed-939d-0b9b17386bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:54.324327 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447374d8-93fb-4bed-939d-0b9b17386bb6 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:54.335417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1464/2895] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:38:54.339607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447374d8-93fb-4bed-939d-0b9b17386bb6 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.343416 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd605f30-639c-487c-a556-c778ac46a2e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:54.344952 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd605f30-639c-487c-a556-c778ac46a2e5 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:54.350015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447374d8-93fb-4bed-939d-0b9b17386bb6 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.354455 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1432/2896] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:54.354582 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194da33e-d546-4ef1-9b96-e47efc47b36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.355093 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194da33e-d546-4ef1-9b96-e47efc47b36c admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.355366 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194da33e-d546-4ef1-9b96-e47efc47b36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.355632 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194da33e-d546-4ef1-9b96-e47efc47b36c admin admin] PATH_INFO: `/v3/projects/495ce14b19884b32a795540706fa59cd/users/a35fe5de7aa44dde9468912197dab7f7/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.372157 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194da33e-d546-4ef1-9b96-e47efc47b36c admin admin] RBAC: Authorizing `identity:create_grant(project_id=495ce14b19884b32a795540706fa59cd, user_id=a35fe5de7aa44dde9468912197dab7f7, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:54.374854 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194da33e-d546-4ef1-9b96-e47efc47b36c admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:54.393588 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1465/2897] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:54 2022] PUT /identity/v3/projects/495ce14b19884b32a795540706fa59cd/users/a35fe5de7aa44dde9468912197dab7f7/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:54.403490 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ea1a-f29d-4022-8298-1a6a3b654efa None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.403887 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ea1a-f29d-4022-8298-1a6a3b654efa None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.404461 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ea1a-f29d-4022-8298-1a6a3b654efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.434302 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3a64ea1a-f29d-4022-8298-1a6a3b654efa None None] MFA Rules not processed for user `a35fe5de7aa44dde9468912197dab7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:54.435548 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3a64ea1a-f29d-4022-8298-1a6a3b654efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:54.456371 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:54.507675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1433/2898] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:54.523152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194da33e-d546-4ef1-9b96-e47efc47b36c admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.525027 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-194da33e-d546-4ef1-9b96-e47efc47b36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:54.586262 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194da33e-d546-4ef1-9b96-e47efc47b36c admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.589988 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529e6dc-db0c-4060-9cf9-5357242601be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f5d6fe6235447acb395030fb0f0555d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.590619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529e6dc-db0c-4060-9cf9-5357242601be service cinder] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.590903 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529e6dc-db0c-4060-9cf9-5357242601be service cinder] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.591175 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529e6dc-db0c-4060-9cf9-5357242601be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.601094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529e6dc-db0c-4060-9cf9-5357242601be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:54.601094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529e6dc-db0c-4060-9cf9-5357242601be service cinder] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:54.601094 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1466/2899] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:57.211707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64ea1a-f29d-4022-8298-1a6a3b654efa None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:57.273300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919c4a7-b0cb-488d-8a00-40d6c6928c36 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.273877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919c4a7-b0cb-488d-8a00-40d6c6928c36 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.273877 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919c4a7-b0cb-488d-8a00-40d6c6928c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.275264 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64ea1a-f29d-4022-8298-1a6a3b654efa None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:57.279743 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65742bbe-1e24-4631-b1d7-757f02eafa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:57.280368 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65742bbe-1e24-4631-b1d7-757f02eafa24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.280648 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65742bbe-1e24-4631-b1d7-757f02eafa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.280923 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65742bbe-1e24-4631-b1d7-757f02eafa24 admin admin] PATH_INFO: `/v3/users/a35fe5de7aa44dde9468912197dab7f7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.282039 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65742bbe-1e24-4631-b1d7-757f02eafa24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35fe5de7aa44dde9468912197dab7f7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:57.283995 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65742bbe-1e24-4631-b1d7-757f02eafa24 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:57.294367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-8919c4a7-b0cb-488d-8a00-40d6c6928c36 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:57.295595 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8919c4a7-b0cb-488d-8a00-40d6c6928c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:57.304371 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1467/2900] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 23:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:57.332556 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-65742bbe-1e24-4631-b1d7-757f02eafa24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35fe5de7aa44dde9468912197dab7f7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:57.339760 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-65742bbe-1e24-4631-b1d7-757f02eafa24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35fe5de7aa44dde9468912197dab7f7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:57.342559 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919c4a7-b0cb-488d-8a00-40d6c6928c36 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:57.343938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8919c4a7-b0cb-488d-8a00-40d6c6928c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:57.352682 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-65742bbe-1e24-4631-b1d7-757f02eafa24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35fe5de7aa44dde9468912197dab7f7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:57.353376 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-65742bbe-1e24-4631-b1d7-757f02eafa24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35fe5de7aa44dde9468912197dab7f7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:57.353975 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-65742bbe-1e24-4631-b1d7-757f02eafa24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35fe5de7aa44dde9468912197dab7f7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:57.368631 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1434/2901] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:38:57 2022] DELETE /identity/v3/users/a35fe5de7aa44dde9468912197dab7f7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:57.372931 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7c68-1a7a-4a69-b5fc-f6ce51d3f137 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.373275 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7c68-1a7a-4a69-b5fc-f6ce51d3f137 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.373601 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7c68-1a7a-4a69-b5fc-f6ce51d3f137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.393383 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-882b7c68-1a7a-4a69-b5fc-f6ce51d3f137 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:57.394709 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-882b7c68-1a7a-4a69-b5fc-f6ce51d3f137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:57.426799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919c4a7-b0cb-488d-8a00-40d6c6928c36 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:57.434224 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:57.462068 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1435/2902] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:57.473820 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b7c68-1a7a-4a69-b5fc-f6ce51d3f137 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:57.475571 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-882b7c68-1a7a-4a69-b5fc-f6ce51d3f137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:57.477118 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:57.499334 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200eda68-dcfd-42b6-9799-99e85c9cbd66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:57.500329 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200eda68-dcfd-42b6-9799-99e85c9cbd66 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.500611 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200eda68-dcfd-42b6-9799-99e85c9cbd66 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.500991 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200eda68-dcfd-42b6-9799-99e85c9cbd66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.503059 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-200eda68-dcfd-42b6-9799-99e85c9cbd66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:57.516169 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200eda68-dcfd-42b6-9799-99e85c9cbd66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:57.518149 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200eda68-dcfd-42b6-9799-99e85c9cbd66 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:57.529148 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1468/2903] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:38:57.536620 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b7c68-1a7a-4a69-b5fc-f6ce51d3f137 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:57.540454 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd15c7-0438-4d3c-bc56-3f884140fca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:57.541055 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd15c7-0438-4d3c-bc56-3f884140fca2 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.541343 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd15c7-0438-4d3c-bc56-3f884140fca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.541598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd15c7-0438-4d3c-bc56-3f884140fca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.551600 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd15c7-0438-4d3c-bc56-3f884140fca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:57.553028 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd15c7-0438-4d3c-bc56-3f884140fca2 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:57.562790 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1436/2904] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:38:57.833684 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200eda68-dcfd-42b6-9799-99e85c9cbd66 service nova] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:57.835347 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-200eda68-dcfd-42b6-9799-99e85c9cbd66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:57.848842 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200eda68-dcfd-42b6-9799-99e85c9cbd66 service nova] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:57.853498 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b61b52-33b6-42cd-878a-17bdfebff953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:57.854124 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b61b52-33b6-42cd-878a-17bdfebff953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.854881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b61b52-33b6-42cd-878a-17bdfebff953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.854881 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b61b52-33b6-42cd-878a-17bdfebff953 admin admin] PATH_INFO: `/v3/projects/495ce14b19884b32a795540706fa59cd` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.855858 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b61b52-33b6-42cd-878a-17bdfebff953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=495ce14b19884b32a795540706fa59cd)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:57.857746 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b61b52-33b6-42cd-878a-17bdfebff953 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:57.904545 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-15b61b52-33b6-42cd-878a-17bdfebff953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495ce14b19884b32a795540706fa59cd', 'request_id': 'req-15b61b52-33b6-42cd-878a-17bdfebff953'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:57.911528 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-15b61b52-33b6-42cd-878a-17bdfebff953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495ce14b19884b32a795540706fa59cd', 'request_id': 'req-15b61b52-33b6-42cd-878a-17bdfebff953'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:57.917581 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-15b61b52-33b6-42cd-878a-17bdfebff953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495ce14b19884b32a795540706fa59cd', 'request_id': 'req-15b61b52-33b6-42cd-878a-17bdfebff953'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:57.930023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-15b61b52-33b6-42cd-878a-17bdfebff953 admin admin] The token cache is being invalidate because project 495ce14b19884b32a795540706fa59cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:38:57.930310 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-15b61b52-33b6-42cd-878a-17bdfebff953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:57.931092 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-15b61b52-33b6-42cd-878a-17bdfebff953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:38:57.932586 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1469/2905] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:38:57 2022] DELETE /identity/v3/projects/495ce14b19884b32a795540706fa59cd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:57.937551 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf24b8-8f52-4cfa-8860-efec70c51265 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.937836 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf24b8-8f52-4cfa-8860-efec70c51265 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.938111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf24b8-8f52-4cfa-8860-efec70c51265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.957664 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b4cf24b8-8f52-4cfa-8860-efec70c51265 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:57.958885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b4cf24b8-8f52-4cfa-8860-efec70c51265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:58.018293 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1437/2906] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:58.026758 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaa6c5-9a50-4bb9-91ba-2eab5a82cb64 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.027045 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaa6c5-9a50-4bb9-91ba-2eab5a82cb64 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.027322 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaa6c5-9a50-4bb9-91ba-2eab5a82cb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.047074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-c3eaa6c5-9a50-4bb9-91ba-2eab5a82cb64 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:58.048256 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-c3eaa6c5-9a50-4bb9-91ba-2eab5a82cb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:58.056028 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1470/2907] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:38:58.060096 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf24b8-8f52-4cfa-8860-efec70c51265 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.070228 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf24b8-8f52-4cfa-8860-efec70c51265 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:58.074806 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eaea7-e1f4-4fc7-84ea-c67fc273dbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:58.075406 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eaea7-e1f4-4fc7-84ea-c67fc273dbde admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.075684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eaea7-e1f4-4fc7-84ea-c67fc273dbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.075953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eaea7-e1f4-4fc7-84ea-c67fc273dbde admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.076588 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eaea7-e1f4-4fc7-84ea-c67fc273dbde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:58.076888 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eaea7-e1f4-4fc7-84ea-c67fc273dbde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:58.078494 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eaea7-e1f4-4fc7-84ea-c67fc273dbde admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:58.091065 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1438/2908] 10.222.0.33 () {58 vars in 1153 bytes} [Mon Sep 12 23:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:58.095123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaa6c5-9a50-4bb9-91ba-2eab5a82cb64 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.104461 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaa6c5-9a50-4bb9-91ba-2eab5a82cb64 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:58.109168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b69ba0-0914-401c-b045-e0cfdddf4028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:58.109876 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b69ba0-0914-401c-b045-e0cfdddf4028 admin admin] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.110078 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b69ba0-0914-401c-b045-e0cfdddf4028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.110348 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b69ba0-0914-401c-b045-e0cfdddf4028 admin admin] PATH_INFO: `/v3/projects` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.111023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b69ba0-0914-401c-b045-e0cfdddf4028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:58.112935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b69ba0-0914-401c-b045-e0cfdddf4028 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:58.147964 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1471/2909] 10.222.0.33 () {60 vars in 1153 bytes} [Mon Sep 12 23:38:58 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:58.157061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eaea7-e1f4-4fc7-84ea-c67fc273dbde admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.168885 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eaea7-e1f4-4fc7-84ea-c67fc273dbde admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:58.231948 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f37afd-35e8-4c32-bc98-2b9f158a52f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:58.232597 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f37afd-35e8-4c32-bc98-2b9f158a52f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.232828 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f37afd-35e8-4c32-bc98-2b9f158a52f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.233103 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f37afd-35e8-4c32-bc98-2b9f158a52f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.233738 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f37afd-35e8-4c32-bc98-2b9f158a52f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:58.235901 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f37afd-35e8-4c32-bc98-2b9f158a52f6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:58.263057 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1439/2910] 10.222.0.33 () {60 vars in 1144 bytes} [Mon Sep 12 23:38:58 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:58.264060 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b69ba0-0914-401c-b045-e0cfdddf4028 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.275257 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b69ba0-0914-401c-b045-e0cfdddf4028 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:58.279832 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4af1e-8cbb-47ab-956e-c2d52b555b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:58.280517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4af1e-8cbb-47ab-956e-c2d52b555b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.280799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4af1e-8cbb-47ab-956e-c2d52b555b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.281068 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4af1e-8cbb-47ab-956e-c2d52b555b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.281707 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4af1e-8cbb-47ab-956e-c2d52b555b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:58.283330 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4af1e-8cbb-47ab-956e-c2d52b555b53 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:58.293724 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1472/2911] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:38:58.297741 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f37afd-35e8-4c32-bc98-2b9f158a52f6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.303291 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:58.309547 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f37afd-35e8-4c32-bc98-2b9f158a52f6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:58.314492 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d5153-d1a1-4b1a-8dad-c333db755302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:58.315092 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d5153-d1a1-4b1a-8dad-c333db755302 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.315911 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d5153-d1a1-4b1a-8dad-c333db755302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.316349 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d5153-d1a1-4b1a-8dad-c333db755302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.316985 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d5153-d1a1-4b1a-8dad-c333db755302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:58.318647 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d5153-d1a1-4b1a-8dad-c333db755302 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:58.329177 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1440/2912] 10.222.0.33 () {58 vars in 1122 bytes} [Mon Sep 12 23:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:38:58.334292 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4af1e-8cbb-47ab-956e-c2d52b555b53 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.344163 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4af1e-8cbb-47ab-956e-c2d52b555b53 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:58.348796 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29521e-d1d1-44c5-b7d7-e55c890aa2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:58.349440 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29521e-d1d1-44c5-b7d7-e55c890aa2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.349718 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29521e-d1d1-44c5-b7d7-e55c890aa2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.349988 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29521e-d1d1-44c5-b7d7-e55c890aa2a3 admin admin] PATH_INFO: `/v3/projects/447458f5638d4378a7d220e0b34e04e3/users/69747cd68aed49e6b99c73cbc77bc8c8/roles/c6ff6f013f2f41d78fedabbe698ed13e` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.364923 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29521e-d1d1-44c5-b7d7-e55c890aa2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=447458f5638d4378a7d220e0b34e04e3, user_id=69747cd68aed49e6b99c73cbc77bc8c8, role_id=c6ff6f013f2f41d78fedabbe698ed13e)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:58.367657 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29521e-d1d1-44c5-b7d7-e55c890aa2a3 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:58.383470 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1473/2913] 10.222.0.33 () {60 vars in 1483 bytes} [Mon Sep 12 23:38:58 2022] PUT /identity/v3/projects/447458f5638d4378a7d220e0b34e04e3/users/69747cd68aed49e6b99c73cbc77bc8c8/roles/c6ff6f013f2f41d78fedabbe698ed13e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:58.395122 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7f315-01d3-492e-baa9-76a3bc320db9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.395404 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7f315-01d3-492e-baa9-76a3bc320db9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.395675 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7f315-01d3-492e-baa9-76a3bc320db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.423841 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-71d7f315-01d3-492e-baa9-76a3bc320db9 None None] MFA Rules not processed for user `69747cd68aed49e6b99c73cbc77bc8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:58.425565 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-71d7f315-01d3-492e-baa9-76a3bc320db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:58.489671 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1441/2914] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:38:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:38:58.501367 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29521e-d1d1-44c5-b7d7-e55c890aa2a3 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.503654 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-3d29521e-d1d1-44c5-b7d7-e55c890aa2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:58.560418 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29521e-d1d1-44c5-b7d7-e55c890aa2a3 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:58.563946 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd183ab1-f7ce-4ac2-a876-50e7177bb717 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f96bbb14c04691ac403271de293224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:58.564553 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd183ab1-f7ce-4ac2-a876-50e7177bb717 service glance] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.564831 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd183ab1-f7ce-4ac2-a876-50e7177bb717 service glance] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.565099 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd183ab1-f7ce-4ac2-a876-50e7177bb717 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.571052 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:58.575477 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd183ab1-f7ce-4ac2-a876-50e7177bb717 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:58.576915 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd183ab1-f7ce-4ac2-a876-50e7177bb717 service glance] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:58.587631 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1474/2915] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:38:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:00.527238 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64c671-b8d6-41fb-be7d-021ccc069fd4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:00.527755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64c671-b8d6-41fb-be7d-021ccc069fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:00.527755 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64c671-b8d6-41fb-be7d-021ccc069fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:00.548549 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1b64c671-b8d6-41fb-be7d-021ccc069fd4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:00.549765 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1b64c671-b8d6-41fb-be7d-021ccc069fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:00.624378 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1442/2916] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 23:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:39:00.649032 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd183ab1-f7ce-4ac2-a876-50e7177bb717 service glance] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:00.650742 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-fd183ab1-f7ce-4ac2-a876-50e7177bb717 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:00.745065 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd183ab1-f7ce-4ac2-a876-50e7177bb717 service glance] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:00.751846 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2044d-8671-49c1-add5-17c3119afa79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:00.752505 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2044d-8671-49c1-add5-17c3119afa79 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:00.752737 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2044d-8671-49c1-add5-17c3119afa79 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:00.753009 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2044d-8671-49c1-add5-17c3119afa79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:00.766981 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2044d-8671-49c1-add5-17c3119afa79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:00.768640 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2044d-8671-49c1-add5-17c3119afa79 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:00.780484 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1475/2917] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:03.694481 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaf757-0552-408d-a505-fc71f1d42293 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:03.695062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaf757-0552-408d-a505-fc71f1d42293 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:03.695062 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaf757-0552-408d-a505-fc71f1d42293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:03.716056 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-beeaf757-0552-408d-a505-fc71f1d42293 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:03.717258 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-beeaf757-0552-408d-a505-fc71f1d42293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:03.725700 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1443/2918] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 23:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:39:03.755623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2044d-8671-49c1-add5-17c3119afa79 service nova] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:03.757061 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-26f2044d-8671-49c1-add5-17c3119afa79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:03.772054 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2044d-8671-49c1-add5-17c3119afa79 service nova] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:03.777390 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a76c4-89b5-4f76-97d0-680fdc807ee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:03.778115 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a76c4-89b5-4f76-97d0-680fdc807ee9 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:03.778424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a76c4-89b5-4f76-97d0-680fdc807ee9 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:03.778698 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a76c4-89b5-4f76-97d0-680fdc807ee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:03.787417 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a76c4-89b5-4f76-97d0-680fdc807ee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:03.789103 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a76c4-89b5-4f76-97d0-680fdc807ee9 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:03.798926 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1476/2919] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:07.875712 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d904379-12a1-4a36-93aa-869fe2c303cc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:07.876232 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d904379-12a1-4a36-93aa-869fe2c303cc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:07.876339 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d904379-12a1-4a36-93aa-869fe2c303cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:07.895560 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1d904379-12a1-4a36-93aa-869fe2c303cc None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:07.896761 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1d904379-12a1-4a36-93aa-869fe2c303cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:07.904824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1444/2920] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 23:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:39:07.928168 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a76c4-89b5-4f76-97d0-680fdc807ee9 service nova] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:07.940015 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a76c4-89b5-4f76-97d0-680fdc807ee9 service nova] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:07.945480 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011be5e-078f-480a-951d-01e7be2b4a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:07.946074 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011be5e-078f-480a-951d-01e7be2b4a4d service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:07.946354 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011be5e-078f-480a-951d-01e7be2b4a4d service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:07.946662 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011be5e-078f-480a-951d-01e7be2b4a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:07.955038 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011be5e-078f-480a-951d-01e7be2b4a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:07.956563 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011be5e-078f-480a-951d-01e7be2b4a4d service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:07.966835 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1477/2921] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:08.222579 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d904379-12a1-4a36-93aa-869fe2c303cc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:08.223975 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1d904379-12a1-4a36-93aa-869fe2c303cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:08.236421 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d904379-12a1-4a36-93aa-869fe2c303cc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:08.241021 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:08.241632 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:08.241906 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:08.242173 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] PATH_INFO: `/v3/users/21286e437f264fd28e71a7c245a1e6bd` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:08.243297 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] RBAC: Authorizing `identity:delete_user(user_id=21286e437f264fd28e71a7c245a1e6bd)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:08.245194 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:08.302531 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21286e437f264fd28e71a7c245a1e6bd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:08.309446 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21286e437f264fd28e71a7c245a1e6bd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:08.314448 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:08.322016 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21286e437f264fd28e71a7c245a1e6bd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:08.322703 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21286e437f264fd28e71a7c245a1e6bd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:08.323305 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21286e437f264fd28e71a7c245a1e6bd'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:08.335379 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1445/2922] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:39:08 2022] DELETE /identity/v3/users/21286e437f264fd28e71a7c245a1e6bd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:08.340324 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a47f2b-01ea-47e2-9849-d889401e2546 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:08.340651 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a47f2b-01ea-47e2-9849-d889401e2546 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:08.340952 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a47f2b-01ea-47e2-9849-d889401e2546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:08.361082 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-f2a47f2b-01ea-47e2-9849-d889401e2546 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:08.362289 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f2a47f2b-01ea-47e2-9849-d889401e2546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:08.420534 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1478/2923] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:39:08.430166 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:08.431620 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:08.488528 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02a8f9-cd3d-4467-a285-c872cde4142d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:08.492511 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18942af9-0fbf-4625-aadd-37e4fed07115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:08.493144 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18942af9-0fbf-4625-aadd-37e4fed07115 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:08.493426 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18942af9-0fbf-4625-aadd-37e4fed07115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:08.493704 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18942af9-0fbf-4625-aadd-37e4fed07115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:08.502735 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18942af9-0fbf-4625-aadd-37e4fed07115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:08.504169 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18942af9-0fbf-4625-aadd-37e4fed07115 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:08.514260 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1446/2924] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:08.795996 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a47f2b-01ea-47e2-9849-d889401e2546 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:08.797445 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f2a47f2b-01ea-47e2-9849-d889401e2546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:08.809738 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a47f2b-01ea-47e2-9849-d889401e2546 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:08.814625 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:08.815270 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:08.815548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:08.815821 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] PATH_INFO: `/v3/projects/5dce44e43f65449e9a8377af70a72923` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:08.816935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dce44e43f65449e9a8377af70a72923)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:08.818883 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:08.868226 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:08.869743 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dce44e43f65449e9a8377af70a72923', 'request_id': 'req-8db50dcf-924c-4c71-a6a1-681bbcf26938'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:08.877269 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dce44e43f65449e9a8377af70a72923', 'request_id': 'req-8db50dcf-924c-4c71-a6a1-681bbcf26938'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:08.883541 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dce44e43f65449e9a8377af70a72923', 'request_id': 'req-8db50dcf-924c-4c71-a6a1-681bbcf26938'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:08.895424 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] The token cache is being invalidate because project 5dce44e43f65449e9a8377af70a72923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:39:08.895709 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:08.896321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:08.897828 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1479/2925] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:39:08 2022] DELETE /identity/v3/projects/5dce44e43f65449e9a8377af70a72923 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:12.594507 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d976f-ff0b-4cf8-9c51-a9395bf3af6d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:12.594979 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d976f-ff0b-4cf8-9c51-a9395bf3af6d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:12.595080 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d976f-ff0b-4cf8-9c51-a9395bf3af6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:12.614311 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8f6d976f-ff0b-4cf8-9c51-a9395bf3af6d None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:12.615553 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8f6d976f-ff0b-4cf8-9c51-a9395bf3af6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:12.674486 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1447/2926] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 23:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:39:12.701420 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:12.702899 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:12.778839 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50dcf-924c-4c71-a6a1-681bbcf26938 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:12.784365 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238cae7-e057-424e-9db0-91caaf57d2cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:12.784978 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238cae7-e057-424e-9db0-91caaf57d2cf service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:12.785258 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238cae7-e057-424e-9db0-91caaf57d2cf service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:12.785531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238cae7-e057-424e-9db0-91caaf57d2cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:12.794540 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238cae7-e057-424e-9db0-91caaf57d2cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:12.796123 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238cae7-e057-424e-9db0-91caaf57d2cf service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:12.806145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1480/2927] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:22.666617 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=59,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:22.801412 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=41,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:23.273757 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d976f-ff0b-4cf8-9c51-a9395bf3af6d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:23.288199 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d976f-ff0b-4cf8-9c51-a9395bf3af6d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:23.294128 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e0fcf-0a9b-4ea1-8ed3-49028e470f42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:23.294832 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e0fcf-0a9b-4ea1-8ed3-49028e470f42 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:23.295111 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e0fcf-0a9b-4ea1-8ed3-49028e470f42 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:23.295378 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e0fcf-0a9b-4ea1-8ed3-49028e470f42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:23.297439 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cb5e0fcf-0a9b-4ea1-8ed3-49028e470f42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:23.312799 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e0fcf-0a9b-4ea1-8ed3-49028e470f42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:23.314388 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e0fcf-0a9b-4ea1-8ed3-49028e470f42 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:23.327337 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1448/2928] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:28.199389 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5510d-61e6-4f02-bb09-dc6fbf86c1c3 None None] REQUEST_METHOD: `POST` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:28.199936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5510d-61e6-4f02-bb09-dc6fbf86c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:28.199936 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5510d-61e6-4f02-bb09-dc6fbf86c1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:28.219144 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.auth.core [None req-8aa5510d-61e6-4f02-bb09-dc6fbf86c1c3 None None] MFA Rules not processed for user `42a1ed716ae14d9780652fc18b4bade9`. Rule list: `[]` (Enabled: `True`). {{(pid=81387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:28.220313 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8aa5510d-61e6-4f02-bb09-dc6fbf86c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:28.275893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1481/2929] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:39:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:39:28.505058 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e0fcf-0a9b-4ea1-8ed3-49028e470f42 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:28.506499 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cb5e0fcf-0a9b-4ea1-8ed3-49028e470f42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:28.562047 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e0fcf-0a9b-4ea1-8ed3-49028e470f42 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:28.565823 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91959ed7-d9c3-41ce-839a-ea17f0748b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:28.566442 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91959ed7-d9c3-41ce-839a-ea17f0748b71 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:28.566720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91959ed7-d9c3-41ce-839a-ea17f0748b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:28.566988 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91959ed7-d9c3-41ce-839a-ea17f0748b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:28.568679 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-91959ed7-d9c3-41ce-839a-ea17f0748b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:28.578662 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91959ed7-d9c3-41ce-839a-ea17f0748b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:28.580082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91959ed7-d9c3-41ce-839a-ea17f0748b71 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:28.588475 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1449/2930] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:28.639813 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5510d-61e6-4f02-bb09-dc6fbf86c1c3 None None] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:28.641236 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-8aa5510d-61e6-4f02-bb09-dc6fbf86c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:28.655300 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5510d-61e6-4f02-bb09-dc6fbf86c1c3 None None] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:28.660230 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:28.660866 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:28.661143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:28.661409 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] PATH_INFO: `/v3/users/69747cd68aed49e6b99c73cbc77bc8c8` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:28.662547 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69747cd68aed49e6b99c73cbc77bc8c8)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:28.664450 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:28.717548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69747cd68aed49e6b99c73cbc77bc8c8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:28.724247 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69747cd68aed49e6b99c73cbc77bc8c8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:28.735904 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69747cd68aed49e6b99c73cbc77bc8c8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:28.736591 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69747cd68aed49e6b99c73cbc77bc8c8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:28.737210 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69747cd68aed49e6b99c73cbc77bc8c8'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:28.753276 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1482/2931] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:39:28 2022] DELETE /identity/v3/users/69747cd68aed49e6b99c73cbc77bc8c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:28.757998 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6dfd8-9420-4169-a5f5-648eec5418ab None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:28.758407 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6dfd8-9420-4169-a5f5-648eec5418ab None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:28.758684 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6dfd8-9420-4169-a5f5-648eec5418ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:28.778918 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-39f6dfd8-9420-4169-a5f5-648eec5418ab None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:28.780114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-39f6dfd8-9420-4169-a5f5-648eec5418ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:28.842247 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1450/2932] 10.222.0.33 () {58 vars in 958 bytes} [Mon Sep 12 23:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:39:28.851967 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:28.853878 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:28.916752 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6dfd8-9420-4169-a5f5-648eec5418ab None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:28.918062 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d6e3f-296a-4f26-b582-6f6978195a10 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:28.918218 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-39f6dfd8-9420-4169-a5f5-648eec5418ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:28.922142 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278e4d7-8848-4b44-8bf0-50ced95471b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:28.922893 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278e4d7-8848-4b44-8bf0-50ced95471b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:28.923272 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278e4d7-8848-4b44-8bf0-50ced95471b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:28.923666 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278e4d7-8848-4b44-8bf0-50ced95471b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:28.934321 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278e4d7-8848-4b44-8bf0-50ced95471b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:28.936399 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278e4d7-8848-4b44-8bf0-50ced95471b2 service neutron] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:28.947820 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1483/2933] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:29.003955 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6dfd8-9420-4169-a5f5-648eec5418ab None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:29.009945 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fba27-5188-4964-9156-35ff333162e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '559a4af215324597b203e6866cb51fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:29.010775 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fba27-5188-4964-9156-35ff333162e0 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:29.011061 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fba27-5188-4964-9156-35ff333162e0 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:29.011465 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fba27-5188-4964-9156-35ff333162e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:29.013279 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e93fba27-5188-4964-9156-35ff333162e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:29.026921 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fba27-5188-4964-9156-35ff333162e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:29.028544 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fba27-5188-4964-9156-35ff333162e0 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:29.040953 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1451/2934] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:39:29.228302 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278e4d7-8848-4b44-8bf0-50ced95471b2 service neutron] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:29.230127 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-b278e4d7-8848-4b44-8bf0-50ced95471b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:29.244271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278e4d7-8848-4b44-8bf0-50ced95471b2 service neutron] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:29.249667 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:29.250414 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:29.250799 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:29.251079 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] PATH_INFO: `/v3/projects/447458f5638d4378a7d220e0b34e04e3` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:29.252232 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=447458f5638d4378a7d220e0b34e04e3)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:29.254239 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:29.273728 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:29.306898 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '447458f5638d4378a7d220e0b34e04e3', 'request_id': 'req-0add6303-0cd7-4a59-b72f-93670cd997b9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:29.314497 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '447458f5638d4378a7d220e0b34e04e3', 'request_id': 'req-0add6303-0cd7-4a59-b72f-93670cd997b9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:29.321143 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '447458f5638d4378a7d220e0b34e04e3', 'request_id': 'req-0add6303-0cd7-4a59-b72f-93670cd997b9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:29.334359 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] The token cache is being invalidate because project 447458f5638d4378a7d220e0b34e04e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:39:29.334675 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:29.335294 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:39:29.336818 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1484/2935] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:39:29 2022] DELETE /identity/v3/projects/447458f5638d4378a7d220e0b34e04e3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:30.814207 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fba27-5188-4964-9156-35ff333162e0 service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:30.815593 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e93fba27-5188-4964-9156-35ff333162e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:30.827141 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fba27-5188-4964-9156-35ff333162e0 service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:30.842971 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:30.876642 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e80d2-a6aa-4419-aaa4-46c1533ee6de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1d4b0f322c741c5b69b922071aab3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:30.877243 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e80d2-a6aa-4419-aaa4-46c1533ee6de service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:30.877525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e80d2-a6aa-4419-aaa4-46c1533ee6de service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:30.877796 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e80d2-a6aa-4419-aaa4-46c1533ee6de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:30.879542 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bd0e80d2-a6aa-4419-aaa4-46c1533ee6de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:30.888934 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e80d2-a6aa-4419-aaa4-46c1533ee6de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:30.890352 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e80d2-a6aa-4419-aaa4-46c1533ee6de service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:30.898170 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1452/2936] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:39.330580 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:39.503295 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:39.508344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:39.593017 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add6303-0cd7-4a59-b72f-93670cd997b9 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:39.598361 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410f57c-3d10-4452-b9bd-fde319f04c6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:39.598985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410f57c-3d10-4452-b9bd-fde319f04c6f service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:39.599261 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410f57c-3d10-4452-b9bd-fde319f04c6f service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:39.599531 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410f57c-3d10-4452-b9bd-fde319f04c6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:39.601244 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-a410f57c-3d10-4452-b9bd-fde319f04c6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:39.613316 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410f57c-3d10-4452-b9bd-fde319f04c6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:39.614860 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410f57c-3d10-4452-b9bd-fde319f04c6f service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:39.626034 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1485/2937] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:40.894761 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=17 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:44.617256 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a54c2-c808-4046-ba0d-d3009f96adb8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:44.617877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a54c2-c808-4046-ba0d-d3009f96adb8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:44.617877 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a54c2-c808-4046-ba0d-d3009f96adb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:44.636756 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0a6a54c2-c808-4046-ba0d-d3009f96adb8 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:44.638074 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0a6a54c2-c808-4046-ba0d-d3009f96adb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:44.696557 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1453/2938] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 23:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:39:44.717344 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410f57c-3d10-4452-b9bd-fde319f04c6f service nova] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:44.728695 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410f57c-3d10-4452-b9bd-fde319f04c6f service nova] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:44.735030 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41746c-e280-4c0f-b69d-f6839785e137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:44.735623 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41746c-e280-4c0f-b69d-f6839785e137 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:44.735898 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41746c-e280-4c0f-b69d-f6839785e137 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:44.736166 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41746c-e280-4c0f-b69d-f6839785e137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:44.744023 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41746c-e280-4c0f-b69d-f6839785e137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:44.745607 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41746c-e280-4c0f-b69d-f6839785e137 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:44.755101 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1486/2939] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:39:47.886110 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e71b0a-5e77-49a4-8746-a32f49061b17 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:47.886702 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e71b0a-5e77-49a4-8746-a32f49061b17 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:47.886702 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e71b0a-5e77-49a4-8746-a32f49061b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:47.906598 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-99e71b0a-5e77-49a4-8746-a32f49061b17 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:47.907807 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-99e71b0a-5e77-49a4-8746-a32f49061b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:47.915954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1454/2940] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 23:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:39:47.936548 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41746c-e280-4c0f-b69d-f6839785e137 service nova] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:47.938136 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-df41746c-e280-4c0f-b69d-f6839785e137 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:47.953517 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41746c-e280-4c0f-b69d-f6839785e137 service nova] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:47.958924 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017d97a-ecbc-4589-872a-613ad0ec7984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:47.959518 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017d97a-ecbc-4589-872a-613ad0ec7984 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:47.959794 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017d97a-ecbc-4589-872a-613ad0ec7984 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:47.960067 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017d97a-ecbc-4589-872a-613ad0ec7984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:47.968090 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017d97a-ecbc-4589-872a-613ad0ec7984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:47.969663 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017d97a-ecbc-4589-872a-613ad0ec7984 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:47.978930 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1487/2941] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:50.968220 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a31efb-ce7a-40e6-8d8e-9b3ee55b3523 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:50.968776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a31efb-ce7a-40e6-8d8e-9b3ee55b3523 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:50.968776 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a31efb-ce7a-40e6-8d8e-9b3ee55b3523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:50.988574 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b0a31efb-ce7a-40e6-8d8e-9b3ee55b3523 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:50.989824 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b0a31efb-ce7a-40e6-8d8e-9b3ee55b3523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:50.998366 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1455/2942] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 23:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:39:51.018345 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017d97a-ecbc-4589-872a-613ad0ec7984 service nova] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:51.029619 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017d97a-ecbc-4589-872a-613ad0ec7984 service nova] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:51.035072 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0f105-6e01-49ea-b338-86c021b883b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:51.035661 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0f105-6e01-49ea-b338-86c021b883b5 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:51.035940 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0f105-6e01-49ea-b338-86c021b883b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:51.036215 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0f105-6e01-49ea-b338-86c021b883b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:51.045037 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0f105-6e01-49ea-b338-86c021b883b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:51.046637 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0f105-6e01-49ea-b338-86c021b883b5 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:51.055968 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1488/2943] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:54.146621 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a8781-7a2d-4f62-a8b7-fed96636caa3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:54.147151 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a8781-7a2d-4f62-a8b7-fed96636caa3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:54.147254 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a8781-7a2d-4f62-a8b7-fed96636caa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:54.167124 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a48a8781-7a2d-4f62-a8b7-fed96636caa3 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:54.168356 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a48a8781-7a2d-4f62-a8b7-fed96636caa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:54.176954 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1456/2944] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 23:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:39:54.197980 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0f105-6e01-49ea-b338-86c021b883b5 service nova] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:54.209596 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0f105-6e01-49ea-b338-86c021b883b5 service nova] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:54.214935 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b1d7-4f18-4543-83c4-11933ad221fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:54.215554 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b1d7-4f18-4543-83c4-11933ad221fd service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:54.215995 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b1d7-4f18-4543-83c4-11933ad221fd service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:54.216442 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b1d7-4f18-4543-83c4-11933ad221fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:54.224335 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b1d7-4f18-4543-83c4-11933ad221fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:54.225886 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b1d7-4f18-4543-83c4-11933ad221fd service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:54.235938 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1489/2945] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:39:58.328855 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c0b2e-5b96-4277-8945-cbdd85948ed4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:58.329399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c0b2e-5b96-4277-8945-cbdd85948ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:58.329399 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c0b2e-5b96-4277-8945-cbdd85948ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:58.349114 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-686c0b2e-5b96-4277-8945-cbdd85948ed4 None None] MFA Rules not processed for user `2b404d3419014a9a8edff785259ec500`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:58.350308 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-686c0b2e-5b96-4277-8945-cbdd85948ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:58.358826 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1457/2946] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 23:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:39:58.381721 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b1d7-4f18-4543-83c4-11933ad221fd service nova] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:58.393000 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b1d7-4f18-4543-83c4-11933ad221fd service nova] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:58.398655 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea233-79ce-4d05-aea9-f141e2a6e3e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b0698294e94845ae0dbdfb87059755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:58.399271 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea233-79ce-4d05-aea9-f141e2a6e3e5 service nova] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:58.399553 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea233-79ce-4d05-aea9-f141e2a6e3e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:58.399823 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea233-79ce-4d05-aea9-f141e2a6e3e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:58.408411 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ea233-79ce-4d05-aea9-f141e2a6e3e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:58.410041 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ea233-79ce-4d05-aea9-f141e2a6e3e5 service nova] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:58.420368 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1490/2947] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:40:08.343895 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=39 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:08.415333 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=64 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:29.421134 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c0b2e-5b96-4277-8945-cbdd85948ed4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:29.422589 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-686c0b2e-5b96-4277-8945-cbdd85948ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:29.484599 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea233-79ce-4d05-aea9-f141e2a6e3e5 service nova] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:29.486049 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-e61ea233-79ce-4d05-aea9-f141e2a6e3e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:29.500985 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea233-79ce-4d05-aea9-f141e2a6e3e5 service nova] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:29.501569 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c0b2e-5b96-4277-8945-cbdd85948ed4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:29.506697 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:29.507364 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:29.507747 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:29.507868 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] PATH_INFO: `/v3/users/42a1ed716ae14d9780652fc18b4bade9` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:29.508149 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64a64d-999a-49fd-8feb-afb98c6ecd63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '559a4af215324597b203e6866cb51fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:29.508660 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64a64d-999a-49fd-8feb-afb98c6ecd63 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:29.508950 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64a64d-999a-49fd-8feb-afb98c6ecd63 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:29.509229 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64a64d-999a-49fd-8feb-afb98c6ecd63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:29.510069 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a1ed716ae14d9780652fc18b4bade9)` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:29.511158 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fe64a64d-999a-49fd-8feb-afb98c6ecd63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:29.512152 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:29.525082 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64a64d-999a-49fd-8feb-afb98c6ecd63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:29.526720 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64a64d-999a-49fd-8feb-afb98c6ecd63 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:29.537449 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1458/2948] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:40:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:40:29.561954 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a1ed716ae14d9780652fc18b4bade9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:40:29.569909 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a1ed716ae14d9780652fc18b4bade9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:40:29.581457 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a1ed716ae14d9780652fc18b4bade9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:40:29.582145 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a1ed716ae14d9780652fc18b4bade9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:40:29.583018 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.notifications [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a1ed716ae14d9780652fc18b4bade9'} {{(pid=81387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:40:29.595764 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1491/2949] 10.222.0.33 () {58 vars in 1224 bytes} [Mon Sep 12 23:40:29 2022] DELETE /identity/v3/users/42a1ed716ae14d9780652fc18b4bade9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:40:29.775235 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64a64d-999a-49fd-8feb-afb98c6ecd63 service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:29.789127 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64a64d-999a-49fd-8feb-afb98c6ecd63 service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:29.846867 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f479c-e9c5-4452-94cd-10ba899102f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b404d3419014a9a8edff785259ec500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a803ea5f3c94589b38112108dcb63f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:29.847500 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f479c-e9c5-4452-94cd-10ba899102f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:29.847780 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f479c-e9c5-4452-94cd-10ba899102f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:29.848050 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f479c-e9c5-4452-94cd-10ba899102f3 admin admin] PATH_INFO: `/v3/projects/f186600d96d2442fad41c9f7172e3e47` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:29.849707 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f479c-e9c5-4452-94cd-10ba899102f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f186600d96d2442fad41c9f7172e3e47)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:29.851677 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f479c-e9c5-4452-94cd-10ba899102f3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:29.897742 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4c1f479c-e9c5-4452-94cd-10ba899102f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f186600d96d2442fad41c9f7172e3e47', 'request_id': 'req-4c1f479c-e9c5-4452-94cd-10ba899102f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:40:29.905525 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4c1f479c-e9c5-4452-94cd-10ba899102f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f186600d96d2442fad41c9f7172e3e47', 'request_id': 'req-4c1f479c-e9c5-4452-94cd-10ba899102f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:40:29.912661 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4c1f479c-e9c5-4452-94cd-10ba899102f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f186600d96d2442fad41c9f7172e3e47', 'request_id': 'req-4c1f479c-e9c5-4452-94cd-10ba899102f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:40:29.923422 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4c1f479c-e9c5-4452-94cd-10ba899102f3 admin admin] The token cache is being invalidate because project f186600d96d2442fad41c9f7172e3e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:40:29.923711 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4c1f479c-e9c5-4452-94cd-10ba899102f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:40:29.924343 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4c1f479c-e9c5-4452-94cd-10ba899102f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:40:29.925817 dv-cinder-852009-7-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1459/2950] 10.222.0.33 () {58 vars in 1233 bytes} [Mon Sep 12 23:40:29 2022] DELETE /identity/v3/projects/f186600d96d2442fad41c9f7172e3e47 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:40:39.592158 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:39.920344 dv-cinder-852009-7-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:22.862206 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] Authenticating user token {{(pid=81387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:22.863707 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:42:22.932575 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bcdd4-7702-4d0f-877c-7c0ea28a4629 admin admin] Validating token access rules against request {{(pid=81387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:22.990812 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbfa1b-4ca3-4390-878d-552f3842acd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '559a4af215324597b203e6866cb51fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd655924cf9a4736ba38740ade63ec52', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:22.991416 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbfa1b-4ca3-4390-878d-552f3842acd9 service placement] REQUEST_METHOD: `GET` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:22.991693 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbfa1b-4ca3-4390-878d-552f3842acd9 service placement] SCRIPT_NAME: `/identity` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:22.991962 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbfa1b-4ca3-4390-878d-552f3842acd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:22.993675 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.fernet_utils [None req-f7bbfa1b-4ca3-4390-878d-552f3842acd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:42:23.004864 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbfa1b-4ca3-4390-878d-552f3842acd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:23.006472 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbfa1b-4ca3-4390-878d-552f3842acd9 service placement] RBAC: Authorization granted {{(pid=81387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:23.016737 dv-cinder-852009-7-smb devstack@keystone.service[81387]: [pid: 81387|app: 0|req: 1492/2951] 10.222.0.33 () {60 vars in 1365 bytes} [Mon Sep 12 23:42:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:42:33.012570 dv-cinder-852009-7-smb devstack@keystone.service[81387]: DEBUG dbcounter [-] [81387] Writing DB stats keystone:SELECT=58 {{(pid=81387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}